Intel’s news source for media, analysts and everyone curious about the company.

Intel Helps Facilitate AI Language Recognition (English Only)

Presented at the Conference on Neural Information Processing Systems, two datasets help catalog dozens of languages.



Today at the annual Conference on Neural Information Processing Systems (NeurIPS), two Intel-supported whitepapers on spoken language datasets are being presented. The first paper, The People’s Speech, targets “automatic speech recognition” tasks; the second is Multilingual Spoken Words Corpus (MSWC), which involves “keyword spotting.” Datasets coming out of each project contribute a sizeable volume of rich audio data, and each is among the largest collection available in its class.

The MSWC paper is co-authored by Keith Achorn, an AI frameworks engineer in Intel’s Software and Advanced Technology Group (SATG). Keith talks about his experiences on the project in a blog on the Intel Community site.

The People’s Speech and MSWC projects started in 2018, under the auspices of ML Commons, to identify and chart the 50 most used languages in the world into a single dataset, and then figure out a way to make the data useful. Group members came from Intel, Harvard, Alibaba, Oracle, Landing AI, University of Michigan, Google, Baidu and others.

In today’s diverse international, multilingual work environment, the ability to accurately transcribe and translate becomes increasingly important. With these datasets, a computer using artificial intelligence can “hear” a spoken word and produce an automatic transcript or translation.

Both projects utilize “diverse speech,” which means they better represent a natural environment, complete with background noise and informal speech patterns with a mixture of recording equipment in different acoustic environments. This stands apart from highly controlled content such as audiobooks, which are more “sanitized.”  Training on diverse speech has been correlated with better accuracy in real-world use.

The People’s Speech project includes tens of thousands of hours of supervised conversational audio. It is now among the world’s largest English speech recognition datasets licensed for academic and commercial usage, and is free to download.

MSWC is an audio speech dataset that has more than 300,000 keywords in dozens of languages, and can be accessed by smart devices. The MSWC is dataset spans languages spoken by over 5 billion people, and advances the research and development of voice applications for a wide global audience.

Both datasets will be widely available for users. They are licensed with extremely permissive licensing terms, including commercial use.

Acerca de Intel

Intel (Nasdaq: INTC) es una empresa líder en la industria, creando tecnología que cambia al mundo, habilita el progreso mundial y enriquece vidas. Inspirados en la Ley de Moore, continuamente avanzamos en el diseño y la fabricación de semiconductores para ayudar a enfrentar los desafíos más grandes de nuestros clientes. Al integrar inteligencia en la nube, las redes, el edge y toda clase de dispositivos de cómputo, liberamos el potencial de los datos para transformar y mejorar a las empresas y la sociedad. Si deseas conocer más sobre las innovaciones de Intel, visita e

© Intel Corporation, Intel, el logotipo de Intel y otras marcas de Intel son marcas registradas de Intel Corporation o sus subsidiarias. Otros nombres y marcas pueden ser reclamados como propiedad de otros.