您当前的位置是:  首页 > technology > Corporate communications > technology > voice communication > Technical dynamics >
  Home >technology > Corporate communications > technology > voice communication > Technical dynamics > Microsoft Instantly Converts Lecture Content to Text Using Speech Recognition

Microsoft Instantly Converts Lecture Content to Text Using Speech Recognition

- Let hearing-impaired students learn to be accessible

2018-04-09 15:29:16 Author: Source:CTI ForumComment:0  Click:


Hearing-impaired students also have new aids in class. Microsoft uses automatic speech recognition technology to instantly transfer what the professor has taught in class to words to help students learn more efficiently.
Microsoft's official blog on the 5th published the use of AI technology to assist deaf students to learn the achievements of Presentation Translator, through speech recognition technology, will be taught in the classroom speech content into text, to help deaf students can synchronize to get the most complete and accurate Information, and through AI technology to achieve translation, can now support more than 60 languages, the system can instantly translate into different languages, allowing students to choose their own more familiar language to learn.
The Microsoft team started last year with the National Institute of Deaf Education at the University of Rochester, New York, USA. In order to create a model that can correctly identify the academic terms in the classroom, the research team collected more than 10 years of classroom lectures from the college. Data, including texts and annotations given by professors in the briefings, AI techniques to identify proper nouns in each specific domain. When professors speak proper nouns in the classroom, the system will be able to automatically identify and provide instant text. .
When there are hearing impaired students in the classroom, the college will employ a sign language interpreter to convert the content taught by the professor in class into sign language to help students understand the content of the class, but also because of the conversion between spoken language and sign language. Students are not able to keep up with the contents of the professors immediately. When the students are still learning the formula information through the sign language, the professor's slides have been switched to the next page. Plus, some students are not very familiar with sign language. Learning in class is difficult.
Microsoft has partnered with the National Institute of Deaf Education at Rochester Institute of Technology. The polytechnic has about 1,500 hearing-impaired students. Microsoft has added real-time captions to the presentation software Power Point. , Through speech recognition technology, the professor's words, including terminology and spoken words, are translated into punctuation marks and presented on the projection screen. Now they can support more than 60 translation languages. Students can also use their own computers. Or on the tablet, choose your own language to learn.
Joseph Adjei, a first-year student at the college, said that when he first entered the school, he spent a lot of time in sign language. When he first came into contact with the instant voice-to-text service in class, he thought Through this phonetic transcription, you can receive information at the same time as your acquaintance. For example, in the biology class, you can let him follow the course, and you can also learn to spell correctly those classes in the classroom. There is a noun.
In addition, Joseph Adjei believes that the phonetic transcription service is an additional aiding learning tool. When he can't read the sign language or transliterate the missing message from the sign language, he can also read the speech and turn the text to assist. However, he pointed out that there are still some words that will identify mistakes, such as "I" and "Eye", but it is better if there is a reference to the text.
In addition, Joseph Adjei also used Microsoft's translation app on smart phones. When the class was discussed, sometimes the students spoke too quickly and it was not easy to read lips. Microsoft Translation App could show the contents of the classmates' speeches and let him more. Can participate in class discussions.
[Disclaimer] This article only represents the author's own opinion and has nothing to do with the CTI Forum. The CTI Forum maintains its neutrality in the presentation of statements and opinions, and does not provide any express or implied warranty for the accuracy, reliability or completeness of the contents contained therein. Readers are for reference only, and please bear full responsibility for yourself.

Topics