表題番号:2017K-220 日付:2018/04/09
研究課題Providing automatic realtime feedback on temporal parameters of speech for second language fluency development
研究者所属(当時) 資格 氏名
(代表者) 理工学術院 創造理工学部 准教授 ローズ ラルフ レオン
研究成果概要

This research project focused on the development and user testing of a computer application called Fluidity which is designed to help second language learners develop their speed fluency by giving real-time feedback on fluency-related features of speechin a manner that resembles human-human communication.

At first, several speech researchers in Lisbon, Portugal who are experts in second language fluency and digital signal processing were consulted. Their advice included detailed recommendations about application design and audio libraries for signal processing.

Thereafter, Fluidity was completely reprogrammed. Two main practice functions were implemented: scripted speech and free speech practice. Also, a virtual character named Fludie was added, which gives feedback to the learner via facial expressions. Also implemented were different visualizations of the learner's speech for review purposes.

Finally, Fluidity underwent user testing by a number of second language learners in Portugal, France, and the United States. Afterward, each user completed a survey about their experience. Responses to Fluidity were very positive, with many users saying they would likely use it for their own language learning purposes.

The new version of Fluidity and results of user testing were presented to various professional audiences in Portugal, France, Germany, Belgium, and the United States, who gave expert suggestions for further development. It is anticipated that an alpha version of the application will be released during AY2018.