表題番号:2019C-544 日付:2020/07/13
研究課題Development of gesture recognition system for therapy applications
研究者所属(当時) 資格 氏名
(代表者) 理工学術院 国際理工学センター(理工学術院) 准教授 コセンティノ サラ
研究成果概要
This project stemmed from the selected kakenhi project Wakate B 17K18178, and served as a base for continuing research on robotic platforms for cognitive and social therapy applications. We developed two systems: a gesture recognition system to analyze human movement via real-time video data analysis, a system for movement input recognition, and a system for real-time video gaze direction recognition. These systems were integrated in two therapy session protocols for ASD children, for social training interaction robotic therapy using our WAS Waseda Anthropomorphic Saxophonist robot.
From the analysis of body movement and gaze direction, as well as, if present, facial expression, the robot can recognize basic interactive behaviors and emotional patterns of the child, and adapt its performance consequently, following the suitable therapeutic protocol. In this way, also the effects of both active and receptive music therapy can be combined, as the robot can choose appropriate melodies and music tunes according to the current needs of the child under therapy.
This supporting grant was useful in running more experiments and refining the prototype systems developed during Wakate B 17K18178.