Human-Robot Musical Interaction

2015-1215-07
researcher's name
affiliation
research field
Intelligent mechanics/Mechanical systems,Surgical dentistry
keyword

background

● Musical robots give the opportunity to study musical playing skills(Fig.1)
● Musical performance requires technical and creative skills
● An instrumental piece is generally composed by several instruments
● Non-verbal communication among players is essential for synchronization


summary


● Musical robots must be able to communicate with partner artists(Fig.2)
● Musical robots should recognize and send real-time non-verbal signals
● Sensor system for real-time non-verbal signals monitoring
● Multi-sensor: detects several signals at once (Fig.3)

predominance

● Musical robots can dynamically respond to partner players
● Musical robots can be integrated in a human ensemble (Fig.4)
● Musical robots and humans can interact freely during performance

application/development

● Joint musical performance sounds more natural
● Artists can add real-time their personal touch to the plain score
● Interesting proof of concept for human-robot dynamic non-verbal communication during a shared technical task

material

  • Fig.1 Waseda Musical Robots:WF4-VI flutist and WAS3 Saxophonist
  • Fig.2 real-time non-verbal communication during artistic performance
  • Fig.3 Multi-sensor system for real-time non-verbal communication
  • Fig.4 Performance naturalness

collaborative researchers

コセンティノ サラ

same researcher's seeds

posted: 2015/12/15