Motion tracking based conducting experience

In his master’s thesis, Emergo co-founder Paul Redetzky developed a motion-tracking-based virtual conductor experience in which the user is presented with a conductor’s performance and has to imitate it as accurately as possible. She gets positive feedback when she conducts correctly in time and negative feedback when she conducts incorrectly. In addition to the implementation of the application, a study was designed to analyze the immersion of the users. The study could only be conducted as a pilot study due to the COVID-19 pandemic.

Crucial tasks in developing the application were:

• Implementation of motion capturing with the Phase Space Impulse 2XE motion capturing suite.
• Implementation of an algorithm to analyze and evaluate the movement of the user
• Design of a study to evaluate the immersion of the user