FP: Xander Koo, Cassie Wang, Omari Matthews, Eric Garcia, 2021

Hear Me Move

Eric Garcia showing movement analysis and sequencer

Using PoseNet and Wekinator, Hear Me Move transforms movement generation into a way of concurrently generating audio, blurring the distinction of influence between these two art forms. Historically, dance has been used as a way to physically interpret and embody music and sound. But what happens when we reverse the dynamic between movement and sound? How can a machine-interpretation of our own movement both surprise and challenge us? Hear Me Move gives users a real-time translation of their movement into sound, confronting users with a reflection of their own physicality. What possibilities will this confrontation open up in terms of user response?