, , , & , Game of tones: Learning to play songs on a piano using projected instructions and games, in Matt Jones, Philippe A. Palanque, Albrecht Schmidt, & Tovi Grossman (eds.), CHI Conference on Human Factors in Computing Systems, CHI'14, Toronto, ON, Canada - April 26 - May 01, 2014, Extended Abstracts,411-414 (ACM ). DOI  PDF


Learning to play a musical instrument such as the piano requires a substantial amount of practice and perseverance in learning to read and play from sheet music. Our interactivity demo allows people to learn to play songs without requiring sheet music reading skills. We project a graphical notation on top of a piano that indicates what key(s) need to be pressed and create a feedback loop that monitors the player's performance. We implemented The Augmented Piano (TAP), which is a straightforward combination of a physical piano with our alternative notation projected on top. Piano Attack (PAT) extends TAP with a shooting game that continuously provides game-based incentives for learning to play the piano.

«  Interdisciplinary design of a pervasive fall handling system | Exploring social augmentation concepts for public speaking using peripheral feedback and real-time behavior analysis »