Gate of Music: An Assistive Digital Web-Based Musical Instrument

Abstract

This thesis presents the design and implementation of Gate of Music, a web-based assistive digital musical instrument that enables users to transform their smartphones into expressive musical interfaces. The system maps phone-based interactions, such as touch, motion, and orientation, into MIDI signals, which are received by a host computer and translated into musical output defined by a coordinator. Gate of Music consists of two main components: a simple and colorful interface for players, designed around assigned interaction behaviors, and a control interface for the coordinator to manage mappings and structure musical performances in real time. The system was built to minimize setup complexity, eliminate the need for specialized hardware, and adapt to users with different cognitive and physical abilities. The instrument was co-designed and evaluated in collaboration with inclusive music groups, including participants with mental and motor disabilities, professional musicians, and educators. Real-world testing in workshops and live performances highlighted both the creative potential of the tool and its usability in inclusive contexts. Key limitations identified include touch latency and the need for more robust offline functionality. Overall, the project contributes a flexible, sustainable, and socially grounded approach to accessible digital instrument design. It reinforces the value of participatory methodologies and proposes web technologies as a viable path toward inclusive musical expression.