I'm researching about augmented interfaces for sound design and music production by using graphic animations. Using a DAW can reduce a cost in every way. In digital sound design, How to control the parameter is important. How to manipulate the parameters will determine the artistry. In this research, We are developing tools that utilize visual movements. This tool aims to be efficient sound design or give new inspiration.
JackTopGuitar is a digital musical interface (DMI) that uses an electric guitar, microphone and foot pedal for a computer-based audio-visual live performance. It consists of voice commands, voice gestures, guitar gestures, pedal controls, and their combined actions. The performer can project videos and control various parameters of sequencers and effectors. The interface realizes real-time audio-visual musical performances. JackTopGuitar is based on the traditional electric guitar playing style, and its performing expression is augmented by the extra functions such as speech recognition. Visual expressions are not just visualization of vocal and guitar plays but a part of the performance created by the music and performer’s control.DEMO2017 DEMO2018 PAPER2018 PAPER2019