Reserch & Development

Research and Creation for Music, Sound Design and Visuals

Follow

Sound Design Tools(Max for live)

I'm researching about augmented interfaces for sound design and music production by using graphic animations. In this research, We are developing tools that utilize visual movements. This tool aims to be efficient sound design or give new inspiration.

サウンドデザインツール開発を通した新しい表現の拡張を目指しています.視覚情報と音情報(コンピュータで操作可能なパラメータ)を様々なアプローチでつなげて,音楽的に新しいあるいは,効率的な音生成を行えるツールを研究開発するプロジェクトです.

[Github]

JackTopGuitar

JackTopGuitar is a digital musical interface (DMI) that uses an electric guitar, microphone and foot pedal for a computer-based audio-visual live performance. It consists of voice commands, voice gestures, guitar gestures, pedal controls, and their combined actions. The performer can project videos and control various parameters of sequencers and effectors. The interface realizes real-time audio-visual musical performances. JackTopGuitar is based on the traditional electric guitar playing style, and its performing expression is augmented by the extra functions such as speech recognition. Visual expressions are not just visualization of vocal and guitar plays but a part of the performance created by the music and performer’s control.

JackTopGuitarは,音声認識技術をベースとした、エレキギター演奏によるオーディオビジュアルパフォーマンスプロジェクトです。マイクからの音声入力、ギター演奏を考慮したインターフェースを設計することで、音や映像を提示し、表現拡張を目指したプロジェクトです。

DEMO2017 DEMO2018 PAPER2018 PAPER2019