2005 Rockefeller New Media Foundation Proposal

Abstract

We propose to study the nature of the computer controlled real-time interactive audio visual presentation system. We want to create a multipurpose toolkit and interface for this medium by developing a symbolic graphic language and notational system for it. Our goal is to create a visual language that will drive the toolkit, and allow a non-programmer to design computer controlled audio visual presentations. The outcome of this toolkit will be a software application accessible to anyone. A music teacher will be able to link the position of her hand to a relative audio frequency and color. A performer might use the software to control lighting based on the loudness of his voice. The creative possibilities for an accessible multipurpose software are limitless.