We introduce the notion of musical gestures as time varying measurements which identify the audio input stream’s musical skeleton without attempting to implement any involved model of musical understanding. Living comfortably at an intermediate level of abstraction between wave forms and music transcriptions, these musical gestures are used to control the behavior of an audio processing module. The resulting scheme qualifies as an audio effects processing system as it essentially transforms an audio stream into another.