MIDI Board Experiments

  • MIDI
  • generative
  • real-time
  • TouchDesigner
  • Resolume
  • live-performance
  • interaction
Role
Interaction Designer, Visual Manipulator
Tools
TouchDesigner · Resolume · MIDI Controller
Duration
2 weeks
Output
Real-time generative system with MIDI macro-mapped control
Date
January 2024

Overview

This project explores how tactile interfaces — specifically MIDI controllers — can transform real-time generative systems into responsive visual instruments. The approach involves macro-mapped control logic allowing single physical interactions to modify multiple parameters simultaneously.

Each fader or knob was macro-mapped to influence multiple visual dimensions — shape, movement, feedback, colour depth, and speed — all at once. One gesture, many outputs.

System Architecture

MIDI Knobs / Faders

Multi-Parameter Mapping

  Visual Engine (TD)

     Projection

TouchDesigner Layer

MIDI input was parsed and mapped to generative controls in TouchDesigner. Parameters included motion, speed, shape distortion, colour ramping, and glitch behaviours — all manipulated in real time without pre-rendered content.

Resolume Layer

MIDI-mapped values were also routed into Resolume for layered post-process effects — blending, feedback, and colour grading on top of the generative TD output. This created a two-layer system: generative source in TouchDesigner, processed output in Resolume.

Key Outcomes

  • Designed a macro-mapped control scheme using MIDI
  • Integrated real-time generative visual system in TouchDesigner
  • Extended MIDI routing into Resolume for layered visuals
  • Created a modular base reusable for VJ and interactive setups

MIDI mapping overview

TouchDesigner patch

Visual output — shape mapping

Visual output — colour depth

Setup