15 / Experiments & systems

color-sequencer-sampler

Creative TechEmbedded

A photograph becomes a score; color becomes pitch, duration, and velocity.

color-sequencer-sampler is a camera-based sequencer and sampler that captures a piece of reality and turns it into a grid used to sequence and modulate sound.

The problem

Many image-to-sound experiments stay either too abstract or too uncontrolled musically. This project explores a more structured idea: using a captured image as the basis for a sequencer whose musical behavior remains editable and grounded.

Design & implementation

The system captures a photo of the real world and reduces it to a grid where each cell represents the average of a group of pixels. That grid becomes the base surface for sequencing a sample.

Different color channels are mapped to different musical dimensions: one channel for note pitch, one for note length, and one for velocity. The system also detects pitch automatically so it can establish a scale, then lets the user shape the musical result further by changing the grid size, tempo, scale type, and effects such as reverb and delay.

The result is not just image sonification. It is a visual sequencing system where a captured scene becomes structured control data for a sampler.

What it does

  • Captured image reduced to a sequencing grid
  • Different color channels mapped to pitch, duration, and velocity
  • Automatic pitch detection to establish a scale
  • Adjustable grid size, tempo, scale type, reverb, and delay

Why I built it

color-sequencer-sampler matters because it turns a fragment of reality into a playable musical structure. It shows how image capture can become an expressive sampler workflow instead of remaining a purely visual recording.