ALL EXPERIMENTS06 / 07 — A piece of the world becomes a score

Color Sequencer / Sampler

Capture the colors, play the world back

What would a photograph sound like if its colors became musical decisions?

MY ROLE
Concept, interaction design and development
CONTEXT
Independent exploration of image and sound
STATUS
Experimental instrument
06 / COLOR SEQUENCER

Listen to
the colors.

An image becomes a score. Color translates into pitch, duration and intensity.

AN INTERACTIVE STUDY INSPIRED BY THE PROJECT
CHROMATIC STUDY / 0018 STEPS · 112 BPM

ONE COLOR, ONE NOTE.

From input to experience.

THE INTERACTION LOOP
  1. 01

    Capture

    Take a photograph of the world around you.

  2. 02

    Reduce

    Average its pixels into a grid of colors.

  3. 03

    Sequence

    Map color channels to pitch, duration and velocity.

  4. 04

    Shape

    Adjust the grid, tempo, scale and effects.

01 / The material

Start with something around you

The instrument captures a photograph of the real world and reduces it to a grid. Each cell holds the average color of a group of pixels, turning visual detail into a surface for sequencing a sample.

Changing the grid size changes the material available to the sequencer. The source remains a piece of the world you chose to capture.

02 / The mapping

Color makes musical choices

Different color channels control different musical dimensions: note pitch, duration and velocity. The image becomes a set of relationships that can be heard as well as seen.

Automatic pitch detection helps establish a scale. The mapping connects a captured image to a musical structure that the user can continue to shape.

03 / The play

Keep the result open

Grid size, tempo and scale type remain adjustable. Reverb and delay give further ways to transform the sound after the image has supplied its initial pattern.

The photograph is a starting point for playing with a sample: capture a scene, listen to the pattern it suggests and reshape that pattern through the controls.

WHAT THIS PROJECT EXPLORES

A photograph becomes material for composition, with room left for the person playing it.

Creative coding / Sound / Image processing / Interaction design
Back to selected work Explore the full archive