Music Synthesis: Zip Zap Zop ball game | Tangible User Interfaces - Fall 2011

Music Synthesis: Zip Zap Zop ball game

jennifer_wang's picture

Wed, 11/16/2011 - 18:35 — jennifer_wang

Music game based on an icebreaker game called Zip Zap Zop. There are four cups (each with a photocell inside). When the ball is passed from one cup to another, it creates a drum tone depending on from whom and to whom the ball is passed.

Materials

4 photocells
4 220 ohm resisters

Arduino code

* 4 sensor reader

* Jennifer Wang

* Reads value from sensors at pins 0, 1, 2, 3 and outputs to serial, separated by commas

int sensorPin1 = 0; // select the input pin for the potentiometer

int sensorPin2 = 1;

int sensorPin3 = 2;

int sensorPin4 = 3;

int val1 = 0; // variable to store the value coming from the sensor

Serial.begin(9600);

val1 = analogRead(sensorPin1); // read the value from the sensor, between 0 - 1024

val2 = analogRead(sensorPin2); // read the value from the sensor, between 0 - 1024

val3 = analogRead(sensorPin3); // read the value from the sensor, between 0 - 1024

val4 = analogRead(sensorPin4); // read the value from the sensor, between 0 - 1024

/*Serial.print(val1);

Serial.print(",");

Serial.print(val2);

Serial.print(",");

Serial.print(val3);

Serial.print(",");

Serial.println(val4);*/

String str = String("") + val1 + "," + val2 + "," + val3 + "," + val4;

Serial.println(str);

Processing code

/* Jennifer Wang

* Alex Gaysinsky

* Margaret Rhee

* Sebastian Fuenzalida

* TUI Music Synthesis Project

* November 16, 2011

import ddf.minim.*;

import ddf.minim.analysis.*;

import processing.serial.*;

AudioPlayer tone1; // use AudioSnippet?

AudioPlayer tone2;

AudioPlayer tone3;

//AudioInput input;

AudioOutput out;

// keep track of the previous player and the current player, numbered 1-4

int prevPlayer;

String portname = "/dev/tty.usbmodem411"; // or "COM5"

int[] sensorVals; // 4-dimensional array values coming from sensors of players 1, 2, 3, 4

// ** calibrate for environmental conditions **

// sensor threshold values (i.e. the threshold between being ON and OFF)

int sensor1Threshold = 100; // threshold value for player 1

int sensor2Threshold = 400; // threshold value for player 2

int sensor3Threshold = 100; // threshold value for player 3

int sensor4Threshold = 300; // threshold value for player 4

//println(Serial.list()); // List COM-ports

//select second com-port from the list

//port = new Serial(this, Serial.list()[0], 9600);

port = new Serial(this, portname, 9600);

size(100, 100);

minim = new Minim(this);

tone1 = minim.loadFile("tone-1.mp3");

tone2 = minim.loadFile("tone-2.mp3");

tone3 = minim.loadFile("tone-3.mp3");

//input = minim.getLineIn();

out = minim.getLineOut(); // returns a stereo line out with buffer size of

// 1024 samples that plays 16 bit audio at 44100 Hz sample rate

// set loop points so each tone plays for 500 ms (1 beat at 120bpm) to cut off silence at end

tone1.setLoopPoints(0, 500);

tone2.setLoopPoints(0, 500);

tone3.setLoopPoints(0, 500);

//default start values for players

prevPlayer = 0;

}

//tone1.pause();

//tone1.close();

//tone2.pause();

//tone2.close();

//tone3.pause();

//tone3.close();

}

// play tone based on what player receives and what player passes

void play(int playerA, int playerB) {

//AudioPlayer tonex;

// do calculation to determine what tone is played

// add rhythm? loop(n) for looping n times - can do something depending on playerA, playerB, tone

if (playerA != 0) { // first player beginning doesn't make sound (not coming from another)

// tone depends on if passing to left, middle, or right (assuming clockwise orientation of players)

//int tone = (playerB - playerA) % 4;

if (playerA > playerB) tone = playerB - playerA + 4;

else tone = (playerB - playerA) % 4;

case 1: // left

//tone1.play(0); //play tone depending on path

//delay(500); // wait half second

//tone1.pause();

//tone1.rewind();

case 2: // middle

//tone2.play(0); //play tone depending on path

//delay(500); // wait half second

//tone2.pause();

//tone2.rewind();

case 3: // right

//tone3.play(0); //play tone depending on path

//delay(500); // wait half second

//tone3.pause();

//tone3.rewind();

// tonex.play(); play tone depending on path

// delay(500); wait half second

// tonex.pause();

// tonex.rewind();

// OR tonex.loop(1) to loop once (or use 0?), play for 500 ms

/* I think the basic idea for an algorithm went as follows:

- each player's cup (with photocell) can trigger up to 3 sounds with the tennis ball

- Sebastian added the constraint that the sound triggered depends on the direction from which the ball is received (3 possible paths in the 4-player use case on pic)

- as the focus is passed from player to player, unique sound patterns are created (just like in Zip Zap Zop, except each person triggers a sound instead of voicing it)

- each sound could be a tone (instrument) or an audio sample (voice/music/noise) - i will take this task

- each player could effect the pitch of the playback output (or other effects) - could be a potentiometer or FSR, at the discretion of the person building the circuit

- anything else..??

arrayMaker(k, n) {

rhythm[] = array of n 1s followed by k-n 0s

}

euclidRhythm(rhythm[]) {

k = count of repeated sequences from the beginning

n-k = count of repeated sequences from the end

if (k > n-k) // more 1s than 0s

merge n-k last elements into first n-k elements

else // less 1s than 0s

merge n last elements into first n elements

euclidRhythm(rhythm[])

}

*/

}

// the AudioPlayer you got from Minim.loadFile()

//tonex.close();

// the AudioInput you got from Minim.getLineIn()

// this calls the stop method that

// you are overriding by defining your own

// it must be called so that your application

// can do all the cleanup it would normally do

}

void serialEvent(Serial p) {

// get the ASCII string:

String inString = port.readStringUntil('\n');

if (inString != null) {

// trim off any whitespace:

inString = trim(inString);

// convert to integer array that carries two ints for valx and valy

// raw sensor values: sensorVals[0] is from sensor 1, sensorVals[1] is from sensor 2,

// sensorVals[2] is from sensor 3, sensorVals[3] is from sensor 4

sensorVals = int(split(inString, ","));

println(sensorVals);

//println(sensorVals[0]+","+sensorVals[1]+","+sensorVals[2]+","+sensorVals[3]);

// play sound depending on the path of ball from player to player

if (sensorVals.length == 4) { //prevent array out of bounds error since arduino/processing interface is buggy

if (sensorVals[0] < sensor1Threshold && curPlayer != 1) { // player 1 gets ball

prevPlayer = curPlayer;

println("coming into sensor 1?");

else if (sensorVals[1] < sensor2Threshold && curPlayer != 2) { // player 2 gets ball

prevPlayer = curPlayer;

println("sensor 2?");

else if (sensorVals[2] < sensor3Threshold && curPlayer != 3) { // player 3 gets ball

prevPlayer = curPlayer;

println("sensor 3??");

else if (sensorVals[3] < sensor4Threshold && curPlayer != 4) { // player 4 gets ball

prevPlayer = curPlayer;

println("player 4");

println("curPlayer is " + curPlayer + ", prevPlayer is " + prevPlayer);

play(prevPlayer, curPlayer);

}

zip zap zop game

Average:

Your rating: None

Synthesis: Music Instrument (group work)

Login to post comments

Recent Posts

Title	Name	Type
Arduino and Processing	deepaks	Blog entry
Welcome to the course website!	admin	Blog entry