Interactive Breakout Game

Project Brief: 

Create an interactive game using a 3D camera,  computer vision, and Touch Designer to detect the user's position to drive the input controls of the game.

The person's position is derived from the computer vision bounding box that identifies a person is in the camera's field of view.

Software: 

Touch Designer, Roboflow (computer vision)

Programming Language: 

Python

Project Brief: 

Create an interactive art instillation using Touch Designer and a web cam to detect the user's position to drive the input controls that alter the visual output. 

Proximity to camera is derived from the cumulative sum of pixels that differ from the camera's view when no person is present. The greater the difference between images, the closer the person is to the camera.

Software: 

Touch Designer

Project Brief: 

Create a music visualiser that dynamically responds to four separated channels of the audio; voice, bass, drums, other. Use AI to extract the lyrics, then use the data to generate animated lyrics with the timing of the song.

Ryan's Role: Creative Coding

Programming Language: 

P5.js