Creative Developer/Technologist on Project
My contributions include:
- Creating and projection mapped all visuals, using TouchDesigner and GLSL, for the show what were on the backdrop and "The Instrument"
- Created synth patch within Max that was used throughout the show that was connected to "The Instrument." In this patch we took advantage of FluComa, a machine learning library in Max, to allow Guillermo to search/glide through recordings he has created throughout his career. The patch also had simple audio effects (reverb, delay, distortion) and a FM/AM synth.
- The networking architecture for all sensors on "The Instrument" to communicate to the Max and TouchDesigner patches. This primarily using OSC for sensor data from "The Instrument" and websocket for wireless webcam for image processing.
- Coordinated/triggered all visuals to align with the proper section of the show.
Main softwares used through project included: Max, TouchDesigner, PyTorch/Librosa, Ardunio IDE, and a lot of debugging tools.
