OPEN STUDIO: Expanded Instruments, Live Coding and Machine Learning

 

OPEN STUDIO: Expanded Instruments, Live Coding and Machine Learning

EMPAC Studio 1

November 11, 2019 3:00 PM - 5:00 PM

The sound component employs two systems for musical “expanded instruments”, one based on the Expanded Instrument System (EIS) designed by Pauline Oliveros, and the second designed by Michael Century for performance on a piano with auto-play capabilities.  All electronic sounds are spatialized in the Goodman studio’s 36 channel immersive speaker system, with programming support by PhD student Matthew Gantt.

EIS is used by special permission from the Pauline Oliveros Trust and The Ministry of Maåt.

The visual component combines live coding of images with an auto-visual system built with a machine learning (ML) system.  The ML employs a trained Generative Adversarial Network (GAN) that creates real-time imagery from audio spectra and audio feature data ingestion. This ML auto-decides how to further manipulate the imagery in Touch Designer from pre-trained artist's feedback.

In addition, a soundscape composition is presented with a machine-learning based visual system, inspired Shakespeare’s play The Tempest. Sonically, The Isle i is Full of Noises uses poetic text, phonemic particles of language, birds, animals, newly adapted for higher order ambisonic spatialization. The visual component combines live generation of images with an auto-visual system trained on two feature films: Videodrome and Planet of the Apes.

Add to calendar
Share|