tubeshowcase●1,673,274 videos♡ My collection 0
← Technology

Technology03:31

AI image generator simulates synesthesia with the Teenage Engineering OP-Z

Engadget ↗

From the creator

AI-generated art is a new frontier rife with potential. But for every thorny question about copyright and the potential for widespread manipulation, generated art can also inspire wonder and awe. For example, look no further than this AI-powered experiment that creates kaleidoscopic visual landscapes for composed music. A collaboration between quirky synth and hardware brand Teenage Engineering and design studios Modem and Bureau Cool, the project draws inspiration from the neurological condition synesthesia. This rare phenomenon leads the brain to perceive sensory input for several senses instead of one. For example, a listener with synesthesia may see music instead of only hearing it, observing color, movement and shape in response to musical patterns. Conversely, a synesthetic person may taste shapes, feel words from a novel or hear an abstract painting. The audiovisual experiment uses the Teenage Engineering OP-Z sequencer as the music source that is then translated into AI art. In real-time, Modem and Bureau Cool’s “digital extension” translates musical properties into text prompts describing colors, shapes and movements. Those prompts then feed into Stable Diffusion (an open-source tool similar to DALL-E 2 and Midjourney) to produce dreamy and synesthetic animations. Modem co-founder Bas van de Poel sees the experiment as fuel for artists’ imaginations. “With the project, we see the potential for musicians to explore new forms of creativity, facilitating a joint perf

Published 2022-11-19 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.

Keep exploring Technology