RAIN ROOM

A 3D and ML-POwered interactive installation for Zest & CO’s AUSTIN CITY LIMITS SILENT DISCO AFTER Party in OCTOBER 2023. Explored Rain PaRticle Systems in THREE.JS and Mediapipe Hand Interactions.

This installation built a digital jungle and 3D particle rain system in Three.js with a custom particle shader that moved, changed direction, and color based on disco-er’s hand input and gestures interpreted by the MediaPipe library. Partygoers could control the color, size, and velocity of the particle rain system based on the pitch, roll, and yaw (XYZ) placement of their hand over a hidden webcam, ot experience unexpected changes to the system via distinct hand gestures, blurring the lines between artists and viewers, and adding an interactive dimension to the silent disco.

Built by Kellyn Dassler (Lead Creative Technologist) and Alexander Kennedy (Lead Mechanical Engineer)

Mediums: Three.js, MediaPipe, HLSL/GLSL (Shaders)