Dynamix

2024

Course: 6.8510 Intelligent Multimodal User Interfaces

Instructors(s): Randall Davis

Collaborator(s): Liam Kronman

Introduction

Dynamix is a novel system designed to automate DJ functions by dynamically interpreting the affective state of a crowd in real time. Utilizing a laptop webcam, advanced affect recognition models, and audio processing and manipulation tools, Dynamix enhances party atmospheres by optimizing music selection and transitions based on crowd emotion, aiming to maintain and elevate the overall energy of the venue.

Implementation

Contributions

Kelly Fang developed the Data Capture, Emotion Recognition, and Emergency Transition Detection Modules. She also worked on integrating the modules together into a system and experimenting with the user interface to reduce latency. Liam Kronman developed the Music Selection and Song Transition Modules. He also set up the music database by downloading songs and processing them with Spotify’s API. The user testing was conducted by Liam at his fraternity’s party room.