Opera Leverages Artificial Intelligence to Empower Non-Verbal Individuals with Disabilities

A groundbreaking new opera, “Sensorium Ex,” debuted at a Nebraska festival this summer, blending art and artificial intelligence to enhance the representation of people with non-verbal disabilities. The production, from composer Paola Prestini and librettist Brenda Shaughnessy, uses AI-driven voice technology developed in collaboration with NYU’s Ability Project to provide non-verbal actors a means of expressively participating on stage. This open-source system interprets physical vocalizations and movements, recreating the actor’s personal voice through artificial means. The opera, which centers on a disabled protagonist, signals a shift towards greater inclusivity in the performing arts, illustrating both the social promise of AI and the evolving relationship between technology and culture.

Read more