Back to Projects

RoboTheater: A Multi-Robot Storytelling Platform from LLM Scripts to Stage Performance

Multi-Robot Systems | Swarm Robotics | HRI | MQTT | LLM | TTS | Tangible | Storytelling

overview.

Designed and implemented RoboTheater, an automated end-to-end platform that translates Generative AI (LLM) scripts into synchronized multi-robot stage performances. We developed a multimodal mapping pipeline that autonomously converts structured JSON scripts into coordinated robotic motion primitives, ElevenLabs-driven expressive speech, and Midjourney-generated environmental projections. The system utilizes an MQTT-based wireless architecture to ensure sub-millisecond synchronization across a swarm of modular robots, effectively bridging computational narrative with physical embodiment. Through pilot user studies, the platform demonstrated high efficacy in conveying complex emotions and character relationships through spatial choreography and rhythmic timing.

Open to collaboration.

I'm always interested in new opportunities and exciting projects. Whether you have a project in mind or just want to chat about tech, I'd love to hear from you.

Currently available for internships and full-time job opportunities

Response time: Usually within 24 hours

© 2026 Chenwan Halley Zhong