2025-12-04
Enhancing the audience experience for VR and AR theatre with AI-generated subtitles
Publication
Publication
Recent technological developments on AI and immersive media are transforming the artistic landscape, providing novel mechanisms for artists and audiences. Following a human-centric approach, together with a theatre company in Greece, this paper investigates how subtitle placement affects user experience and cognitive load in a live theatre performance enhanced by AR glasses. To do so, we design and develop a system for displaying subtitles in VR and AR. We evaluated the system in two conditions (N = 19;N = 12), both in a controlled environment (VR) and an actual theatre (AR). In the latter, we integrate AI solutions to provide automatic captioning and translation in real time, and VFX to further augment the experience. Our quantitative and qualitative results showed no difference between subtitle placements in terms of cognitive load and user experience, with users equally liking the two proposed approaches. Results also highlighted the perceived usefulness of AR to enhance theatre performances, indicating new paths for wider accessibility and further immersion.
| Additional Metadata | |
|---|---|
| , , , , | |
| doi.org/10.1145/3756884.3766057 | |
| Voice driven interaction in XR spaces | |
| VRST '25: 31st ACM Symposium on Virtual Reality Software and Technology | |
| Organisation | Distributed and Interactive Systems |
|
Viola, I., Ahsan, M., Chatzifoti, O., Yonkov, A., Oikonomou, E., Radin, I., … César Garcia, P. S. (2025). Enhancing the audience experience for VR and AR theatre with AI-generated subtitles. In VRST '25: Proceedings of the 2025 31st ACM Symposium on Virtual Reality Software and Technology (pp. 71:1–71:11). doi:10.1145/3756884.3766057 |
|
