Contactless Measurement of Emotional States in VR Simulations via Pupil Size Changes
FENG.02.07-IP.05-0061/23
Source of financing: Initiative "Incubator of Innovation 4.0." under the supervision of the CITTRU Center for Technology Transfer of the Jagiellonian University
Principal investigator: Michał Kuniecki, Emotion and Perception Lab, Institute of Psychology, Jagiellonian University in Krakow
Team:
Beata Pacula-Leśniak, Doctoral School in the Social Sciences, Jagiellonian University, Krakow
Radosław Sterna, Doctoral School in the Social Sciences, Jagiellonian University, Krakow
Agata Szymańska, Doctoral School in the Social Sciences, Jagiellonian University, Krakow
Paweł Jemioło, AGH University in Krakow, Krakow
Vladyslav Riabchuk, Jagiellonian University, Faculty of Physics, Astronomy and Applied Computer Science
Source of financing: Initiative "Incubator of Innovation 4.0." under the supervision of the CITTRU Center for Technology Transfer of the Jagiellonian University
Principal investigator: Michał Kuniecki, Emotion and Perception Lab, Institute of Psychology, Jagiellonian University in Krakow
Team:
Beata Pacula-Leśniak, Doctoral School in the Social Sciences, Jagiellonian University, Krakow
Radosław Sterna, Doctoral School in the Social Sciences, Jagiellonian University, Krakow
Agata Szymańska, Doctoral School in the Social Sciences, Jagiellonian University, Krakow
Paweł Jemioło, AGH University in Krakow, Krakow
Vladyslav Riabchuk, Jagiellonian University, Faculty of Physics, Astronomy and Applied Computer Science
Stage I: Development of a Contactless Physiological Measurement System for VR
Our innovation enables contactless measurement of physiological parameters, providing real-time insights into a user's emotional states.
At its core is a software library that analyzes pupil size and other physiological markers extracted from the video stream of VR headsets. The measurement process is completely unobtrusive, ensuring a seamless experience for the user. Unlike traditional behavioral assessments that rely on self-reported emotions, this method offers a more objective and reliable approach.
By leveraging existing VR hardware, this solution eliminates the need for additional consumables such as electrodes or gels required in conventional physiological measurements. It is designed for broad compatibility with most VR devices, making it accessible for both home and professional use. The technology has diverse applications, including VR gaming, training simulations, and emergency services or military simulations, enhancing immersion and providing valuable physiological insights.
By leveraging existing VR hardware, this solution eliminates the need for additional consumables such as electrodes or gels required in conventional physiological measurements. It is designed for broad compatibility with most VR devices, making it accessible for both home and professional use. The technology has diverse applications, including VR gaming, training simulations, and emergency services or military simulations, enhancing immersion and providing valuable physiological insights.
Stage II: Integration of Emotional Feedback in VR Simulation
At this stage, the interactive VR simulation developed in Stage I will be enhanced with real-time emotional feedback, based on pupil size analysis. The system will dynamically adjust specific simulation parameters according to the user's arousal level ("low" or "high"), optimizing the user experience.
This advancement is particularly valuable in high-stakes training for emergency and military personnel, where monitoring psychophysiological responses can optimize learning and performance. The current phase focuses on refining a real-time processing module that translates physiological signals into meaningful adjustments within VR environments, paving the way for more responsive and immersive simulations.
This advancement is particularly valuable in high-stakes training for emergency and military personnel, where monitoring psychophysiological responses can optimize learning and performance. The current phase focuses on refining a real-time processing module that translates physiological signals into meaningful adjustments within VR environments, paving the way for more responsive and immersive simulations.
Robinson, et al. (2020, November). " Let's Get Physiological, Physiological!" A Systematic Review of Affective Gaming. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (pp. 132-147).