Train. Ask. Learn. Repeat. 

LUMINOUS Pilot 2 brings generative AI to life in immersive safety training 

What if you could learn how to extinguish a fire by talking to a virtual instructor as real as a co-worker? 
That’s exactly what’s happening in the European project LUMINOUS, where generative AI, virtual reality, and professional training are coming together like never before. 

Pilot 2, led by LUDUS, is reshaping how workers are trained in health and safety procedures. The goal? To enable anyone to face emergencies—like fires—in a safe, immersive environment, guided at their own pace, in their own style, and according to their needs. And all of it supported by a smart virtual instructor. 

What’s happening in Pilot 2? 

Pilot 2 of LUMINOUS aims to integrate and validate generative AI technologies within the LUDUS VR training ecosystem—already used by companies and institutions to train professionals in high-risk environments. 

A fully immersive fire extinguisher training simulation has been developed, where users can interact by voice with a virtual assistant that understands what they say, processes the context, and responds accordingly. 

This is not a pre-scripted bot or a rigid menu system. This new model allows users to ask open questions, receive real-time feedback, and make decisions with the support of an AI system that adapts, guides, and facilitates learning. 

Smarter training, powered by human-centric technology 

To make this experience possible, the team has completely restructured the simulation’s architecture. The result: 

• A voice-based conversational assistant in VR, capable of processing speech input, using generative AI (LLMs), and delivering natural responses through voice and on-screen feedback. 

• A contextual engine, which tracks real-time user actions (steps taken, mistakes, tool usage, hazard proximity) and enriches the AI’s input for more accurate guidance. 

• A non-intrusive interaction model, where users can request help when needed or continue independently. 

• A user-friendly interface, with message history, text overlays, and fallback systems to ensure learning continuity even under technical stress. 

To enhance realism, a virtual avatar is currently being integrated, with plans to synchronize its speech and lip movement with real-time AI-generated dialogue—transforming the instructor into a fully embodied digital guide. 

Why does this matter? 

Immersive training systems like this can allow users—especially those with less experience—to engage in realistic simulations, learn by doing, and ask questions freely, as they would with a human trainer. 

This approach has the potential to: 

• Adapt to each learner’s pace and needs, supporting inclusive and flexible learning. 

• Enable repeated practice in a safe environment, strengthening retention and skill development. 

• Reduce the need for continuous instructor presence, making training more scalable. 

While full user evaluations are still in progress, early internal tests confirm the system’s technical viability and pave the way for real-world deployment. 

What’s next? 

The pilot led by LUDUS is moving into new phases. Current developments include: 

• Enabling speech and lip-sync synchronization between the AI-generated responses and the virtual avatar. 

• Designing a new CPR training simulation, applying the same adaptive model to life-saving procedures. 

• Preparing for structured user testing, which will provide insights into response speed, usability, and user satisfaction. 

Thanks to its modular architecture, this system can be extended to future training simulations—building a flexible and intelligent XR learning ecosystem. 

A glimpse into the future of workplace learning 

LUMINOUS is exploring how emerging technologies can support more accessible, adaptive, and engaging training experiences across industries. 

Pilot 2, led by LUDUS, is a clear example of what the future of learning could look like: immersive, conversational, personalized, and safe. 

👁️‍🗨️ Follow the LUMINOUS project to discover how generative AI, virtual worlds, and XR are transforming training across Europe. 

The future of learning. For everyone. Starting now. 
#HumanCentricAI #XRTraining #DigitalInclusion #LUMINOUSproject