MATREX

Game Design Process
"MaTrEx" (Maintenance and Training through Extended Reality) is a VR-based training platform designed to address skill gaps in the manufacturing industry. It leverages immersive environments and digital twins to enable remote diagnostics and training sessions. The modular design integrates networking, IoT, and user interface elements to create a scalable solution for industrial applications.

Virtual Reality Environment
The VR environment was designed to be spacious and distraction-free, ensuring comfort and productivity for users. Built on OpenVR for multi-vendor compatibility, it supports diverse hardware setups, from high-end Oculus Vive headsets to budget-friendly Windows MR devices. This flexibility allows trainers and trainees to collaborate seamlessly in shared virtual spaces.

IoT Integration
The IoT module connects real-world machines to their virtual counterparts using digital twins. A proof-of-concept was implemented with Arduino heat sensors and MQTT protocol to stream real-time diagnostic data into Unity. This functionality enables trainers to guide on-site workers remotely while interacting with the digital twin in VR.

Multiplayer Networking
As the lead developer for multiplayer functionality, I implemented Photon (PUN 2) to allow trainers and multiple trainees to join VR sessions remotely. This system supports simultaneous interactions with the digital twin, facilitating collaborative training and maintenance tasks across different locations.

User Interface Design
I developed a simple yet effective UI dashboard that displays real-time data from IoT devices in graphical formats within the VR environment. The interface ensures that users can focus on training tasks without being overwhelmed by complex visuals, enhancing usability and immersion.

Features
MaTrEx offers robust functionalities such as remote training, ad-hoc maintenance, and session recording for future reference. Trainers can interact with digital twins while trainees observe or engage hands-on. Multiplayer pooling allows professionals to collaboratively simulate solutions, ensuring optimal outcomes for complex challenges.

Challenges & Results
Testing was limited by access to VR headsets and machinery, but the prototype successfully demonstrated the feasibility of VR-based industrial training. Future plans include stress testing scalability, adding haptic feedback for enhanced immersion, and conducting user studies to compare learning outcomes against traditional methods.

Impact
The research behind "MaTrEx" was showcased at IndiaHCI 2019, highlighting its potential as an innovative solution for industrial training. MaTrEx introduces the XR-as-a-Service paradigm, offering scalable solutions that industries can adopt for continuous support. My contributions in UX design, multiplayer implementation, and IoT integration demonstrate my expertise in creating cutting-edge extended reality solutions.