Overlay virtual objects with process instructions and task feedback
Umajin makes it possible with the PhaseSpace tracking system to locate people, tools and any pieces of the equipment so it can overlay the users’ view with instructions, synthetic problems or feedback.
This is most applicable to practicing repairing expensive equipment, difficult limited time frame procedures or life threatening or dangerous procedures.
It is also very valuable for procedures which need multiple people to work together, which require good spatial awareness of elements of the machine or target and where procedures need to be repeated many times to achieve a high level of competency.
The fusion reactor scene is a step by step repair process. While the reactor is fictional – the scenario requires two simultaneous users and real props. The VR view has prompts instructing the users of their next step.
The props are tracked for speed (don’t move the reactor core too quickly), for position (put the elements in the right place) and orientation (the fuel cells must be placed the correct way around).