What is mixed reality?

MR is the point where a digital object stops floating over the screen and starts answering the room.

The headset builds a 3D map of the physical space, so a virtual object can rest on a real table, disappear behind a real wall, and respond to a real hand.

How mixed reality works in practice

That takes sensors to measure the room, computer vision to read it, and real-time computing to keep digital objects aligned while somebody walks around.

Two people stand in a room. A VR training scenario for what is mixed reality. — Two people stand in a mapped room.

Video passthrough headsets. External cameras capture the room and render digital graphics into the camera stream at low latency.
Optical see-through headsets. Transparent lenses (waveguides) project digital light directly while the wearer looks straight at the real world.
Spatial mapping and meshing. Depth sensors build an invisible 3D mesh of the room, so a virtual ball bounces off a real desk.
Spatial persistence. Content anchors to fixed physical coordinates, so a digital dashboard stays on the same boardroom wall days later.
Direct hand tracking. Cameras track fingers and joints, so a user taps, pushes and resizes digital items without a controller.

Occlusion, in Meta's own terms

If a virtual character stands behind a real office chair, the chair naturally conceals the lower half of the character.

Two people display a figure partly hidden. A VR training scenario for what is mixed reality. — A figure, partly hidden behind a real chair.

Meta's developer documentation describes a Depth API that provides real-time, per-eye environment depth estimates to let developers build dynamic occlusion. Meta developer blog, 2023

Eye tracking adds foveated rendering on top: the area a person is looking at stays sharp while peripheral detail drops, to save on graphics performance.

Light is the other half of believing it

Occlusion decides what you can see. Lighting decides whether your eye accepts that it is there at all.

A glowing translucent human figure sits in a real office chair in a dark room, its light spilling onto the seat and the floor. — A figure of light in a real chair.

When a digital figure occupies a real chair, the giveaway is the light.

A headset that estimates the room's own lighting can throw that figure's glow onto the seat and the floor beneath it. The eye stops reading two pictures and starts reading one room.

That matters more for practice than for looks. If the person you are rehearsing with does not seem to be in the room, neither does the conversation.

What it feels like to use MR

It feels less like going somewhere and more like something arriving. The room stays visible, so people keep their bearings and keep talking to whoever else is standing there.

A holographic ball passes behind a chair. A VR training scenario for mixed reality. — A holographic ball passes behind a real chair.

Reaching for a virtual control panel beside a real machine works because hand tracking responds immediately, and because the panel behaves as though the room's geometry applies to it. Direct hand interaction also cuts down on controller use.

Where mixed reality is commonly used

MR fits work where digital guidance and physical equipment have to stay in view and answer each other.

Three people examine forms above a mannequin. A VR training scenario for what is mixed reality. — **High-fidelity clinical training.** Teams practise a procedure on a physical mannequin while holographic organs and vitals are superimposed onto it.

Two people inspect a machine structure. A VR training scenario for what is mixed reality. — **Engineering and architectural prototyping.** A 1:1 digital prototype is placed inside a real factory floor to test clearances and access.

A holographic instrument rests on a table. A first person VR training scenario for mixed reality, seen through the headset. — **Complex assembly and quality assurance.** Holographic guidance aligns directly with a physical part on the production line.

Three people gather around a terrain model. A VR training scenario for what is mixed reality. — **Multi-user spatial collaboration.** A team gathers around a physical table to work on a shared holographic model.

Mixed reality in practice at PTR

PTR builds mixed reality alongside its virtual and augmented reality work, for realistic practice: a safe setting, real pressure, the learner's own choice, and a debrief afterwards.

A clinical scenario with a holographic patient.

What changes is where the practice happens. MR anchors the scenario in the room the learner is already standing in, so a holographic person is met at a real bedside and a procedure is rehearsed against real equipment.

A hologram that has to sit beside real equipment

Mixed reality earns its place when the digital thing must line up with a real bed, a real machine or a real colleague.

A clinician addresses a holographic patient. A VR training scenario for mixed reality. — **A real bedside** with a holographic patient.

A facilitator checks anchored wall forms. A VR training scenario for what is mixed reality. — **A real wall** holding anchored guidance in place.

Common confusions about MR

What people get wrong about mixed reality.

A guide stands beside a ball rolling. A first person VR training scenario for what is mixed reality, seen through the headset. — **MR goes beyond standard AR.** Basic AR overlays static graphics on a camera feed; MR creates co-presence, where physical and digital items interact through spatial meshing, physics and occlusion.

A practice person stands by a clinical bed. A first person VR training scenario for what is mixed reality, seen through the headset. — **MR is not entirely separate from VR.** Modern standalone headsets increasingly support both full VR and high-resolution MR passthrough on the same hardware.

Two guides stand among forms integrated. A first person VR training scenario for what is mixed reality, seen through the headset. — **Passthrough is not identical to eyesight.** The view is rendered via camera sensors and screens, so lighting and camera resolution can affect clarity compared with optical see-through glass.

Two people display an object partly hidden. A VR training scenario for VR vs AR vs MR differences. — **"Mixed reality" means several things.** A 2019 ACM CHI study interviewed ten AR/VR experts and reviewed 68 papers, and found at least six competing notions of the term. Ask which one a vendor means before comparing two products.

Is mixed reality the right fit?

The conditions that make MR the obvious choice, and the ones that mean another format will serve better.

A collaborator rotates a model on a desk. A first person VR training scenario for VR vs AR vs MR differences, seen through the headset. — A strong fit when Users must interact with digital models and physical objects at the same time, such as a holographic scan beside a real desk. Collaborative in-person training needs participants to see each other and shared assets naturally. Situational awareness is critical while navigating a real environment.

Two people watch a spatial mesh form. A VR training scenario for mixed reality. — Not the right fit when Hardware cost and complexity matter: MR headsets with depth sensors cost more than a phone-based AR app and need more setup. Small or frequently rearranged spaces make occlusion and anchoring less reliable. Battery and thermal limits cap continuous session length. When the task only needs a floating label, plain AR usually does the job.

To explore how mixed reality applications are built for enterprise and training, visit the XR overview page.

The short version

A woman wearing a PeopleTech Revolution branded headset points a controller while trying an immersive training demo at a PTR community event. — A Townsville PTR guest tries a standalone headset.

MR keeps the real world visible, like AR, and gives digital objects a working understanding of the room. They can rest on real surfaces, hide behind real furniture, and stay in place between sessions.

That deeper environmental integration separates MR from standard AR.