MRTK 101: How to use Mixed Reality Toolkit Unity for Crucial Spatial Interactions (HoloLens 2, HoloLens, Windows Mixed Reality, OpenVR, OpenXR)

Learn how to use MRTK to achieve some of the most widely used common interaction patterns in Mixed Reality This article is based on MRTK 2.7 release (May 2021)

How to simulate input interactions in Unity editor?

MRTK’s Input simulation in Unity editor

How to grab and move an object?

Grab and move with input simulation — far interaction with hand ray / near interaction with articulated hand

How to resize an object?

Resizing object with two-handed manipulation

How to move, rotate, and scale an object with precision?

Default Bounding Box and HoloLens 2 style in the BoundingBoxExamples.unity scene

How to make an object respond to input events?

How to add visual feedback?

Assigned material with MRTK Standard Shader’s proximity light and border light options

How to add audio feedback?

How to use HoloLens 2 style button prefabs?

PressableButtonExamples scene

How to make an object follow you?

Example of using Radial View Solver on the Toggle Features Panel in the HandInteractionExamples scene

How to make an object face you?

The left object always faces the camera with Billboard script, with Y-axis pivot option
Example of using Billboard script in the Tooltip prefab to make the labels always face the camera


Microsoft MR Dev Days 2020 Session Video: MRTK’s UX Building Blocks

Read my other stories

Designing Type In Space for HoloLens 2

Designer & Creative Technologist. UX Designer @Microsoft HoloLens. Creator of Opinions are my own.