Working With Unity

VisionLib's SDK for Unity is the easiest way to get started, because you can quickly setup tracking with VisionLib and use the Unity engine for rendering and application logic.

Getting Started

We've prepared step-by-step tutorials on how to use VisionLib with Unity. To get started, we recommend the quick-start:

• UnitySDK Quick Start

The ModelTrackingSetup example scene can be used to tailor the tracking parameters to a specific tracking model and save the results in a configuration file. A separate tracking setup scene specific to HoloLens 2 is also included with the MRTK example scenes.

• Using the Model Tracking Setup Scene
• Using the Model Tracking Setup Scene on HoloLens 2

Further tutorials describing how to use the VisionLib SDK can be found here:

• Poster Tracker Tutorial
• Build VisionLib Unity Projects
• Using Commands and Tasks
• HoloLens Model and Poster Tracker Tutorial
• HoloLens Optimizations
• Mixed Reality Toolkit Integration
• Universal Render Pipeline Support

Background + Trouble Shooting

The illusion of augmented reality relies on the effect of precisely superimposed visuals within the augmented views. That said, camera calibration and getting core tracking parameters right is essential. For this, we recommend also looking into tracking essentials:

• Camera Calibration
• Setting an Init-Pose
• Understanding Tracking

Update: For more trouble shooting, have a look at the FAQ section.

In order to safely update to a newer version of the VisionLib SDK, see

• Release Notes
• Updating the VisionLib Package

Experimental

• Using Models from Unity Hierarchy for Tracking (Beta)
• AutoInit with WorkSpaces (Beta)
• Multi Model Tracking (Beta)
• AR Foundation Support (Beta)
• AR Foundation Remote Plugin Setup (Beta)