SRWorks Introduction

The VIVE SRWorks SDK expands the capabilities and potential uses of the VIVE VR system’s pass-through technology. With this powerful tool, content developers can bring the real world into VR. In most cases, the view of the real world is blocked while wearing the headset. By using the dual camera of VIVE HMD, the headset can receive input from the real world in stereo vision. In most cases, the view of the real world is blocked while wearing the headset. By using a dual camera, the VIVE HMD can receive input from the real world in stereo vision.

../_images/flow.png

Images from the dual camera undergo processing through the following VIVE SRWorks modules, after which the output can be rendered through Unity or Unreal and delivered to rendering engine:

Pass-through module

Enables the pass-through function of the dual camera on both VIVE Pro and VIVE Cosmos to view the actual environment outside of VR. Furthermore, the module also provides material and texture effects.

Depth module

Provides depth-sensing of objects in the real world. This can be used to implement occlusion effect.

AI Vision module

Recognizes pre-trained objects, including human or indoor objects (chair/table/floor/wall/ceiling/bed). It provides two modes. In 2D mode, every pixel is labeled if it is recognized as a pre-trained object. In 3D mode, it handles the reconstructed 3D mesh and segments out semantic objects.

3D Reconstruction module

Supports saving 3D scenes as an .OBJ file. The module recreates scanned environments into 3D, including mesh and material assets, color textures, as well as detection of physical collisions and planes. If this module enables AI Vision relative functions, it will export semantic objects (.obj) and extra-information (.xml) for plenty MR application.

Reality / Virtuality interface through dual camera

The VIVE Pro and Cosmos headset’s dual camera provides a stereo view of the real world, mimicking human vision via two lenses each with its own image sensor. For developers planning to use pass-through technology with their VR content, the dual camera offers two major benefits:

3D perception

Because there are separate cameras used for the left and right eyes, 3D perception is possible when viewing the real world.

Depth sensing

A basic application is realistic occlusion. You can also make use of this depth information to implement other more advanced scenarios, such as body, hand, and face tracking.

By using the SRWorks SDK, you can create VR content that can simultaneously align the real world and VR. The pass-through feature, supported by 3D reconstruction and depth sensing, offers untapped possibilities for developing next-generation VR content across a variety of genres – from games, entertainment, to education.

../_images/vr_and_ar.jpg