Introduction¶
Vive Hand Tracking SDK is aimed to provide:
- First-person view hand recognition in VR/AR/Phones
- Provide accurate, low-latency, deep learning-based solution.
- Support different hardware & operation systems.
- Use existing camera modules, no extra hardware needed.
- Recognises static gestures, instead of gesture sequences.
This section provides overview of the Vive Hand Tracking SDK, with requirements, supported features and limitations. We recommend complete this section before heading to document of each plugin.
Supported Operation Systems & Hardware¶
Vive Hand Tracking SDK tries our best to support all VR/AR devices with camera on-board. A list of currently supported devices is listed below:
| Operation System | Architecture | Hardware |
|---|---|---|
| Windows 7 or newer | x86-64, x86 [1] | HTC Vive, HTC Vive Pro series
HTC Vive Cosmos, HTC Vive Cosmos XR
Valve Index
|
| Android N or newer | ARMv7, ARMv8 | Android phone with optional VR headset
Android device with ARCore support [2]
|
| Android (WaveVR) | ARMv7, ARMv8 | HTC Vive Focus, HTC Vive Focus Plus
HTC Vive Focus 3 [3]
|
| [1] | Windows x86 only provided in C++ plugin for 32-bit apps. x86-64 is preferred for performance reason. |
| [2] | ARCore supported is not included in Android Library (Java) plugin. |
| [3] | HTC Vive Focus 3 support only available in Unity/Unreal plugin. See WaveVR Compatibility for details. |
For detailed requirements for each OS/hardware, please see Supported Hardware.
Supported Features¶
Vive Hand Tracking SDK supports:
- Left/Right hand detection
- Pre-defined gesture classification
- Hand position & rotation result for 21 joints
- Pinch (thumb & index fingers) detection
- Confidence value for each hand result
For detailed feature for each OS/hardware, please see Available Features.
Available Plugins¶
| Plugin Type | Supported Platforms | Requirements |
|---|---|---|
| Unity | All | Unity 5.4 or newer (Android armv8 requires 2017.4+) |
| Unreal | All | Unreal 4.21 or newer (WaveVR may require newer Unreal) |
| Android (Java) | Android, WaveVR | Java 8 or newer |
| C/C++ | All | c/c++ compiler (MSVC or Android NDK) |
Limitations¶
- Hand tracking SDK uses on-board camera(s) to detect hands, so make sure hands are visible from camera.
- We are improving accuracy of model, please pay attention to following situations if hand is not detected:
- Avoid complicated backgrounds
- Avoid backlight or low light, or unbalanced lighting condition in camera frame
- Roll up sleeves and make sure wrest is visible
- Avoid side-view of hands
For devices with see-through enabled (e.g. Vive Cosmos), you can use see-through to check environments and hand requirements.
Developer Support¶
To download Vive Hand Tracking SDK, please visit Vive developer resources site.
If you have any feedback or questions, please visit Vive Hand Tracking forum.
For demo videos, please refer to our Youtube playlist or Youku playlist (For Chinese developer).