Hand Tracking

Overview of hand tracking and gesture control for Extend Robotics.

Supported Headsets

Hand tracking is available with any headset that supports OpenXR.

How to activate

The feature is always active on headsets that support hand tracking. Hand tracking will automatically activate whenever a user puts down their controllers. Grabbing the controllers again will automatically deactivate hand tracking.

Gesture recognition

Instead of using the controller's buttons, hand tracking gestures will provide the same functionality.

• To move around the scene, use the grasp gesture to grab and move in View Adjust Mode.

• To control the robot, use the grasp gesture in Robot Control Mode. The angle of the index finger will affect the gripper.

User Interface

While using hand tracking, users can interact with the UI using the tip of their index fingers.