Hand-Tracking in VR

Leap motion-based

In VR, where users are more likely to interact in a real-life way, in addition to the controller input system, hand tracking provides a more natural interaction behavior and is more conducive to immersion, therefore here few sci-fi, interesting hand-based interaction ways were made.

Examples

Provide a general description of the items below and introduce the services you offer. Click on the text box to edit the content.

Scene 1

Scene 2

Scene 3

Interaction 1

Distance Pick

Gesture interaction 1, using hand position and direction for pick-up operations in a 3D context

Interaction 2

Distance Grasp

Gesture Interaction 2, Grasp gestures can perform remote grasping and trigger shader effects of the objects

Interaction 3

Two Hands

Gesture Interaction 3, Controlling the object with the interaction between the two hands

LeapMotion +
VR Context

To explore gesture interaction in a VR environment, a virtual scene was created based on UNITY, and the Hardware Leap Motion was used to conduct the gesture tracking.

Hand Tracking in VR

Scene Design

this scene model is relatively simple, consisting of a group of Cubes, which is rendered in different color based on world coordinates(shader driven) , and also particle system was added as a smoke effect to enhance the atmosphere.

Interaction Design

When a cube is remotely selected, it will trigger the edge highlight effect, and the remote grabbing behavior can be triggered according to the gesture grabbing, and then the item can be pushed away or destroyed