User guide

Overview

Our hand-tracking system is designed to track the position and orientation of a user's hands as well as the (limited) pose of the ten fingers. Presently, we support several finger poses such as pinching and pointing.

Our technology works best when the user is seated at a desk and the cameras are looking down at the user's hands. This configuration allows the user to rest his hands on the desk most of the time. A desktop environment is also good for facilitating interaction with virtual objects.

In this version of the hand-tracker, we've focussed on exposing robust tracking of the hand and the pinching pose in particular. Pinching is a good way for users to select or "grab" virtual objects or drive a touchless GUI. It's analogous to "clicking" with a mouse. In fact, our API exposes the "pinching" gesture much like a mouse event.

Limitations

Our system is not yet a general purpose hand-tracking system. It relies on a database of user-calibrated poses to track a user's hands. Poses outside of the database may be tracked poorly. We are actively working on relaxing this constraint. Feel free to contact us with any problems, suggestions for improvements, etc. Fill out our feedback form or send email to info@threegear.com.

Thanks for giving our SDK a try!