DexCap: Hand Motion Capture Data for Dexterous Manipulation

Provider
Chen Wang et al. (Stanford University)
License
CC-BY-4.0 (source)
Size
6 files
Format
HDF5 (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/chenwangj/DexCap-Data)
Access
Free and public. No account with the data provider is needed.
Category
Robotics
Source
https://arxiv.org/abs/2403.07788

About DexCap: Hand Motion Capture Data for Dexterous Manipulation

The official dataset collected with DexCap, a portable hand motion capture system for learning dexterous robot manipulation from human demonstrations (Wang et al., arXiv:2403.07788). It contains 30 minutes of mocap data for a wiping task and 60 minutes of in-the-wild mocap data for a packaging task. Raw data are zip archives in which each frame folder holds the chest camera RGB image (JPEG) and depth image (PNG), the chest camera 6-DoF pose in the world frame, left and right hand 6-DoF poses, and 3D hand joint positions in the palm frame as text files. Postprocessed training sets are HDF5 files with 10,000-point point clouds and a 5-step action gap, readable with h5py and the training scripts in the DexCap GitHub repository. Measured 2026-11-14 at about 108 GB across two raw zips and two HDF5 files. Useful for human-to-robot retargeting, point-cloud imitation learning and dexterous bimanual manipulation. The card releases the dataset under CC BY 4.0; cite the DexCap paper.

How to load DexCap: Hand Motion Capture Data for Dexterous Manipulation in Python

from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="chenwangj/DexCap-Data", filename="hand_packaging_wild_1-20_5actiongap_10000points.hdf5", repo_type="dataset")
print(path)

Data structure

File types in sampled files: HDF5

Files

Example file: hand_packaging_wild_1-20_5actiongap_10000points.hdf5

Analyze this dataset without downloading it

On Scigantic, DexCap: Hand Motion Capture Data for Dexterous Manipulation opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Robotics datasets