DexCap: Hand Motion Capture Data for Dexterous Manipulation
- Provider
- Chen Wang et al. (Stanford University)
- License
- CC-BY-4.0 (source)
- Size
- 6 files
- Format
- HDF5 (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/chenwangj/DexCap-Data)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Robotics
- Source
- https://arxiv.org/abs/2403.07788
About DexCap: Hand Motion Capture Data for Dexterous Manipulation
The official dataset collected with DexCap, a portable hand motion capture system for learning dexterous robot manipulation from human demonstrations (Wang et al., arXiv:2403.07788). It contains 30 minutes of mocap data for a wiping task and 60 minutes of in-the-wild mocap data for a packaging task. Raw data are zip archives in which each frame folder holds the chest camera RGB image (JPEG) and depth image (PNG), the chest camera 6-DoF pose in the world frame, left and right hand 6-DoF poses, and 3D hand joint positions in the palm frame as text files. Postprocessed training sets are HDF5 files with 10,000-point point clouds and a 5-step action gap, readable with h5py and the training scripts in the DexCap GitHub repository. Measured 2026-11-14 at about 108 GB across two raw zips and two HDF5 files. Useful for human-to-robot retargeting, point-cloud imitation learning and dexterous bimanual manipulation. The card releases the dataset under CC BY 4.0; cite the DexCap paper.
How to load DexCap: Hand Motion Capture Data for Dexterous Manipulation in Python
from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="chenwangj/DexCap-Data", filename="hand_packaging_wild_1-20_5actiongap_10000points.hdf5", repo_type="dataset")
print(path)Data structure
File types in sampled files: HDF5
Files
Example file: hand_packaging_wild_1-20_5actiongap_10000points.hdf5
Analyze this dataset without downloading it
On Scigantic, DexCap: Hand Motion Capture Data for Dexterous Manipulation opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Robotics datasets
- NuRec AV Object Benchmark
- Connected Eco-Driving, Fort Collins 2019: Synchronized Vehicle, ADAS, V2V and Traffic-Signal (V2I) Data for Velocity Prediction (DOE EE0008468)
- PhysicalAI Robotics Mindmap Franka Mug In Drawer
- Arena GR 1 Manipulation Task V 3
- CANOE Dataset
- Digit Pose Estimation
- PhysicalAI Robotics Mindmap Franka Cube Stacking
- Sparsh X Dataset