Everyday Manipulation 3D: 1,513 Raw iPhone LiDAR RGB-D Egocentric Clips of Two-Handed Tasks with ARKit Camera Poses (CaryX AI)

Provider
CaryX AI
License
CC-BY-4.0 (source)
Size
1,518 files
Format
CSV (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/CaryxAI/everyday-manipulation-3d-raw)
Access
Free and public. No account with the data provider is needed.
Category
Robotics
Source
https://huggingface.co/datasets/CaryxAI/everyday-manipulation-3d-raw

About this dataset

An open sample of raw 3D egocentric manipulation data from CaryX AI: 1,513 clips, 10.28 hours and about 280 GiB of everyday two-handed manipulation by 4 participants across 10 tasks in 42 recording sittings, captured with a chest-mounted iPhone Pro running the Record3D app. Each clip is the app's .r3d file (a ZIP) with the audio removed and the sensor streams unmodified: synchronized RGB frames (1440x1920 portrait or 1920x1440 landscape), metric LiDAR depth in float32 meters (192x256 or 256x192, LZFSE-compressed), ARKit per-pixel depth confidence, per-frame ARKit 6-DoF camera poses and per-frame camera intrinsics in a JSON metadata member. 1,027 clips are portrait and 486 landscape, and index.csv and index.jsonl give each clip's resolution and orientation; the card explains how to scale the RGB intrinsics to depth pixels before back-projecting to point clouds. About 300 GB in 1,518 files (measured 2026-11-21). Useful for hand-object interaction, 3D reconstruction and learning robot manipulation from human video. Released under CC BY 4.0, including commercial use with attribution.

How to load this dataset in Python

import pandas as pd
df = pd.read_csv("hf://datasets/CaryxAI/everyday-manipulation-3d-raw/index.csv")
df.head()

Data structure

File types in sampled files: CSV

Files

Example file: index.csv

Analyze this dataset without downloading it

On Scigantic, Everyday Manipulation 3D: 1,513 Raw iPhone LiDAR RGB-D Egocentric Clips of Two-Handed Tasks with ARKit Camera Poses (CaryX AI) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Robotics datasets