# Everyday Manipulation 3D: 1,513 Raw iPhone LiDAR RGB-D Egocentric Clips of Two-Handed Tasks with ARKit Camera Poses (CaryX AI)

## Facts

- Provider: CaryX AI
- License: CC-BY-4.0 (https://huggingface.co/datasets/CaryxAI/everyday-manipulation-3d-raw)
- Size: 1,518 files
- Format: CSV (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/datasets/CaryxAI/everyday-manipulation-3d-raw
- Access: public, readable without an account
- Category: Robotics
- Source: https://huggingface.co/datasets/CaryxAI/everyday-manipulation-3d-raw
- Page: https://scigantic.com/archive/be328a4e-9a13-54b7-8442-ce6056795309
- Keywords: Robotics, LiDAR, robot learning, CSV, Hugging Face

## About

An open sample of raw 3D egocentric manipulation data from CaryX AI: 1,513 clips, 10.28 hours and about 280 GiB of everyday two-handed manipulation by 4 participants across 10 tasks in 42 recording sittings, captured with a chest-mounted iPhone Pro running the Record3D app. Each clip is the app's .r3d file (a ZIP) with the audio removed and the sensor streams unmodified: synchronized RGB frames (1440x1920 portrait or 1920x1440 landscape), metric LiDAR depth in float32 meters (192x256 or 256x192, LZFSE-compressed), ARKit per-pixel depth confidence, per-frame ARKit 6-DoF camera poses and per-frame camera intrinsics in a JSON metadata member. 1,027 clips are portrait and 486 landscape, and index.csv and index.jsonl give each clip's resolution and orientation; the card explains how to scale the RGB intrinsics to depth pixels before back-projecting to point clouds. About 300 GB in 1,518 files (measured 2026-11-21). Useful for hand-object interaction, 3D reconstruction and learning robot manipulation from human video. Released under CC BY 4.0, including commercial use with attribution.

## Load the data

```python
import pandas as pd
df = pd.read_csv("hf://datasets/CaryxAI/everyday-manipulation-3d-raw/index.csv")
df.head()
```

## Data structure

File types in sampled files: CSV

Example file: `index.csv`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/be328a4e-9a13-54b7-8442-ce6056795309
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/be328a4e-9a13-54b7-8442-ce6056795309
- Over MCP: `get_schema_card` with id `be328a4e-9a13-54b7-8442-ce6056795309` at https://api.scigantic.com/mcp

## Related topics

- [CSV datasets](https://scigantic.com/topics/csv)
- [LiDAR datasets](https://scigantic.com/topics/lidar)
- [Robotics datasets](https://scigantic.com/topics/robotics)
- [Robot learning datasets](https://scigantic.com/topics/robot-learning)
