OctoSense: Synchronized Multi-Sensor Driving Dataset with Event Cameras
- Provider
- Anthony Bisulco et al. (University of Pennsylvania)
- License
- MIT (source)
- Size
- 3,058 files
- Format
- PNG, MP4, HDF5 (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/anthonytec2/OctoSense)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Robotics
- Source
- https://arxiv.org/abs/2606.27317
About OctoSense: Synchronized Multi-Sensor Driving Dataset with Event Cameras
OctoSense is a time-synchronised, calibrated multi-sensor dataset in which a car, a boat and a Unitree Go2-W quadruped share the same sensor rig (arXiv:2606.27317). Most of it is driving: 371 sequences, 59 hours and 2,474 km of urban, suburban and rural driving on Long Island and in Philadelphia at sunrise, day, sunset and night. Every sequence carries stereo RGB, stereo event cameras, infrared, Ouster LiDAR and IMU; driving sequences add GPS, CAN, ground truth for depth, ego-motion optical flow and semantic segmentation, and a fused GPS plus LiDAR-inertial odometry trajectory. Nine boat sequences and two quadruped sequences (with per-joint robot state) have no perception ground truth. Sequences are keyed by recording datetime under car/, boat/ and unitree/, with per-sequence data in HDF5 (data.h5), calibrations/, and metadata.parquet listing platform and attributes. Measured 2026-11-14 at about 8.5 TB. Read with h5py and pandas; the authors provide a Colab getting-started notebook. Useful for event-based vision, depth and flow estimation, SLAM and night driving. Released under the MIT licence; cite the OctoSense paper.
How to load this dataset in Python
from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="anthonytec2/OctoSense", filename="boat/sess1/rosbag2_2025_11_20-08_48_14/data.h5", repo_type="dataset")
print(path)Data structure
File types in sampled files: PNG, MP4, HDF5
Files
Example file: boat/sess1/rosbag2_2025_11_20-08_48_14/data.h5
Analyze this dataset without downloading it
On Scigantic, OctoSense: Synchronized Multi-Sensor Driving Dataset with Event Cameras opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Robotics datasets
- Open X-Embodiment
- Ouster OS1-64 LiDAR Drives with Aptiv ESR Radar Tracks, Kalamazoo 2020-2025 (WMU AD Assurance Lab)
- Infrastructure-Enabled Energy-Efficient Autonomous Vehicles (DOE EEMS116): Radar Retroreflector, Smart Pavement Marker, HD-Map and Weather Sensing Recordings
- X-VLA Soft Cloth Folding Dataset
- PhysicalAI Robotics Manipulation SingleArm
- DexCap: Hand Motion Capture Data for Dexterous Manipulation
- NuRec AV Object Benchmark
- Connected Eco-Driving, Fort Collins 2019: Synchronized Vehicle, ADAS, V2V and Traffic-Signal (V2I) Data for Velocity Prediction (DOE EE0008468)