OctoSense: Synchronized Multi-Sensor Driving Dataset with Event Cameras

Provider
Anthony Bisulco et al. (University of Pennsylvania)
License
MIT (source)
Size
3,058 files
Format
PNG, MP4, HDF5 (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/anthonytec2/OctoSense)
Access
Free and public. No account with the data provider is needed.
Category
Robotics
Source
https://arxiv.org/abs/2606.27317

About OctoSense: Synchronized Multi-Sensor Driving Dataset with Event Cameras

OctoSense is a time-synchronised, calibrated multi-sensor dataset in which a car, a boat and a Unitree Go2-W quadruped share the same sensor rig (arXiv:2606.27317). Most of it is driving: 371 sequences, 59 hours and 2,474 km of urban, suburban and rural driving on Long Island and in Philadelphia at sunrise, day, sunset and night. Every sequence carries stereo RGB, stereo event cameras, infrared, Ouster LiDAR and IMU; driving sequences add GPS, CAN, ground truth for depth, ego-motion optical flow and semantic segmentation, and a fused GPS plus LiDAR-inertial odometry trajectory. Nine boat sequences and two quadruped sequences (with per-joint robot state) have no perception ground truth. Sequences are keyed by recording datetime under car/, boat/ and unitree/, with per-sequence data in HDF5 (data.h5), calibrations/, and metadata.parquet listing platform and attributes. Measured 2026-11-14 at about 8.5 TB. Read with h5py and pandas; the authors provide a Colab getting-started notebook. Useful for event-based vision, depth and flow estimation, SLAM and night driving. Released under the MIT licence; cite the OctoSense paper.

How to load this dataset in Python

from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="anthonytec2/OctoSense", filename="boat/sess1/rosbag2_2025_11_20-08_48_14/data.h5", repo_type="dataset")
print(path)

Data structure

File types in sampled files: PNG, MP4, HDF5

Files

Example file: boat/sess1/rosbag2_2025_11_20-08_48_14/data.h5

Analyze this dataset without downloading it

On Scigantic, OctoSense: Synchronized Multi-Sensor Driving Dataset with Event Cameras opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Robotics datasets