MARE Lunar Rover Dataset: Synthetic Multisensor Frames with Depth, Object and Shadow Ground Truth

Provider
Raul Castilla-Arquillo, Miguel Olivares-Mendez
License
CC-BY-4.0 (source)
Size
179 files
Format
MCAP, CSV (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/raulcastar/mare-lunar-rover-dataset)
Access
Free and public. No account with the data provider is needed.
Category
Astronomy & Space
Source
https://arxiv.org/abs/2610.28465

About this dataset

5,040 synthetic samples recorded by a lunar rover (Leo Raph) driving autonomously across eight procedurally generated 500 m x 500 m terrains in the MARE simulator (Unreal Engine 5.7), under low sun elevations of 3 to 35 degrees with long shadows. Each sample pairs a 640 x 480 central navigation camera (with and without lens glare), a stereo pair with 20 cm baseline, a rear camera, an event camera (346 x 260), a SPAD single-photon camera (256 x 256) and a 1 Hz lidar scan with pixel-accurate ground truth: planar depth (uint16 mm and float32 m), per-pixel object classes (sky, rover, sun disc, sun glare, landscape, crater, crater rim, wheel track, boulder, small rock) and shadow classes that separate the rover's own shadow from terrain shadow. Splits are by terrain: 3,872 train, 583 validation, 585 test. Shards are WebDataset tar files loadable with datasets or webdataset; the repo also holds per-episode metadata and intrinsics, the terrain DEMs with crater and rock lists, and MCAP rosbags of odometry, IMU and tf. Licensed CC BY 4.0; cite the MARE paper (Castilla-Arquillo and Olivares-Mendez, 2026).

How to load this dataset in Python

import pandas as pd
df = pd.read_csv("hf://datasets/raulcastar/mare-lunar-rover-dataset/episodes/map_000_ep00_frames.csv")
df.head()

Data structure

File types in sampled files: MCAP, CSV

Files

Example file: episodes/map_000_ep00_frames.csv

Analyze this dataset without downloading it

On Scigantic, MARE Lunar Rover Dataset: Synthetic Multisensor Frames with Depth, Object and Shadow Ground Truth opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Astronomy & Space datasets