Multimodal Universe: DESI Legacy Imaging Surveys North Galaxy Images (SSL Sample)

Provider
Multimodal Universe Collaboration (Polymathic AI, UniverseTBD)
License
CC-BY-4.0 (source)
Size
10,995 files
Format
PNG, Parquet (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/UniverseTBD/mmu_ssl_legacysurvey_north)
Access
Free and public. No account with the data provider is needed.
Category
Astronomy & Space
Source
https://arxiv.org/abs/2412.02527

About this dataset

Multi-band galaxy image cutouts from the northern footprint of the DESI Legacy Imaging Surveys, the self-supervised learning (SSL) galaxy sample, packaged as part of the Multimodal Universe, a collection of about 100 TB of machine-learning-ready astronomical data. The modality is imaging: each of 14,174,203 objects carries a g, r and z band flux image of 152 by 152 pixels at 0.262 arcsec per pixel with per-band PSF FWHM, together with catalogue photometry (flux_g, flux_r, flux_z, fiber fluxes, PSF depths), Galactic extinction E(B-V) and a spectroscopic redshift z_spec where one exists. The README lists 15 columns in 5,488 HEALPix partitions and 3.4 TiB on disk. Listing the repository (measured 2026-11-13) shows the main catalog folder mmu_ssl_legacysurvey_north/ (dataset/, hats.properties, partition_info.csv, point_map.fits), the margin catalog mmu_ssl_legacysurvey_north_10arcs/ and collection.properties; about 3.8 TB in all. Data are a HATS catalog: Apache Parquet partitioned by HEALPix tile, with a 10 arcsecond margin catalog for cross-matching. Open with LSDB (lsdb.open_catalog on the Hugging Face URL, with cone searches and crossmatch), or read the Parquet with pandas, pyarrow, dask or DuckDB. Uses include galaxy representation learning, photometric redshift estimation and morphology. Part of the Multimodal Universe (arXiv:2412.02527); released under CC-BY-4.0, cite the Multimodal Universe paper and the original survey.

How to load this dataset in Python

from datasets import load_dataset
ds = load_dataset("UniverseTBD/mmu_ssl_legacysurvey_north")
print(ds)

Data structure

File types in sampled files: PNG, Parquet

Files

Example file: mmu_ssl_legacysurvey_north/dataset/Norder=4/Dir=0/Npix=1005.parquet

Analyze this dataset without downloading it

On Scigantic, Multimodal Universe: DESI Legacy Imaging Surveys North Galaxy Images (SSL Sample) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Astronomy & Space datasets