Multimodal Universe: DESI Early Data Release SV3 Spectra

Provider
Multimodal Universe Collaboration (Polymathic AI, UniverseTBD)
License
CC-BY-4.0 (source)
Size
634 files
Format
PNG, Parquet (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/UniverseTBD/mmu_desi_edr_sv3)
Access
Free and public. No account with the data provider is needed.
Category
Astronomy & Space
Source
https://arxiv.org/abs/2412.02527

About Multimodal Universe: DESI Early Data Release SV3 Spectra

Optical spectra from the Dark Energy Spectroscopic Instrument (DESI) Early Data Release (EDR), Survey Validation 3 (the One-Percent Survey), packaged as part of the Multimodal Universe collection of machine-learning-ready astronomical data. The modality is 1D spectroscopy: each of 1,126,441 objects has a spectrum of 7,781 pixels starting at 3,600 Angstrom with flux, inverse variance, line spread function width and mask arrays, plus the DESI redshift Z, ZERR and ZWARN flag, Galactic extinction and Legacy Surveys g, r and z total and fiber fluxes. The README lists 20 columns in 306 HEALPix partitions and 61.8 GiB on disk. Listing the repository (measured 2026-11-13) shows the main catalog folder mmu_desi_edr_sv3/ (dataset/, hats.properties, partition_info.csv, point_map.fits), the margin catalog mmu_desi_edr_sv3_10arcs/ and collection.properties; about 69 GB in all. Data are a HATS catalog: Apache Parquet partitioned by HEALPix tile, with a 10 arcsecond margin catalog for cross-matching. Open with LSDB (lsdb.open_catalog on the Hugging Face URL, with cone searches and crossmatch), or read the Parquet with pandas, pyarrow, dask or DuckDB. Uses include redshift estimation, spectral classification and cross-modal learning with the Legacy Surveys images. Part of the Multimodal Universe (arXiv:2412.02527); released under CC-BY-4.0, cite the Multimodal Universe paper and the original survey.

How to load Multimodal Universe: DESI Early Data Release SV3 Spectra in Python

from datasets import load_dataset
ds = load_dataset("UniverseTBD/mmu_desi_edr_sv3")
print(ds)

Data structure

File types in sampled files: PNG, Parquet

Files

Example file: mmu_desi_edr_sv3/dataset/Norder=10/Dir=2500000/Npix=2506751.parquet

Analyze this dataset without downloading it

On Scigantic, Multimodal Universe: DESI Early Data Release SV3 Spectra opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Astronomy & Space datasets