DESI DR1 Galaxy Spectra: 100,000 Normalized Optical Spectra with Redshifts for Machine Learning (Dark Energy Spectroscopic Instrument)

Provider
marberi (MasterCosmos BCN, IFAE/PIC), from DESI Collaboration data
License
CC-BY-4.0 (source)
Size
14 files
Format
Parquet (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/marberi/desi-dr1-spectra-100k)
Access
Free and public. No account with the data provider is needed.
Category
Astronomy & Space
Source
https://github.com/marberi/can-you-trust-your-network

About this dataset

A random subset of 100,000 galaxy spectra with redshifts from Data Release 1 (DR1) of the Dark Energy Spectroscopic Instrument (DESI), prepared for the MasterCosmos BCN lecture "Can you trust your network?" (IFAE/PIC, Barcelona) for teaching and machine-learning redshift estimation. The parent sample follows Guo and Eriksen (2026): DR1 main-survey HEALPix target-coadded spectra from the dark, bright and backup programs with the three spectrograph arms combined, cut to ZCAT_PRIMARY, good fiber status, ZWARN 0 or 4, SPECTYPE GALAXY, ZERR 0.01 (about 14.6 million spectra, redshift up to about 1.7). Spectra are normalized by their median flux and stored in spectra.zarr as a float32 array (100000, 2, 7781) of flux and inverse variance on the DESI observed-frame grid from 3600 to 9824 Angstrom in 0.8 Angstrom steps, with bright sky lines masked in the inverse variance. catalog.parquet gives DESI TARGETID, pipeline redshift, spectral type, HEALPix pixel and normalizations. About 5 GB; load with zarr and pandas. Use it for photometric-free spectroscopic redshift networks and galaxy spectra representation learning. DESI data are CC BY 4.0; acknowledge DESI and cite DESI DR1.

How to load this dataset in Python

from datasets import load_dataset
ds = load_dataset("marberi/desi-dr1-spectra-100k")
print(ds)

Data structure

File types in sampled files: Parquet

Files

Example file: catalog.parquet

Analyze this dataset without downloading it

On Scigantic, DESI DR1 Galaxy Spectra: 100,000 Normalized Optical Spectra with Redshifts for Machine Learning (Dark Energy Spectroscopic Instrument) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Astronomy & Space datasets