DESI DR1 Galaxy Spectra: 100,000 Normalized Optical Spectra with Redshifts for Machine Learning (Dark Energy Spectroscopic Instrument)
- Provider
- marberi (MasterCosmos BCN, IFAE/PIC), from DESI Collaboration data
- License
- CC-BY-4.0 (source)
- Size
- 14 files
- Format
- Parquet (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/marberi/desi-dr1-spectra-100k)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Astronomy & Space
- Source
- https://github.com/marberi/can-you-trust-your-network
About this dataset
A random subset of 100,000 galaxy spectra with redshifts from Data Release 1 (DR1) of the Dark Energy Spectroscopic Instrument (DESI), prepared for the MasterCosmos BCN lecture "Can you trust your network?" (IFAE/PIC, Barcelona) for teaching and machine-learning redshift estimation. The parent sample follows Guo and Eriksen (2026): DR1 main-survey HEALPix target-coadded spectra from the dark, bright and backup programs with the three spectrograph arms combined, cut to ZCAT_PRIMARY, good fiber status, ZWARN 0 or 4, SPECTYPE GALAXY, ZERR 0.01 (about 14.6 million spectra, redshift up to about 1.7). Spectra are normalized by their median flux and stored in spectra.zarr as a float32 array (100000, 2, 7781) of flux and inverse variance on the DESI observed-frame grid from 3600 to 9824 Angstrom in 0.8 Angstrom steps, with bright sky lines masked in the inverse variance. catalog.parquet gives DESI TARGETID, pipeline redshift, spectral type, HEALPix pixel and normalizations. About 5 GB; load with zarr and pandas. Use it for photometric-free spectroscopic redshift networks and galaxy spectra representation learning. DESI data are CC BY 4.0; acknowledge DESI and cite DESI DR1.
How to load this dataset in Python
from datasets import load_dataset
ds = load_dataset("marberi/desi-dr1-spectra-100k")
print(ds)Data structure
File types in sampled files: Parquet
Files
Example file: catalog.parquet
Analyze this dataset without downloading it
On Scigantic, DESI DR1 Galaxy Spectra: 100,000 Normalized Optical Spectra with Redshifts for Machine Learning (Dark Energy Spectroscopic Instrument) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Astronomy & Space datasets
- GOES and OMNI >2 MeV Geostationary Electron Flux Forecasting Dataset (GOES-14/GOES-16, 2013-2025)
- Sup3rCC
- AstroPT Galaxies: 8.5 Million DESI Legacy Survey DR8 Galaxy Cutouts
- Sup3rCC
- Mars-Bench MER Pancam Multi-Label Surface Classification (Spirit and Opportunity, 25 labels)
- Mars-Bench Boulder Detection, MRO HiRISE (YOLO, COCO and Pascal VOC boxes)
- SuperDARN Super Dual Auroral Radar Network: HF Radar Ionospheric Convection Velocity Key Parameters, Seven Radars, 1992-2001 (CDAWeb on HelioCloud)
- Voyager 1 Magnetic Field, Plasma, Energetic Particle and Plasma Wave Data (CDAWeb on HelioCloud)