# DESI DR1 Galaxy Spectra: 100,000 Normalized Optical Spectra with Redshifts for Machine Learning (Dark Energy Spectroscopic Instrument)

## Facts

- Provider: marberi (MasterCosmos BCN, IFAE/PIC), from DESI Collaboration data
- License: CC-BY-4.0 (https://data.desi.lbl.gov/doc/acknowledgments/)
- Size: 14 files
- Format: Parquet (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/datasets/marberi/desi-dr1-spectra-100k
- Access: public, readable without an account
- Category: Astronomy & Space
- Source: https://github.com/marberi/can-you-trust-your-network
- Page: https://scigantic.com/archive/da477f0e-4a48-571e-b2b5-6e9da8aa08ac
- Keywords: Astronomy & Space, spectroscopy, Parquet, Hugging Face

## About

A random subset of 100,000 galaxy spectra with redshifts from Data Release 1 (DR1) of the Dark Energy Spectroscopic Instrument (DESI), prepared for the MasterCosmos BCN lecture "Can you trust your network?" (IFAE/PIC, Barcelona) for teaching and machine-learning redshift estimation. The parent sample follows Guo and Eriksen (2026): DR1 main-survey HEALPix target-coadded spectra from the dark, bright and backup programs with the three spectrograph arms combined, cut to ZCAT_PRIMARY, good fiber status, ZWARN 0 or 4, SPECTYPE GALAXY, ZERR 0.01 (about 14.6 million spectra, redshift up to about 1.7). Spectra are normalized by their median flux and stored in spectra.zarr as a float32 array (100000, 2, 7781) of flux and inverse variance on the DESI observed-frame grid from 3600 to 9824 Angstrom in 0.8 Angstrom steps, with bright sky lines masked in the inverse variance. catalog.parquet gives DESI TARGETID, pipeline redshift, spectral type, HEALPix pixel and normalizations. About 5 GB; load with zarr and pandas. Use it for photometric-free spectroscopic redshift networks and galaxy spectra representation learning. DESI data are CC BY 4.0; acknowledge DESI and cite DESI DR1.

## Load the data

```python
from datasets import load_dataset
ds = load_dataset("marberi/desi-dr1-spectra-100k")
print(ds)
```

## Data structure

File types in sampled files: Parquet

Example file: `catalog.parquet`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/da477f0e-4a48-571e-b2b5-6e9da8aa08ac
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/da477f0e-4a48-571e-b2b5-6e9da8aa08ac
- Over MCP: `get_schema_card` with id `da477f0e-4a48-571e-b2b5-6e9da8aa08ac` at https://api.scigantic.com/mcp

## Related topics

- [Parquet datasets](https://scigantic.com/topics/parquet)
- [Astronomy & Space datasets](https://scigantic.com/topics/astronomy-and-space)
- [Spectroscopy datasets](https://scigantic.com/topics/spectroscopy)
