Multimodal Universe DESI x SDSS Cross-Matched Spectra Pairs (13,794 Galaxies)
- Provider
- Michael J. Smith (UniverseTBD), from Multimodal Universe DESI and SDSS subsets
- License
- CC-BY-4.0 (source)
- Size
- 9 files
- Format
- Parquet (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/Smith42/desi_sdss_crossmatched)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Astronomy & Space
- Source
- https://arxiv.org/abs/2412.02527
About Multimodal Universe DESI x SDSS Cross-Matched Spectra Pairs (13,794 Galaxies)
Paired optical spectra of the same objects observed by both the Dark Energy Spectroscopic Instrument (DESI, Early Data Release) and the Sloan Digital Sky Survey (SDSS/BOSS), cross-matched by sky position from the Multimodal Universe DESI EDR SV3 and SDSS subsets. Each of 13,794 rows holds a DESI spectrum (7,781 pixels: flux, inverse variance, line spread function width, wavelength and mask) and an SDSS spectrum with the same fields, the DESI redshift Z with ZERR and ZWARN, the SDSS redshift with Z_ERR, ZWARNING and velocity dispersion VDISP, SDSS spectro-photometric and synthetic ugriz fluxes with inverse variances, Legacy Surveys g, r, z total and fiber fluxes, and Galactic E(B-V). The data are Parquet shards under data/ (one train split, about 1.76 GB, measured 2026-11-16), loadable with Hugging Face datasets, pandas or pyarrow. Uses include cross-instrument spectral translation, testing spectrum foundation models for instrument invariance, and redshift calibration between surveys. DESI data are licensed CC-BY-4.0 and SDSS public data are in the public domain; the packager also tags the repository CC-BY-SA-4.0. Cite DESI EDR, SDSS and the Multimodal Universe paper (arXiv:2412.02527).
How to load this dataset in Python
from datasets import load_dataset
ds = load_dataset("Smith42/desi_sdss_crossmatched")
print(ds)Data structure
File types in sampled files: Parquet
Files
Example file: data/train-00000-of-00006.parquet
Analyze this dataset without downloading it
On Scigantic, Multimodal Universe DESI x SDSS Cross-Matched Spectra Pairs (13,794 Galaxies) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Astronomy & Space datasets
- DMSP Space Environment Sensor Data: SSJ Precipitating Particles, SSIES-3 Thermal Plasma and SSM Magnetometer, F06 to F19 (CDAWeb on HelioCloud)
- GALEX Galaxy Evolution Explorer Observation Log from MAST: 274,911 Ultraviolet Pointings, 2003-2013
- Sup3rCC
- Pioneer 10 Helium Vector Magnetometer 1-Minute Field and Hourly Merged Magnetic Field, Plasma and Proton Flux Data, 1972-1995 (CDAWeb on HelioCloud)
- Mars-Bench Frost Classification, MRO HiRISE (Frost vs Non-Frost, 53,788 tiles)
- Kepler Observation Log from MAST: 212,993 Prime-Mission Target Observations with KIC IDs, Cadence and Quarter Coverage
- STEREO Ahead and Behind In-Situ Data: IMPACT, PLASTIC and S/WAVES (CDAWeb on HelioCloud)
- BARREL Balloon Array for Radiation-belt Relativistic Electron Losses: X-ray Spectra and Magnetometer Data (CDAWeb on HelioCloud)