# Multimodal Universe: SDSS DR17 Optical Spectra

## Facts

- Provider: Multimodal Universe Collaboration (Polymathic AI, UniverseTBD)
- License: CC-BY-4.0 (https://sdss.org/collaboration/image-use-policy/)
- Size: 1,947 files
- Format: PNG, Parquet (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/datasets/UniverseTBD/mmu_sdss_dr17
- Access: public, readable without an account
- Category: Astronomy & Space
- Source: https://arxiv.org/abs/2412.02527
- Page: https://scigantic.com/archive/c741b31a-47c9-5f09-9a56-ee3e9a2c7484
- Keywords: Astronomy & Space, spectroscopy, PNG, Parquet, Hugging Face

## About

Optical spectra from the Sloan Digital Sky Survey Data Release 17 (SDSS DR17), packaged as part of the Multimodal Universe collection of machine-learning-ready astronomical data. The modality is 1D spectroscopy: each of 3,930,301 objects has a spectrum (several thousand pixels) with flux, inverse variance, line spread function width and mask arrays, plus redshift Z and Z_ERR, the ZWARNING flag, velocity dispersion VDISP, spectro-photometric fluxes in u, g, r, i and z, and a survey column naming the SDSS program. The README lists 31 columns in 968 HEALPix partitions and 176.3 GiB on disk. Listing the repository (measured 2026-11-13) shows the main catalog folder mmu_sdss_dr17/ (dataset/, hats.properties, partition_info.csv, point_map.fits), the margin catalog mmu_sdss_dr17_10arcs/ and collection.properties; about 192 GB in all. Data are a HATS catalog: Apache Parquet partitioned by HEALPix tile, with a 10 arcsecond margin catalog for cross-matching. Open with LSDB (lsdb.open_catalog on the Hugging Face URL, with cone searches and crossmatch), or read the Parquet with pandas, pyarrow, dask or DuckDB. Uses include redshift estimation, galaxy and quasar classification and spectral foundation models. SDSS public data releases are in the public domain and this packaging carries CC-BY-4.0; cite the Multimodal Universe paper and acknowledge SDSS.

## Load the data

```python
from datasets import load_dataset
ds = load_dataset("UniverseTBD/mmu_sdss_dr17")
print(ds)
```

## Data structure

File types in sampled files: PNG, Parquet

Example file: `mmu_sdss_dr17/dataset/Norder=1/Dir=0/Npix=1.parquet`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/c741b31a-47c9-5f09-9a56-ee3e9a2c7484
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/c741b31a-47c9-5f09-9a56-ee3e9a2c7484
- Over MCP: `get_schema_card` with id `c741b31a-47c9-5f09-9a56-ee3e9a2c7484` at https://api.scigantic.com/mcp

## Related topics

- [Parquet datasets](https://scigantic.com/topics/parquet)
- [Astronomy & Space datasets](https://scigantic.com/topics/astronomy-and-space)
- [Spectroscopy datasets](https://scigantic.com/topics/spectroscopy)
- [PNG datasets](https://scigantic.com/topics/png)
