# AstroPT Galaxies: 8.5 Million DESI Legacy Survey DR8 Galaxy Cutouts

## Facts

- Provider: Michael J. Smith et al. (AstroPT)
- License: CC-BY-SA-4.0 (https://www.legacysurvey.org/acknowledgment/)
- Size: 442 files
- Format: Parquet (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/datasets/Smith42/galaxies
- Access: public, readable without an account
- Category: Astronomy & Space
- Source: https://arxiv.org/abs/2405.14930
- Page: https://scigantic.com/archive/e0155021-5073-5834-b146-16c394231145
- Keywords: Astronomy & Space, Parquet, Hugging Face

## About

About 8.5 million galaxy cutouts from the DESI Legacy Imaging Surveys DR8, each a 512 by 512 pixel JPEG centred on a galaxy from the Galaxy Zoo DESI catalogue (Walmsley et al. 2023), assembled to train AstroPT, a family of large observation models for astronomy. 98 percent of images form the training set, with 1 percent each for validation and test. Galaxy properties are provided as metadata linked by dr8_id, and pre-computed AstroPT v2 embeddings are available in a companion repository; revision v2.0 joins images and metadata directly. Listing the repository (measured 2026-11-13) shows data/ with 196 Parquet shards (982.5 GB, train and test), with_crops/ with 243 Parquet shards (1,206 GB) and a root metadata.parquet (2.16 GB). Open with Hugging Face datasets (streaming=True is advisable), pyarrow or pandas, decoding the image bytes with PIL. Distributed under CC-BY-SA-4.0 by the uploader over CC-BY-4.0 Legacy Surveys imagery and Galaxy Zoo DESI catalogue; use the Legacy Surveys acknowledgment and cite Dey et al. 2019, Walmsley et al. 2023 and Smith et al. 2024.

## Load the data

```python
from datasets import load_dataset
ds = load_dataset("Smith42/galaxies")
print(ds)
```

## Data structure

File types in sampled files: Parquet

Example file: `data/test-00000-of-00002.parquet`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/e0155021-5073-5834-b146-16c394231145
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/e0155021-5073-5834-b146-16c394231145
- Over MCP: `get_schema_card` with id `e0155021-5073-5834-b146-16c394231145` at https://api.scigantic.com/mcp

## Related topics

- [Parquet datasets](https://scigantic.com/topics/parquet)
- [Astronomy & Space datasets](https://scigantic.com/topics/astronomy-and-space)
