DESI Early Data Release (EDR): Survey Validation Spectra, Fuji Reduction

Provider
DESI Collaboration (Lawrence Berkeley National Laboratory)
License
CC-BY-4.0 (source)
Format
FITS (in sampled files)
Stored at
Amazon S3, s3://desidata/edr (us-west-2)
Access
Free and public. No account with the data provider is needed.
Category
Astronomy & Space
Source
https://arxiv.org/abs/2306.06308

About DESI Early Data Release (EDR): Survey Validation Spectra, Fuji Reduction

Early Data Release of the Dark Energy Spectroscopic Instrument (DESI), covering commissioning and Survey Validation observations taken December 2020 through June 2021. It contains 2,044,588 HEALPix-coadded spectra, of which 1,769,157 are useful (ZWARN==0) for 1,712,004 unique targets: 1,125,635 galaxies, 90,241 quasars and 496,128 stars over roughly 1,390 square degrees. Programs include commissioning (cmx), Target Selection Validation (sv1) with looser selections and deeper exposures, Operations Testing (sv2), and the One-Percent Survey (sv3) of 20 rosette fields. The prefix mirrors the NERSC EDR tree: spectro/redux/fuji/ holds the Fuji spectroscopic reduction (coadded spectra and Redrock redshift catalogs in FITS), with survey/ and vac/ holding survey files and the EDR value-added catalogs (FastSpecFit, PROVABGS, Lyman-alpha, Mg II absorbers, BAL and DLA quasar catalogs, visual inspections and others). Read with astropy, fitsio or desispec. Licensed CC BY 4.0 by the DESI collaboration; cite DESI Collaboration et al. (2023), arXiv:2306.06308.

How to access this dataset in Python

import boto3
from botocore import UNSIGNED
from botocore.client import Config
s3 = boto3.client('s3', region_name='us-west-2', config=Config(signature_version=UNSIGNED))
s3.list_objects_v2(Bucket='desidata', Prefix='edr/', Delimiter='/')

Lists the files with anonymous access. Runs on any machine, with no cloud account.

Data structure

File types in sampled files: FITS

Files

Example file: edr/spectro/desi_spectro_calib/0.3.1/CHANGES

Analyze this dataset without downloading it

On Scigantic, DESI Early Data Release (EDR): Survey Validation Spectra, Fuji Reduction opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Astronomy & Space datasets