DESI Early Data Release (EDR): Survey Validation Spectra, Fuji Reduction
- Provider
- DESI Collaboration (Lawrence Berkeley National Laboratory)
- License
- CC-BY-4.0 (source)
- Format
- FITS (in sampled files)
- Stored at
- Amazon S3, s3://desidata/edr (us-west-2)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Astronomy & Space
- Source
- https://arxiv.org/abs/2306.06308
About DESI Early Data Release (EDR): Survey Validation Spectra, Fuji Reduction
Early Data Release of the Dark Energy Spectroscopic Instrument (DESI), covering commissioning and Survey Validation observations taken December 2020 through June 2021. It contains 2,044,588 HEALPix-coadded spectra, of which 1,769,157 are useful (ZWARN==0) for 1,712,004 unique targets: 1,125,635 galaxies, 90,241 quasars and 496,128 stars over roughly 1,390 square degrees. Programs include commissioning (cmx), Target Selection Validation (sv1) with looser selections and deeper exposures, Operations Testing (sv2), and the One-Percent Survey (sv3) of 20 rosette fields. The prefix mirrors the NERSC EDR tree: spectro/redux/fuji/ holds the Fuji spectroscopic reduction (coadded spectra and Redrock redshift catalogs in FITS), with survey/ and vac/ holding survey files and the EDR value-added catalogs (FastSpecFit, PROVABGS, Lyman-alpha, Mg II absorbers, BAL and DLA quasar catalogs, visual inspections and others). Read with astropy, fitsio or desispec. Licensed CC BY 4.0 by the DESI collaboration; cite DESI Collaboration et al. (2023), arXiv:2306.06308.
How to access this dataset in Python
import boto3
from botocore import UNSIGNED
from botocore.client import Config
s3 = boto3.client('s3', region_name='us-west-2', config=Config(signature_version=UNSIGNED))
s3.list_objects_v2(Bucket='desidata', Prefix='edr/', Delimiter='/')Lists the files with anonymous access. Runs on any machine, with no cloud account.
Data structure
File types in sampled files: FITS
Files
Example file: edr/spectro/desi_spectro_calib/0.3.1/CHANGES
Analyze this dataset without downloading it
On Scigantic, DESI Early Data Release (EDR): Survey Validation Spectra, Fuji Reduction opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Astronomy & Space datasets
- SuryaBench Active Region Emergence: SDO/HMI Acoustic Power, Magnetic Flux and Intensity Timelines for 59 Emerging Active Regions
- GWOSC O3b 16 kHz Gravitational-Wave Strain
- SDOML-lite: SDO AIA and HMI Full-Disk Solar Images at 15-Minute Cadence, 2010-2024, for Machine Learning (Oxford)
- SuryaBench Solar Wind Forecasting: Hourly OMNI Solar Wind Speed, Density and IMF at L1 (2010-2024)
- Galaxy Evolution Explorer Satellite (GALEX)
- DSCOVR Fluxgate Magnetometer and Faraday Cup Solar Wind Data at L1, 2015-present (CDAWeb on HelioCloud)
- Interball-1 Tail Probe (Russian IKI): MIFM Magnetometer, CORALL Ions, ELECTRON, PROMICS, VDP, AKR Radio and Energetic Particles, 1995-2000 (CDAWeb on HelioCloud)
- Event Horizon Telescope 2017 M87 Calibrated Visibilities (First M87 Results, 2019-D01-01), Parquet