NOAA POES and MetOp Space Environment Monitor (SEM-1 and SEM-2) MEPED Particle Precipitation Data, 1978-present (CDAWeb on HelioCloud)

Provider
NOAA NCEI/NGDC and SWPC; SEM-1 reprocessing by NASA SPDF (CDAWeb on HelioCloud)
License
CC0-1.0 (source)
Format
CSV (in sampled files)
Stored at
Amazon S3, s3://gov-nasa-hdrl-data1/spdf/cdaweb/data/noaa (us-east-1)
Access
Free and public. No account with the data provider is needed.
Category
Astronomy & Space
Source
https://cdaweb.gsfc.nasa.gov/pub/data/noaa/

About this dataset

Low-Earth-orbit energetic particle data from the Space Environment Monitor flown by NOAA on the TIROS-N/NOAA Polar-orbiting Operational Environmental Satellites and on EUMETSAT's MetOp-A, B and C, which carry the NOAA-provided SEM-2. The HelioCloud catalog lists 14 datasets. NOAA-05 to NOAA-14 (1978-2004) hold SPDF's reprocessed SEM-1 Medium Energy Proton and Electron Detector (MEPED) archive at 1-minute resolution: detector counts, omnidirectional and perpendicular electron and proton fluxes, and magnetic field parameters (GSM Bx, By, Bz, B/Bmin, L shell) from the IGRF, T89, T96 and T01 field models driven by OMNI-2. NOAA-15, 16, 18, 19 and MetOp-1, 2, 3 (2012 onward) hold SEM-2 2-second particle precipitation fluxes from MEPED and the Total Energy Detector (TED); NOAA warns these have known contamination problems and asks users to consult the data provider (R. Redmon, NOAA NCEI) and the MEPED processing ATBD. Folders are noaa05 to noaa19 and metop1 to metop3. Files are CDF. Files mirror the NASA SPDF CDAWeb tree in the HelioCloud bucket and are listed in the HelioCloud catalog.json; read CDF files with cdflib, SpacePy or pySPEDAS. License: CC0 1.0, stated in the NOAA POES SPASE record's access rights; the SEM data are US government (NOAA) work. Cite NOAA NCEI/NGDC and SWPC, and S.F. Fung (SPDF) for the SEM-1 reprocessing.

How to access this dataset in Python

import boto3
from botocore import UNSIGNED
from botocore.client import Config
s3 = boto3.client('s3', region_name='us-east-1', config=Config(signature_version=UNSIGNED))
s3.list_objects_v2(Bucket='gov-nasa-hdrl-data1', Prefix='spdf/cdaweb/data/noaa/', Delimiter='/')

Lists the files with anonymous access. Runs on any machine, with no cloud account.

Data structure

File types in sampled files: CSV

Files

Example file: spdf/cdaweb/data/noaa/indices/METOP1_POES-SEM2_FLUXES-2SEC_2012.csv

Analyze this dataset without downloading it

On Scigantic, NOAA POES and MetOp Space Environment Monitor (SEM-1 and SEM-2) MEPED Particle Precipitation Data, 1978-present (CDAWeb on HelioCloud) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Astronomy & Space datasets