# NOAA POES and MetOp Space Environment Monitor (SEM-1 and SEM-2) MEPED Particle Precipitation Data, 1978-present (CDAWeb on HelioCloud)

## Facts

- Provider: NOAA NCEI/NGDC and SWPC; SEM-1 reprocessing by NASA SPDF (CDAWeb on HelioCloud)
- License: CC0-1.0 (https://heliophysicsdata.gsfc.nasa.gov/WS/hdp/1/Spase?ResourceID=spase://NOAA/NumericalData/POES/15/SEM-2/CDF/PT2S)
- Format: CSV (in sampled files)
- Stored at: Amazon S3, s3://gov-nasa-hdrl-data1/spdf/cdaweb/data/noaa (us-east-1)
- Access: public, readable without an account
- Category: Astronomy & Space
- Source: https://cdaweb.gsfc.nasa.gov/pub/data/noaa/
- Page: https://scigantic.com/archive/3915289a-fd4b-52f3-b7d9-1290bef7dda2
- Keywords: Astronomy & Space, heliophysics, CSV, AWS Open Data

## About

Low-Earth-orbit energetic particle data from the Space Environment Monitor flown by NOAA on the TIROS-N/NOAA Polar-orbiting Operational Environmental Satellites and on EUMETSAT's MetOp-A, B and C, which carry the NOAA-provided SEM-2. The HelioCloud catalog lists 14 datasets. NOAA-05 to NOAA-14 (1978-2004) hold SPDF's reprocessed SEM-1 Medium Energy Proton and Electron Detector (MEPED) archive at 1-minute resolution: detector counts, omnidirectional and perpendicular electron and proton fluxes, and magnetic field parameters (GSM Bx, By, Bz, B/Bmin, L shell) from the IGRF, T89, T96 and T01 field models driven by OMNI-2. NOAA-15, 16, 18, 19 and MetOp-1, 2, 3 (2012 onward) hold SEM-2 2-second particle precipitation fluxes from MEPED and the Total Energy Detector (TED); NOAA warns these have known contamination problems and asks users to consult the data provider (R. Redmon, NOAA NCEI) and the MEPED processing ATBD. Folders are noaa05 to noaa19 and metop1 to metop3. Files are CDF. Files mirror the NASA SPDF CDAWeb tree in the HelioCloud bucket and are listed in the HelioCloud catalog.json; read CDF files with cdflib, SpacePy or pySPEDAS. License: CC0 1.0, stated in the NOAA POES SPASE record's access rights; the SEM data are US government (NOAA) work. Cite NOAA NCEI/NGDC and SWPC, and S.F. Fung (SPDF) for the SEM-1 reprocessing.

## Load the data

```python
import boto3
from botocore import UNSIGNED
from botocore.client import Config
s3 = boto3.client('s3', region_name='us-east-1', config=Config(signature_version=UNSIGNED))
s3.list_objects_v2(Bucket='gov-nasa-hdrl-data1', Prefix='spdf/cdaweb/data/noaa/', Delimiter='/')
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

File types in sampled files: CSV

Example file: `spdf/cdaweb/data/noaa/indices/METOP1_POES-SEM2_FLUXES-2SEC_2012.csv`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/3915289a-fd4b-52f3-b7d9-1290bef7dda2
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/3915289a-fd4b-52f3-b7d9-1290bef7dda2
- Over MCP: `get_schema_card` with id `3915289a-fd4b-52f3-b7d9-1290bef7dda2` at https://api.scigantic.com/mcp

## Related topics

- [CSV datasets](https://scigantic.com/topics/csv)
- [Astronomy & Space datasets](https://scigantic.com/topics/astronomy-and-space)
- [Heliophysics datasets](https://scigantic.com/topics/heliophysics)
