Daily Temperature and Precipitation for 210 Long-Record US Cities, 1851-2018: GHCN-Daily ThreadEx Training Set (CMU Protostar Challenge)
- Provider
- Yuchuan Lai, David Dzombak (original data); CMU Open Source Programs Office (challenge cut)
- License
- CC0-1.0 (source)
- Size
- 6 files
- Format
- Parquet (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/CMU-OSPO/protostar-climate-train-to-2018)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Climate & Weather
- Source
- https://huggingface.co/datasets/CMU-OSPO/protostar-climate-train-to-2018
About this dataset
Daily maximum and minimum temperature and daily precipitation for 210 US cities with climate records starting between 1851 and 1899, plus yearly averages, totals and extreme climate indices, cut at 2018-12-31 as the training set for Carnegie Mellon University's Protostar Challenge on climate risk forecasting (teams forecast 2019 to 2025). Each city record is the threaded combination of the weather stations that served it over time (ThreadEx), named by the city's current GHCN station ID, with observations from NOAA's Global Historical Climatology Network Daily (GHCN-D) via the Applied Climate Information System. Four Parquet subsets: daily (10.2 million city-days, tmax and tmin in degrees F, prcp in inches), annual_indices (28,052 city-years with average and extreme temperature, warm and cold days and nights, 1-day and 5-day maximum precipitation, wet-day precipitation and a cooling degree days column), city_info (stations combined per city) and coverage_and_stations. Loads with the datasets library. Built from KiltHub records by Yuchuan Lai and David Dzombak, DOI 10.1184/R1/7890488.v6 and 10.1184/R1/7961012.v6, both CC0; cite those records.
How to load this dataset in Python
from datasets import load_dataset
ds = load_dataset("CMU-OSPO/protostar-climate-train-to-2018")
print(ds)Data structure
File types in sampled files: Parquet
Files
Example file: annual_indices/train-00000-of-00001.parquet
Analyze this dataset without downloading it
On Scigantic, Daily Temperature and Precipitation for 210 Long-Record US Cities, 1851-2018: GHCN-Daily ThreadEx Training Set (CMU Protostar Challenge) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Climate & Weather datasets
- NEXRAD ARCO
- NOAA Fundamental Climate Data Records (FCDR)
- NOAA National Water Model CONUS Retrospective Dataset
- NOAA 3-D Surge and Tide Operational Forecast System for the Atlantic Basin (STOFS-3D-Atlantic)
- NOAA Integrated Surface Database (ISD)
- NOAA Rapid Refresh Forecast System (RRFS) and RRFS Ensemble Forecast System (REFS), Operational
- NOAA / NGA Satellite Computed Bathymetry Assessment-SCuBA
- NOAA Atmospheric Climate Data Records