ClimSim Low-Resolution Expanded Inputs (ClimSim-Online)
- Provider
- LEAP NSF Science and Technology Center, Columbia University, and ClimSim consortium
- License
- CC-BY-4.0 (source)
- Size
- 100,000 files
- Format
- NetCDF (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/LEAP/ClimSim_low-res-expanded)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Climate & Weather
- Source
- https://arxiv.org/abs/2306.08754
About ClimSim Low-Resolution Expanded Inputs (ClimSim-Online)
ClimSim, from the LEAP NSF Science and Technology Center and partners, is the largest dataset built for hybrid ML-physics climate emulation: input and output vectors from the multi-scale climate model E3SM-MMF that isolate how embedded high-resolution cloud-resolving physics changes the host model's macro-scale state, so neural networks can learn to replace the expensive subgrid physics. Data were saved every 20 minutes for 10 simulated years as paired netCDF files, E3SM-MMF.mli.* (inputs) and E3SM-MMF.mlo.* (targets), with scalar and vertically resolved variables on ncol and lev. This repository expands ClimSim_low-res for the ClimSim-Online framework: each .mlexpand. file holds the same variables as the matching .mli. input file plus additional features, among them large-scale dynamical forcing, convection memory from the previous step and the cosine and sine of latitude, described in Section 6.3.3 of the supplementary information of the ClimSim-Online paper. These inputs support hybrid E3SM-MMF-NN runs where the emulator is coupled back into the host model and tested online. The listing (measured 2026-11-14) shows a train/ folder of monthly subfolders; the repository uses about 1.5 TB. Open with xarray or netCDF4 alongside ClimSim_low-res targets. Data are released under CC-BY-4.0 (code Apache-2.0); cite arXiv:2306.08754.
How to load ClimSim Low-Resolution Expanded Inputs (ClimSim-Online) in Python
from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="LEAP/ClimSim_low-res-expanded", filename="train/0001-02/E3SM-MMF.mlexpand.0001-02-01-02400.nc", repo_type="dataset")
print(path)Data structure
File types in sampled files: NetCDF
Files
Example file: train/0001-02/E3SM-MMF.mlexpand.0001-02-01-02400.nc
Analyze this dataset without downloading it
On Scigantic, ClimSim Low-Resolution Expanded Inputs (ClimSim-Online) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Climate & Weather datasets
- Ocean Radar - Northwest shelf site - Sea water velocity - Delayed mode
- DWD ICON Weather Model Archive
- NOAA Fundamental Climate Data Records (FCDR)
- Global Airport Weather GeoParquet (1940-present)
- Sentinel-5P TROPOMI Level-2 Methane (CH4) over Africa, Daily COGs (Digital Earth Africa)
- NOAA/PMEL Ocean Climate Stations Moorings
- NOAA observations for Global Workflow test cases: BUFR and IODA dumps, GEFS aerosol inputs, GFS analysis restarts
- CHIRPS v2.0: quasi-global rainfall, 1981 to present, 0.05 degree (monthly and annual)