ClimSim Low-Resolution Expanded Inputs (ClimSim-Online)

Provider
LEAP NSF Science and Technology Center, Columbia University, and ClimSim consortium
License
CC-BY-4.0 (source)
Size
100,000 files
Format
NetCDF (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/LEAP/ClimSim_low-res-expanded)
Access
Free and public. No account with the data provider is needed.
Category
Climate & Weather
Source
https://arxiv.org/abs/2306.08754

About ClimSim Low-Resolution Expanded Inputs (ClimSim-Online)

ClimSim, from the LEAP NSF Science and Technology Center and partners, is the largest dataset built for hybrid ML-physics climate emulation: input and output vectors from the multi-scale climate model E3SM-MMF that isolate how embedded high-resolution cloud-resolving physics changes the host model's macro-scale state, so neural networks can learn to replace the expensive subgrid physics. Data were saved every 20 minutes for 10 simulated years as paired netCDF files, E3SM-MMF.mli.* (inputs) and E3SM-MMF.mlo.* (targets), with scalar and vertically resolved variables on ncol and lev. This repository expands ClimSim_low-res for the ClimSim-Online framework: each .mlexpand. file holds the same variables as the matching .mli. input file plus additional features, among them large-scale dynamical forcing, convection memory from the previous step and the cosine and sine of latitude, described in Section 6.3.3 of the supplementary information of the ClimSim-Online paper. These inputs support hybrid E3SM-MMF-NN runs where the emulator is coupled back into the host model and tested online. The listing (measured 2026-11-14) shows a train/ folder of monthly subfolders; the repository uses about 1.5 TB. Open with xarray or netCDF4 alongside ClimSim_low-res targets. Data are released under CC-BY-4.0 (code Apache-2.0); cite arXiv:2306.08754.

How to load ClimSim Low-Resolution Expanded Inputs (ClimSim-Online) in Python

from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="LEAP/ClimSim_low-res-expanded", filename="train/0001-02/E3SM-MMF.mlexpand.0001-02-01-02400.nc", repo_type="dataset")
print(path)

Data structure

File types in sampled files: NetCDF

Files

Example file: train/0001-02/E3SM-MMF.mlexpand.0001-02-01-02400.nc

Analyze this dataset without downloading it

On Scigantic, ClimSim Low-Resolution Expanded Inputs (ClimSim-Online) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Climate & Weather datasets