ClimSim High-Resolution Real Geography (E3SM-MMF, 1.5 degree)

Provider
LEAP NSF Science and Technology Center, Columbia University, and ClimSim consortium
License
CC-BY-4.0 (source)
Size
100,000 files
Format
NetCDF (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/LEAP/ClimSim_high-res)
Access
Free and public. No account with the data provider is needed.
Category
Climate & Weather
Source
https://arxiv.org/abs/2306.08754

About ClimSim High-Resolution Real Geography (E3SM-MMF, 1.5 degree)

ClimSim, from the LEAP NSF Science and Technology Center and partners, is the largest dataset built for hybrid ML-physics climate emulation: input and output vectors from the multi-scale climate model E3SM-MMF that isolate how embedded high-resolution cloud-resolving physics changes the host model's macro-scale state, so neural networks can learn to replace the expensive subgrid physics. Data were saved every 20 minutes for 10 simulated years as paired netCDF files, E3SM-MMF.mli.* (inputs) and E3SM-MMF.mlo.* (targets), with scalar and vertically resolved variables on ncol and lev. This is the high-resolution real-geography configuration: 1.5 x 1.5 degree horizontal grid (21,600 grid columns), which the project documentation counts as 5.7 billion samples and 41.2 TB (about 102 MB per input file and 61 MB per output file). The listing (measured 2026-11-14) shows a train/ folder of monthly subfolders and ClimSim_high-res_grid-info.nc; the repository uses about 44.7 TB. Open files with xarray or netCDF4; the climsim_utils package and notebooks on GitHub handle normalisation and baselines (MLP, CNN, cVAE and others). Data are released under CC-BY-4.0 (code Apache-2.0); cite the ClimSim NeurIPS 2023 paper, arXiv:2306.08754.

How to load ClimSim High-Resolution Real Geography (E3SM-MMF, 1.5 degree) in Python

from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="LEAP/ClimSim_high-res", filename="ClimSim_high-res_grid-info.nc", repo_type="dataset")
print(path)

Data structure

File types in sampled files: NetCDF

Files

Example file: ClimSim_high-res_grid-info.nc

Analyze this dataset without downloading it

On Scigantic, ClimSim High-Resolution Real Geography (E3SM-MMF, 1.5 degree) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Climate & Weather datasets