ClimSim High-Resolution Real Geography (E3SM-MMF, 1.5 degree)
- Provider
- LEAP NSF Science and Technology Center, Columbia University, and ClimSim consortium
- License
- CC-BY-4.0 (source)
- Size
- 100,000 files
- Format
- NetCDF (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/LEAP/ClimSim_high-res)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Climate & Weather
- Source
- https://arxiv.org/abs/2306.08754
About ClimSim High-Resolution Real Geography (E3SM-MMF, 1.5 degree)
ClimSim, from the LEAP NSF Science and Technology Center and partners, is the largest dataset built for hybrid ML-physics climate emulation: input and output vectors from the multi-scale climate model E3SM-MMF that isolate how embedded high-resolution cloud-resolving physics changes the host model's macro-scale state, so neural networks can learn to replace the expensive subgrid physics. Data were saved every 20 minutes for 10 simulated years as paired netCDF files, E3SM-MMF.mli.* (inputs) and E3SM-MMF.mlo.* (targets), with scalar and vertically resolved variables on ncol and lev. This is the high-resolution real-geography configuration: 1.5 x 1.5 degree horizontal grid (21,600 grid columns), which the project documentation counts as 5.7 billion samples and 41.2 TB (about 102 MB per input file and 61 MB per output file). The listing (measured 2026-11-14) shows a train/ folder of monthly subfolders and ClimSim_high-res_grid-info.nc; the repository uses about 44.7 TB. Open files with xarray or netCDF4; the climsim_utils package and notebooks on GitHub handle normalisation and baselines (MLP, CNN, cVAE and others). Data are released under CC-BY-4.0 (code Apache-2.0); cite the ClimSim NeurIPS 2023 paper, arXiv:2306.08754.
How to load ClimSim High-Resolution Real Geography (E3SM-MMF, 1.5 degree) in Python
from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="LEAP/ClimSim_high-res", filename="ClimSim_high-res_grid-info.nc", repo_type="dataset")
print(path)Data structure
File types in sampled files: NetCDF
Files
Example file: ClimSim_high-res_grid-info.nc
Analyze this dataset without downloading it
On Scigantic, ClimSim High-Resolution Real Geography (E3SM-MMF, 1.5 degree) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Climate & Weather datasets
- NOAA Global Surge and Tide Operational Forecast System 2-D (STOFS-2D-Global)
- NOAA Oceanic Climate Data Records
- NOAA Climate Forecast System (CFS)
- NOAA Fundamental Climate Data Records (FCDR)
- NOAA U.S. Climate Gridded Dataset (NClimGrid)
- NOAA Global Historical Climatology Network Hourly (GHCNh)
- Argo Profiling Float Data from the Global Data Assembly Centre (Argo GDAC, Euro-Argo AWS Mirror)
- SondeHub Radiosonde Telemetry