The Well: PlanetSWE, Forced Rotating Shallow Water on a Sphere

Provider
Polymathic AI (The Well); Michael McCabe
License
CC-BY-4.0 (source)
Size
137 files
Format
HDF5 (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/polymathic-ai/planetswe)
Access
Free and public. No account with the data provider is needed.
Category
Physics
Source
https://arxiv.org/abs/2306.10619

About The Well: PlanetSWE, Forced Rotating Shallow Water on a Sphere

Forced, hyperviscous rotating shallow water equations on a sphere with Earth-like topography and daily and annual periodic forcing, a simplified stand-in for a single pressure level of an atmospheric model. The shallow water equations are a depth-integrated form of incompressible Navier-Stokes for flows whose horizontal scales far exceed vertical ones. Solved with Dedalus on an equiangular 256 by 512 grid; each trajectory runs 3,024 steps (24 steps per model day, 1,008 per model year) for 3 model years. Fields are height and velocity. The datasheet lists 40 trajectories from different initial conditions. Listing data/ (measured 2026-11-13) shows train/ (96 files, 154 GB, 1.6 GB per file, one per initial condition and year segment), valid/ and test/ (12 files, 19.2 GB each); about 192 GB in the repository. Files are HDF5 in the common The Well format; open them with the_well package (WellDataModule with base path hf://datasets/polymathic-ai/) or directly with h5py. Part of The Well (Ohana et al., NeurIPS 2024 Datasets and Benchmarks, arXiv:2412.00568); released under CC-BY-4.0, cite The Well and the simulation's source papers.

How to load The Well: PlanetSWE, Forced Rotating Shallow Water on a Sphere in Python

from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="polymathic-ai/planetswe", filename="data/test/planetswe_IC36_s1.hdf5", repo_type="dataset")
print(path)

Data structure

File types in sampled files: HDF5

Files

Example file: data/test/planetswe_IC36_s1.hdf5

Analyze this dataset without downloading it

On Scigantic, The Well: PlanetSWE, Forced Rotating Shallow Water on a Sphere opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Physics datasets