The Well: Periodic Shear Flow (2D Incompressible Navier-Stokes)

Provider
Polymathic AI (The Well); Rudy Morel, Flatiron Institute CCM
License
CC-BY-4.0 (source)
Size
91 files
Format
HDF5 (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/polymathic-ai/shear_flow)
Access
Free and public. No account with the data provider is needed.
Category
Physics
Source
https://arxiv.org/abs/2412.00568

About The Well: Periodic Shear Flow (2D Incompressible Navier-Stokes)

2D periodic shear flow governed by the incompressible Navier-Stokes equations with an advected passive tracer, solved spectrally with Dedalus. Each simulation has 200 time steps of 128 by 256 images over t from 0 to 20 on a doubly periodic domain. Fields are tracer, pressure and velocity. The datasheet lists 1,120 simulations: 28 PDE parameter pairs (Reynolds 1e4 to 5e5, Schmidt 0.1 to 10) times 40 initial conditions built from tanh shear layers with sinusoidal perturbations. The publishers warn that this Hugging Face copy is v1.0, in which about 80 percent of validation and test trajectories duplicate training trajectories; a corrected v2.0 with disjoint initial conditions is available from Flatiron through the-well-download. Listing data/ (measured 2026-11-13) shows train/ (28 files, 376 GB, one per Reynolds-Schmidt pair), valid/ and test/ (28 files, 47.5 GB each); about 471 GB in the repository. Files are HDF5 in the common The Well format; open them with the_well package (WellDataModule with base path hf://datasets/polymathic-ai/) or directly with h5py. Part of The Well (Ohana et al., NeurIPS 2024 Datasets and Benchmarks, arXiv:2412.00568); released under CC-BY-4.0, cite The Well and the simulation's source papers.

How to load The Well: Periodic Shear Flow (2D Incompressible Navier-Stokes) in Python

from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="polymathic-ai/shear_flow", filename="data/test/shear_flow_Reynolds_1e4_Schmidt_1e-1.hdf5", repo_type="dataset")
print(path)

Data structure

File types in sampled files: HDF5

Files

Example file: data/test/shear_flow_Reynolds_1e4_Schmidt_1e-1.hdf5

Analyze this dataset without downloading it

On Scigantic, The Well: Periodic Shear Flow (2D Incompressible Navier-Stokes) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Physics datasets