# The Well: Periodic Shear Flow (2D Incompressible Navier-Stokes)

## Facts

- Provider: Polymathic AI (The Well); Rudy Morel, Flatiron Institute CCM
- License: CC-BY-4.0 (https://arxiv.org/html/2412.00568)
- Size: 91 files
- Format: HDF5 (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/datasets/polymathic-ai/shear_flow
- Access: public, readable without an account
- Category: Physics
- Source: https://arxiv.org/abs/2412.00568
- Page: https://scigantic.com/archive/5fbaecc3-72e6-5fe1-9260-593bb6da2402
- Keywords: Physics, PDE simulation, HDF5, Hugging Face

## About

2D periodic shear flow governed by the incompressible Navier-Stokes equations with an advected passive tracer, solved spectrally with Dedalus. Each simulation has 200 time steps of 128 by 256 images over t from 0 to 20 on a doubly periodic domain. Fields are tracer, pressure and velocity. The datasheet lists 1,120 simulations: 28 PDE parameter pairs (Reynolds 1e4 to 5e5, Schmidt 0.1 to 10) times 40 initial conditions built from tanh shear layers with sinusoidal perturbations. The publishers warn that this Hugging Face copy is v1.0, in which about 80 percent of validation and test trajectories duplicate training trajectories; a corrected v2.0 with disjoint initial conditions is available from Flatiron through the-well-download. Listing data/ (measured 2026-11-13) shows train/ (28 files, 376 GB, one per Reynolds-Schmidt pair), valid/ and test/ (28 files, 47.5 GB each); about 471 GB in the repository. Files are HDF5 in the common The Well format; open them with the_well package (WellDataModule with base path hf://datasets/polymathic-ai/) or directly with h5py. Part of The Well (Ohana et al., NeurIPS 2024 Datasets and Benchmarks, arXiv:2412.00568); released under CC-BY-4.0, cite The Well and the simulation's source papers.

## Load the data

```python
from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="polymathic-ai/shear_flow", filename="data/test/shear_flow_Reynolds_1e4_Schmidt_1e-1.hdf5", repo_type="dataset")
print(path)
```

## Data structure

File types in sampled files: HDF5

Example file: `data/test/shear_flow_Reynolds_1e4_Schmidt_1e-1.hdf5`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/5fbaecc3-72e6-5fe1-9260-593bb6da2402
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/5fbaecc3-72e6-5fe1-9260-593bb6da2402
- Over MCP: `get_schema_card` with id `5fbaecc3-72e6-5fe1-9260-593bb6da2402` at https://api.scigantic.com/mcp

## Related topics

- [HDF5 datasets](https://scigantic.com/topics/hdf5)
- [Physics datasets](https://scigantic.com/topics/physics)
