The Well: Turbulence with Gravity and Radiative Cooling in the Interstellar Medium
- Provider
- Polymathic AI (The Well); Keiya Hirashima, University of Tokyo and Flatiron Institute CCA
- License
- CC-BY-4.0 (source)
- Size
- 90 files
- Format
- HDF5 (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/polymathic-ai/turbulence_gravity_cooling)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Physics
- Source
- https://arxiv.org/abs/2412.00568
About this dataset
3D simulations of a turbulent, self-gravitating fluid modelling the interstellar medium (ISM) of galaxies at different evolutionary stages, where dense filaments form that go on to make stars. The hydrodynamics with gravity and radiative heating and cooling is solved with ASURA-FDPS smoothed particle hydrodynamics (SPH) and gridded to 64 by 64 by 64 cubes over 50 time steps, spanning one free-fall time. Fields are pressure, density, temperature and velocity. The datasheet lists 2,700 trajectories: 27 parameter sets (initial temperature 10, 100 or 1000 K; hydrogen number density 44.5, 4.45 or 0.445 per cc; metallicity Z0, 0.1 Z0 or 0) times 100 runs, with open boundaries. Listing data/ (measured 2026-11-13) shows train/ (27 files, 680 GB, one 25.2 GB file per parameter set), valid/ and test/ (27 files, 85.8 GB each); about 852 GB in the repository. Files are HDF5 in the common The Well format; open them with the_well package (WellDataModule with base path hf://datasets/polymathic-ai/) or directly with h5py. Part of The Well (Ohana et al., NeurIPS 2024 Datasets and Benchmarks, arXiv:2412.00568); released under CC-BY-4.0, cite The Well and the simulation's source papers.
How to load this dataset in Python
from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="polymathic-ai/turbulence_gravity_cooling", filename="data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_10.hdf5", repo_type="dataset")
print(path)Data structure
File types in sampled files: HDF5
Files
Example file: data/test/turbulence_gravity_cooling_rho0_0.445_Z_0.1_T0_10.hdf5
Analyze this dataset without downloading it
On Scigantic, The Well: Turbulence with Gravity and Radiative Cooling in the Interstellar Medium opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Physics datasets
- PDEBench 1D Burgers' Equation Solutions
- The Well: Compressible MHD Turbulence (64 Cubed)
- Kolmogorov Flow at Re ~10^4, Lyapunov-Calibrated Trajectories for Probabilistic Neural PDE Forecasting (JAX-CFD)
- Sonkyo Benchmark Wind Turbine Blade Vibration under Varying Temperature: Shaker Tests with Added Masses and Cut Cracks, -15 to +20 C (derived copy)
- HiLiftAeroML: Wall-Modeled LES of the NASA CRM High-Lift Aircraft for AI Surrogates
- Quantum Physics Corpus Rebel Ready
- NeuralConvection 3D: Boussinesq-to-Compressible Natural Convection in a Cube for Fourier Neural Operators (Menglik, Shao, Hyde)
- TIDE Strongly Rotating Turbulence (Coriolis Force): 3D Incompressible Navier-Stokes DNS at 256^3 (Dai et al.)