Pythia 8 Quark and Gluon Jets (Komiske, Metodiev, Thaler), Parquet with Particle Transformer Features
- Provider
- Patrick Komiske, Eric Metodiev, Jesse Thaler (MIT); Parquet conversion by jet-universe
- License
- CC-BY-4.0 (source)
- Size
- 12 files
- Format
- Parquet (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/jet-universe/quark_gluon)
- Access
- Free and public. No account with the data provider is needed.
- DOI
- 10.5281/zenodo.3164691
- Category
- Physics
- Source
- https://arxiv.org/abs/1810.05165
About this dataset
Two million simulated quark and gluon jets for quark/gluon discrimination, the standard benchmark introduced with Energy Flow Networks (Komiske, Metodiev and Thaler, JHEP 2019) and used by ParticleNet and Particle Transformer. Jets come from Pythia 8.226 at sqrt(s)=14 TeV: quark jets from qg to Z+q and gluon jets from qqbar to Z+g with the Z decaying to neutrinos, clustered with FastJet anti-kT R=0.4 and selected at jet pT 500 to 550 GeV and |y|<1.7, with equal numbers of quark and gluon jets and no detector simulation. This copy, maintained by the jet-universe group behind JetClass, converts the original NumPy archives into Parquet with the Particle Transformer feature schema: per-jet pT, eta, phi, energy, mass and constituent count, and per-constituent px, py, pz, energy, delta-eta and delta-phi to the jet axis, PDG id, charge and particle-type flags (charged hadron, neutral hadron, photon, electron, muon). Splits are 1,799,982 training and 199,998 test jets in data/train-0000N-of-00009.parquet and data/test-00000-of-00001.parquet (about 3 GB); load with Hugging Face datasets, pandas or awkward. The upstream Zenodo record (10.5281/zenodo.3164691) is CC-BY-4.0; cite Komiske, Metodiev and Thaler, arXiv:1810.05165.
How to load this dataset in Python
from datasets import load_dataset
ds = load_dataset("jet-universe/quark_gluon")
print(ds)Data structure
File types in sampled files: Parquet
Files
Example file: data/test-00000-of-00001.parquet
Analyze this dataset without downloading it
On Scigantic, Pythia 8 Quark and Gluon Jets (Komiske, Metodiev, Thaler), Parquet with Particle Transformer Features opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Physics datasets
- The Well: Rayleigh-Taylor Instability Turbulence (3D)
- The Well: Acoustic Scattering Across a Discontinuous Interface
- DeepMind Hamiltonian Dynamics Suite: 17 Simulated Physical Systems for Learning Latent Dynamics
- The Well: Acoustic Scattering with Random Inclusions
- TIDE Helical Forced Turbulence: 3D Incompressible Navier-Stokes DNS at 256^3 (Dai et al.)
- hls4ml LHC Jet Dataset (150 Particles): Five-Class Jet Tagging for FPGA Trigger Studies
- Quantum Physics 0.6
- ColliderML Release 1: Simulated HL-LHC Collision Events in the Open Data Detector