Pythia 8 Quark and Gluon Jets (Komiske, Metodiev, Thaler), Parquet with Particle Transformer Features

Provider
Patrick Komiske, Eric Metodiev, Jesse Thaler (MIT); Parquet conversion by jet-universe
License
CC-BY-4.0 (source)
Size
12 files
Format
Parquet (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/jet-universe/quark_gluon)
Access
Free and public. No account with the data provider is needed.
DOI
10.5281/zenodo.3164691
Category
Physics
Source
https://arxiv.org/abs/1810.05165

About this dataset

Two million simulated quark and gluon jets for quark/gluon discrimination, the standard benchmark introduced with Energy Flow Networks (Komiske, Metodiev and Thaler, JHEP 2019) and used by ParticleNet and Particle Transformer. Jets come from Pythia 8.226 at sqrt(s)=14 TeV: quark jets from qg to Z+q and gluon jets from qqbar to Z+g with the Z decaying to neutrinos, clustered with FastJet anti-kT R=0.4 and selected at jet pT 500 to 550 GeV and |y|<1.7, with equal numbers of quark and gluon jets and no detector simulation. This copy, maintained by the jet-universe group behind JetClass, converts the original NumPy archives into Parquet with the Particle Transformer feature schema: per-jet pT, eta, phi, energy, mass and constituent count, and per-constituent px, py, pz, energy, delta-eta and delta-phi to the jet axis, PDG id, charge and particle-type flags (charged hadron, neutral hadron, photon, electron, muon). Splits are 1,799,982 training and 199,998 test jets in data/train-0000N-of-00009.parquet and data/test-00000-of-00001.parquet (about 3 GB); load with Hugging Face datasets, pandas or awkward. The upstream Zenodo record (10.5281/zenodo.3164691) is CC-BY-4.0; cite Komiske, Metodiev and Thaler, arXiv:1810.05165.

How to load this dataset in Python

from datasets import load_dataset
ds = load_dataset("jet-universe/quark_gluon")
print(ds)

Data structure

File types in sampled files: Parquet

Files

Example file: data/test-00000-of-00001.parquet

Analyze this dataset without downloading it

On Scigantic, Pythia 8 Quark and Gluon Jets (Komiske, Metodiev, Thaler), Parquet with Particle Transformer Features opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Physics datasets