OPLM antibody sequences v2.0.0: AntiRef99 clustered training sets with CDR3 holdouts

Provider
Briney Lab, Scripps Research
License
CC-BY-4.0 (source)
Size
699 files
Format
Parquet (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/brineylab/oplm-antibody-sequences)
Access
Free and public. No account with the data provider is needed.
Category
Biology
Source
https://zenodo.org/records/7474336

About this dataset

Antibody language model training data from the Briney lab, built from AntiRef, its reference clustering of human antibody sequences. All 299,748,717 AntiRef99 sequences are grouped four ways, at 90, 92, 94 and 96 percent identity (antiref90 to antiref96 folders), with one row per cluster: the representative sequence and the member sequences inside it. Shards hold one million rows in a seeded global shuffle, so any subset is a uniform sample. Held-out files give evaluation and test sets of whole held-out clusters, plus a version 2.0.0 CDR3-identity holdout of 2,500 heavy chains each where no CDR3 in the holdout is within 85 percent identity of training data. Held-out rows carry locus and a per-residue CDR mask from IMGT numbering. Variable domains only, Parquet with zstd. CC BY 4.0.

How to load this dataset in Python

from datasets import load_dataset
ds = load_dataset("brineylab/oplm-antibody-sequences")
print(ds)

Data structure

File types in sampled files: Parquet

Files

Example file: antiref90/train/shard-00000.parquet

Analyze this dataset without downloading it

On Scigantic, OPLM antibody sequences v2.0.0: AntiRef99 clustered training sets with CDR3 holdouts opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Biology datasets