Pfam Seed Protein Domain Classification Splits (Random and Clustered) and Pfam-N2 Predictions (Google Research)
- Provider
- Google Research (Bileschi et al.)
- License
- CC0-1.0 (source)
- Stored at
- Google Cloud Storage, gs://brain-genomics-public/research/proteins/pfam (us)
- Access
- Free and public. No account with the data provider is needed.
- DOI
- 10.1038/s41587-021-01179-w
- Category
- Proteomics
- Source
- https://doi.org/10.1038/s41587-021-01179-w
About this dataset
Machine learning splits of the Pfam 32.0 seed alignments released with Bileschi et al., Using deep learning to annotate the protein universe (Nature Biotechnology, 2022; preprint title Can Deep Learning Classify the Protein Universe). The task is to predict which of about 18,000 Pfam families a protein domain sequence belongs to, from about 1 million training domains. Each record has the domain sequence, family_accession (the label, e.g. PF02953.15), family_id, sequence_name (UniProt accession with start and end) and the aligned_sequence from the seed multiple sequence alignment. Measured 2026-11-17: random_split/ has train/ (80 CSV shards), dev/ and test/; clustered_split/ holds a 258 MB tar.gz of a clustered train/dev/test split for harder out-of-distribution evaluation; pfam-n2/v35.0/ holds significant and insignificant domain-call tables (about 2 GB TSV each) with aligned Stockholm and unaligned FASTA archives; a models/ folder sits alongside. Load the CSVs with pandas. The folder's LICENSE and README state CC0 1.0; cite Bileschi et al. 2022.
How to access this dataset in Python
import gcsfs
fs = gcsfs.GCSFileSystem(token='anon')
fs.ls('brain-genomics-public/research/proteins/pfam/', detail=False)[:10]Lists the files with anonymous access. Runs on any machine, with no cloud account.
Data structure
Files
Example file: research/proteins/pfam/clustered_split/dev/data-00000-of-00010
Analyze this dataset without downloading it
On Scigantic, Pfam Seed Protein Domain Classification Splits (Random and Clustered) and Pfam-N2 Predictions (Google Research) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Proteomics datasets
- PRIDE Crosslinking Archive (XL-MS)
- TyrosineKinaseData
- Vanadium nitrogenase - anomalous maps for resting and turnover states
- Comparative proteomic and metabolomic analyses of plasma reveal the novel biomarker panels for thyroid dysfunction
- Early life exposure to environmental contaminants (BDE-47, TBBPA, and BPS) produced persistent gut dysbiosis in adult male mice
- Circadian ontogenetic metabolomics atlas: an interactive resource with insights from rat plasma, tissues, and feces
- A proteome-wide quantitative platform for nanoscale spatially resolved extraction of membrane proteins into native nanodiscs
- Patient-resolved multi-omic evidence separates ST14 abundance from therapeutic actionability in subsolid lung adenocarcinoma: code and derived data