# ProstT5 Dataset: Paired Amino Acid and 3Di Structure Sequences

## Facts

- Provider: Heinzinger, Weissenow, Gomez Sanchez, Henkel, Steinegger and Rost (Rostlab, TUM; Seoul National University)
- License: CC-BY-4.0 (https://alphafold.ebi.ac.uk/download)
- Size: 135 files
- Format: Parquet (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/datasets/Rostlab/ProstT5Dataset
- Access: public, readable without an account
- DOI: https://doi.org/10.1093/nargab/lqae150
- Category: Structural Biology
- Source: https://doi.org/10.1093/nargab/lqae150
- Page: https://scigantic.com/archive/2a435277-d822-56bf-a4d2-c0dbe2fc1ee0
- Keywords: Structural Biology, protein structure, protein language model, Parquet, Hugging Face

## About

Training data for ProstT5, the bilingual protein language model that translates between amino acid sequence and Foldseek 3Di structure strings (Heinzinger et al., NAR Genomics and Bioinformatics 2024). Per the card, the set starts from the AlphaFold Protein Structure Database: 214 million UniProtKB sequences were clustered with MMseqs2 into 52 million clusters, Foldseek clustered these further into 18.8 million structural clusters, and quality filtering removed low-pLDDT, short and highly repetitive 3Di entries, leaving about 17 million training proteins plus 474 validation and 474 test representatives split by whole clusters. Rows are tokenized with the ProstT5 tokenizer: input_id_x holds 3Di tokens and input_id_y holds amino acid tokens, and the card gives the token-to-character mapping (amino acids 3 to 27, 3Di letters 128 to 147, special tokens for direction). Measured 2026-11-14: 133 parquet files under data/ (about 5.1 GB listed, repository storage about 25 GB). Load with datasets.load_dataset('Rostlab/ProstT5Dataset') or pyarrow. Useful for structure-aware protein language models, inverse folding style translation, remote homology search with 3Di, and comparing AlphaFold-predicted versus PDB structure statistics. The card states an MIT licence from Rostlab; the underlying AlphaFold DB structures are CC BY 4.0, which governs here. Cite ProstT5 and AlphaFold DB.

## Load the data

```python
from datasets import load_dataset
ds = load_dataset("Rostlab/ProstT5Dataset")
print(ds)
```

## Data structure

File types in sampled files: Parquet

Example file: `data/test-00000-of-00001-b109fa020c25190c.parquet`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/2a435277-d822-56bf-a4d2-c0dbe2fc1ee0
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/2a435277-d822-56bf-a4d2-c0dbe2fc1ee0
- Over MCP: `get_schema_card` with id `2a435277-d822-56bf-a4d2-c0dbe2fc1ee0` at https://api.scigantic.com/mcp

## Related topics

- [Parquet datasets](https://scigantic.com/topics/parquet)
- [Structural Biology datasets](https://scigantic.com/topics/structural-biology)
- [Protein structure datasets](https://scigantic.com/topics/protein-structure)
- [Protein language model datasets](https://scigantic.com/topics/protein-language-model)
