SaProt 650M structure-aware protein language model weights

Provider
Westlake University (westlake-repl)
License
MIT (source)
Size
8 files
Format
JSON (in sampled files)
Stored at
Hugging Face (https://huggingface.co/westlake-repl/SaProt_650M_AF2)
Access
Free and public. No account with the data provider is needed.
Category
Biology
Source
https://openreview.net/forum?id=6MRm3G4NiU

About SaProt 650M structure-aware protein language model weights

Open weights for SaProt 650M, a structure-aware protein language model from Westlake University. Its vocabulary pairs each amino acid with a Foldseek 3Di structure token, so a protein is read as a sequence of residue plus local-structure tokens, and the model was pretrained on AlphaFold2-predicted structures. With structure tokens as input it outperforms sequence-only models on many fitness and function tasks; sequence-only input works but needs fine-tuning. The mounted repo holds SaProt_650M_AF2.pt (esm-style checkpoint), pytorch_model.bin with config.json and vocab.txt for transformers (EsmForMaskedLM), each about 2.6 GB. Pair it with the AlphaFold DB or PDB archives to build structure tokens next to the data. MIT licence.

How to load SaProt 650M structure-aware protein language model weights in Python

import os, json
base = "/mnt/archive"   # this model repo, mounted read-only
files = sorted(os.listdir(base)); print(files)
print(json.dumps(json.load(open(os.path.join(base, "config.json"))), indent=1)[:800])
print("SaProt_650M_AF2.pt", os.path.getsize(os.path.join(base, "SaProt_650M_AF2.pt")) // 2**20, "MB")

Written for a Scigantic notebook, where /mnt/archive is the mounted dataset.

Data structure

File types in sampled files: JSON

Files

Example file: SaProt_650M_AF2.pt

Analyze this dataset without downloading it

On Scigantic, SaProt 650M structure-aware protein language model weights opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Biology datasets