AMPLIFY 350M protein language model weights

Provider
Chandar Research Lab
License
MIT (source)
Size
10 files
Format
JSON (in sampled files)
Stored at
Hugging Face (https://huggingface.co/chandar-lab/AMPLIFY_350M)
Access
Free and public. No account with the data provider is needed.
Category
Biology
Source
https://www.biorxiv.org/content/10.1101/2024.09.23.614603v1

About AMPLIFY 350M protein language model weights

Open weights for AMPLIFY 350M, an efficient protein language model from Chandar Lab pretrained with masked language modelling on UR100P, a corpus combining UniRef100, the Observed Antibody Space (OAS) and SCOP. The model has 32 layers, a hidden size of 960 and 15 attention heads, supports sequences up to 2,048 residues, and produces residue and protein embeddings, suggests mutations and scores sequences. The mounted repo holds model.safetensors (1.4 GB), config.json, tokenizer files and the custom modelling code (amplify.py, rotary.py, rmsnorm.py), loaded with transformers and trust_remote_code from the mount path. MIT licence.

How to load AMPLIFY 350M protein language model weights in Python

import os, json
base = "/mnt/archive"   # this model repo, mounted read-only
files = sorted(os.listdir(base)); print(files)
print(json.dumps(json.load(open(os.path.join(base, "config.json"))), indent=1)[:800])
import struct
with open(os.path.join(base, "model.safetensors"), "rb") as f:
    hdr = json.loads(f.read(struct.unpack("<Q", f.read(8))[0]))
tensors = {k: v for k, v in hdr.items() if k != "__metadata__"}
print(len(tensors), "tensors, e.g.", list(tensors.items())[:3])
# To load them: pip install safetensors torch, then safetensors.torch.load_file(path)

Written for a Scigantic notebook, where /mnt/archive is the mounted dataset.

Data structure

File types in sampled files: JSON

Files

Example file: model.safetensors

Analyze this dataset without downloading it

On Scigantic, AMPLIFY 350M protein language model weights opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Biology datasets