AMPLIFY 350M protein language model weights
- Provider
- Chandar Research Lab
- License
- MIT (source)
- Size
- 10 files
- Format
- JSON (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/chandar-lab/AMPLIFY_350M)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Biology
- Source
- https://www.biorxiv.org/content/10.1101/2024.09.23.614603v1
About AMPLIFY 350M protein language model weights
Open weights for AMPLIFY 350M, an efficient protein language model from Chandar Lab pretrained with masked language modelling on UR100P, a corpus combining UniRef100, the Observed Antibody Space (OAS) and SCOP. The model has 32 layers, a hidden size of 960 and 15 attention heads, supports sequences up to 2,048 residues, and produces residue and protein embeddings, suggests mutations and scores sequences. The mounted repo holds model.safetensors (1.4 GB), config.json, tokenizer files and the custom modelling code (amplify.py, rotary.py, rmsnorm.py), loaded with transformers and trust_remote_code from the mount path. MIT licence.
How to load AMPLIFY 350M protein language model weights in Python
import os, json
base = "/mnt/archive" # this model repo, mounted read-only
files = sorted(os.listdir(base)); print(files)
print(json.dumps(json.load(open(os.path.join(base, "config.json"))), indent=1)[:800])
import struct
with open(os.path.join(base, "model.safetensors"), "rb") as f:
hdr = json.loads(f.read(struct.unpack("<Q", f.read(8))[0]))
tensors = {k: v for k, v in hdr.items() if k != "__metadata__"}
print(len(tensors), "tensors, e.g.", list(tensors.items())[:3])
# To load them: pip install safetensors torch, then safetensors.torch.load_file(path)Written for a Scigantic notebook, where /mnt/archive is the mounted dataset.
Data structure
File types in sampled files: JSON
Files
Example file: model.safetensors
Analyze this dataset without downloading it
On Scigantic, AMPLIFY 350M protein language model weights opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Biology datasets
- Observed Antibody Space (OAS) paired heavy and light chains, 2023-09-09 snapshot
- DynaCLR: live-cell infection dynamics and single-cell tracks
- ChronoRoot 2.0 segmentation dataset: annotated infrared images of Arabidopsis and tomato seedlings
- ESM-2 650M protein language model weights (esm2_t33_650M_UR50D)
- An MGRS-based 4km grid for the FTW Benchmark Dataset
- PRISM Antibody Training Data: 66 Million Unpaired and 764k Paired Human Antibody Sequences from OAS with Germline Labels (Romero Lab, Duke)
- PDB seqres FASTA 2022-09-28 (AlphaFold 3 training set)
- RNAcentral clustered ncRNA 90% identity (AlphaFold 3 training set)