# AMPLIFY 350M protein language model weights

## Facts

- Provider: Chandar Research Lab
- License: MIT (https://github.com/chandar-lab/AMPLIFY/blob/main/LICENSE)
- Size: 10 files
- Format: JSON (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/chandar-lab/AMPLIFY_350M
- Access: public, readable without an account
- Category: Biology
- Source: https://www.biorxiv.org/content/10.1101/2024.09.23.614603v1
- Page: https://scigantic.com/archive/432da359-0ac7-50b4-abf8-e1efd422b7f3
- Keywords: Biology, protein language model, JSON, Hugging Face

## About

Open weights for AMPLIFY 350M, an efficient protein language model from Chandar Lab pretrained with masked language modelling on UR100P, a corpus combining UniRef100, the Observed Antibody Space (OAS) and SCOP. The model has 32 layers, a hidden size of 960 and 15 attention heads, supports sequences up to 2,048 residues, and produces residue and protein embeddings, suggests mutations and scores sequences. The mounted repo holds model.safetensors (1.4 GB), config.json, tokenizer files and the custom modelling code (amplify.py, rotary.py, rmsnorm.py), loaded with transformers and trust_remote_code from the mount path. MIT licence.

## Load the data

```python
import os, json
base = "/mnt/archive"   # this model repo, mounted read-only
files = sorted(os.listdir(base)); print(files)
print(json.dumps(json.load(open(os.path.join(base, "config.json"))), indent=1)[:800])
import struct
with open(os.path.join(base, "model.safetensors"), "rb") as f:
    hdr = json.loads(f.read(struct.unpack("<Q", f.read(8))[0]))
tensors = {k: v for k, v in hdr.items() if k != "__metadata__"}
print(len(tensors), "tensors, e.g.", list(tensors.items())[:3])
# To load them: pip install safetensors torch, then safetensors.torch.load_file(path)
```

Written for a Scigantic notebook, where /mnt/archive (SCIGANTIC_MOUNT_PATH) is the mounted dataset.

## Data structure

File types in sampled files: JSON

Example file: `model.safetensors`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/432da359-0ac7-50b4-abf8-e1efd422b7f3
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/432da359-0ac7-50b4-abf8-e1efd422b7f3
- Over MCP: `get_schema_card` with id `432da359-0ac7-50b4-abf8-e1efd422b7f3` at https://api.scigantic.com/mcp

## Related topics

- [JSON datasets](https://scigantic.com/topics/json)
- [Biology datasets](https://scigantic.com/topics/biology)
- [Protein language model datasets](https://scigantic.com/topics/protein-language-model)
