# PromoterZoo: 13.6 Million Multi-Species Promoter Sequences for Training the LOL-EVE Variant Effect Model (Harvard Marks Lab)

## Facts

- Provider: Marks Lab, Harvard Medical School
- License: MIT (https://huggingface.co/datasets/Marks-lab/PromoterZoo)
- Size: 13 files
- Format: Parquet, Arrow (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/datasets/Marks-lab/PromoterZoo
- Access: public, readable without an account
- Category: Genomics & Bioinformatics
- Source: https://huggingface.co/datasets/Marks-lab/PromoterZoo
- Page: https://scigantic.com/archive/74b31416-c2c6-5fc7-ab54-4ae1c287ddcb
- Keywords: Genomics & Bioinformatics, Parquet, Arrow, Hugging Face

## About

Training data for LOL-EVE (Language of Life, Evolutionary Variant Effects), a genomic language model from the Marks Lab at Harvard Medical School that scores the effect of indels and other variants in gene promoters. The dataset holds 13,611,373 promoter DNA sequences of 1,000 base pairs taken around transcription start sites (TSS) across many species grouped into evolutionary clades, giving the model evolutionary context for each gene's regulatory region. Each record has the sequence, gene symbol, species, clade, chromosome, strand, genomic start and stop, sequence length and direction (towards or away from the TSS), and both strands are included. Stored as one 6.4 GB data.parquet plus Arrow shards under dataset/, it loads with the datasets library or pandas and can be filtered by gene or species. Suited to pretraining DNA language models, comparative promoter analysis and cis-regulatory evolution studies. Released by the Marks Lab under the MIT License.

## Load the data

```python
from datasets import load_dataset
ds = load_dataset("Marks-lab/PromoterZoo")
print(ds)
```

## Data structure

File types in sampled files: Parquet, Arrow

Example file: `data.parquet`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/74b31416-c2c6-5fc7-ab54-4ae1c287ddcb
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/74b31416-c2c6-5fc7-ab54-4ae1c287ddcb
- Over MCP: `get_schema_card` with id `74b31416-c2c6-5fc7-ab54-4ae1c287ddcb` at https://api.scigantic.com/mcp

## Related topics

- [Parquet datasets](https://scigantic.com/topics/parquet)
- [Genomics & Bioinformatics datasets](https://scigantic.com/topics/genomics-and-bioinformatics)
