# OLDI Seed: 6,193 English Wikipedia Sentences Translated into About 45 Low-Resource Languages (Open Language Data Initiative)

## Facts

- Provider: Open Language Data Initiative (OLDI); Meta NLLB team and contributors
- License: CC-BY-SA-4.0 (https://huggingface.co/datasets/openlanguagedata/oldi_seed)
- Size: 63 files
- Format: JSON Lines (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/datasets/openlanguagedata/oldi_seed
- Access: public, readable without an account
- Category: Natural Language Processing
- Source: https://aclanthology.org/2023.acl-long.154
- Page: https://scigantic.com/archive/423aacfb-740e-506d-a85c-1d720412bffa
- Keywords: Natural Language Processing, JSON Lines, Hugging Face

## About

OLDI Seed is a multi-way parallel corpus for starting machine translation in languages that lack training data. It has 6,193 sentences sampled from English Wikipedia, each translated into about 45 languages. Many are low-resource languages and scripts of Africa, Asia and the Americas, such as Acehnese in Arabic and Latin script, Moroccan and Egyptian Arabic, Bambara and Shan in Myanmar script. That gives about 576,000 sentence rows in total, one JSONL file per language and script under seed/, with per-language dataset cards and a bibliography of contributing papers. It updates the NLLB Seed data released with No Language Left Behind (Maillard et al., Small Data, Big Impact, ACL 2023). Linguists and MT researchers use it as aligned text in many languages for building translation models, studying cross-lingual transfer and documenting written varieties. Load it with Hugging Face datasets by language config. Because the source is Wikipedia, the data stays under CC BY-SA 4.0, managed by the Open Language Data Initiative. Cite the papers in bibliography.bib.

## Load the data

```python
from datasets import load_dataset
ds = load_dataset("openlanguagedata/oldi_seed")
print(ds)
```

## Data structure

File types in sampled files: JSON Lines

Example file: `seed/ace_Arab.jsonl`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/423aacfb-740e-506d-a85c-1d720412bffa
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/423aacfb-740e-506d-a85c-1d720412bffa
- Over MCP: `get_schema_card` with id `423aacfb-740e-506d-a85c-1d720412bffa` at https://api.scigantic.com/mcp

## Related topics

- [JSON Lines datasets](https://scigantic.com/topics/json-lines)
- [Natural Language Processing datasets](https://scigantic.com/topics/natural-language-processing)
