# CVSS: Multilingual Speech-to-Speech Translation Corpus, 21 Languages into English (CVSS-C and CVSS-T, Google Research)

## Facts

- Provider: Google Research (Ye Jia, Michelle Tadmor Ramanovich, Quan Wang, Heiga Zen)
- License: CC-BY-4.0 (https://github.com/google-research-datasets/cvss)
- Stored at: Google Cloud Storage, gs://cvss (us)
- Access: public, readable without an account
- Category: Speech & Audio
- Source: https://arxiv.org/abs/2201.03713
- Page: https://scigantic.com/archive/de6658f6-fe58-5bd3-9337-bab18d5d31ac
- Keywords: Speech & Audio, text-to-speech, Google Cloud Storage

## About

CVSS is a sentence-level speech-to-speech translation (S2ST) corpus pairing speech in 21 source languages with spoken English translations. It is derived from the Mozilla Common Voice speech corpus (release version 4) and the CoVoST 2 speech-to-text translation corpus: the English translation text of CoVoST 2 was synthesized into speech by text-to-speech. Two versions are provided. CVSS-C (cvss_c_v1.0/) has all target speech in a single canonical speaker's voice; CVSS-T (cvss_t_v1.0/) transfers the voice of each source speaker to the translation, for voice-preserving translation. Each version has about 1,900 hours of speech together with the Common Voice source audio. Source languages: Arabic, Catalan, Welsh, German, Estonian, Spanish, Persian, French, Indonesian, Italian, Japanese, Latvian, Mongolian, Dutch, Portuguese, Russian, Slovenian, Swedish, Tamil, Turkish and Chinese. Each per-language tar.gz (for example cvss_c_de_en_v1.0.tar.gz) holds train, dev and test folders of translation audio clips and train/dev/test.tsv files with normalized translation text (numbers, currencies and acronyms written as spoken). Clips are paired with Common Voice v4 source audio by file name. Used to train and evaluate direct speech translation models such as Translatotron. License: CC BY 4.0. Cite Jia et al., CVSS Corpus and Massively Multilingual Speech-to-Speech Translation, LREC 2022 (arXiv:2201.03713).

## Load the data

```python
import gcsfs
fs = gcsfs.GCSFileSystem(token='anon')
fs.ls('cvss/', detail=False)[:10]
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

Example file: `cvss_c_v1.0/cvss_c_ar_en_v1.0.tar.gz`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/de6658f6-fe58-5bd3-9337-bab18d5d31ac
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/de6658f6-fe58-5bd3-9337-bab18d5d31ac
- Over MCP: `get_schema_card` with id `de6658f6-fe58-5bd3-9337-bab18d5d31ac` at https://api.scigantic.com/mcp

## Related topics

- [Speech & Audio datasets](https://scigantic.com/topics/speech-and-audio)
- [Text-to-speech datasets](https://scigantic.com/topics/text-to-speech)
