CocoChorales: 240,000 Synthesized Four-Part Chorale Mixtures with Per-Instrument Stems, MIDI and Note Expression (Google Magenta)
- Provider
- Google Magenta (Yusong Wu, Josh Gardner, Ethan Manilow, Ian Simon, Curtis Hawthorne, Jesse Engel)
- License
- CC-BY-4.0 (source)
- Stored at
- Google Cloud Storage, gs://magentadata/datasets/cocochorales (us)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Speech & Audio
- Source
- https://arxiv.org/abs/2209.14458
About this dataset
CocoChorales is a music dataset of over 1,400 hours of audio mixtures of four-part chorales performed by 13 instruments, all synthesized with generative models. A trained Coconet model first generated four-part chorales in the style of J.S. Bach (stored as MIDI, with tempo and random note timing variations), then MIDI-DDSP, trained on the URMP dataset, rendered each part as audio. Ensembles are String (violin, violin, viola, cello), Brass (trumpet, French horn, trombone, tuba), Woodwind (flute, oboe, clarinet, bassoon) and Random (each soprano, alto, tenor and bass part drawn from a list of instruments). The dataset has 240,000 examples, 60,000 mixes per ensemble type, each with its own train/validation/test split; audio is 16 kHz 16-bit PCM. Every example contains the mixture, the source audio of all four instruments, per-source gain, MIDI, per-note expression annotations (volume, vibrato, brightness and others) and synthesis parameters (fundamental frequency f0, harmonic amplitudes, filtered noise) with the pitch augmentation applied. Because the data come from generative models, annotations match the audio exactly. The folder cocochorales_full_v1_zipped/ splits the zipped data into main_dataset/, metadata/, note_expression/, synthesis_parameters/ and f0/, with an MD5 list; about 2.9 TB compressed. Used for music source separation, automatic music transcription and multi-f0 estimation. License: CC BY 4.0. Cite Wu et al., The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modeling, arXiv:2209.14458.
How to access this dataset in Python
import gcsfs
fs = gcsfs.GCSFileSystem(token='anon')
fs.ls('magentadata/datasets/cocochorales/', detail=False)[:10]Lists the files with anonymous access. Runs on any machine, with no cloud account.
Data structure
Files
Example file: datasets/cocochorales/cocochorales_full_v1_zipped/f0/test/1.tar.bz2
Analyze this dataset without downloading it
On Scigantic, CocoChorales: 240,000 Synthesized Four-Part Chorale Mixtures with Per-Instrument Stems, MIDI and Note Expression (Google Magenta) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Speech & Audio datasets
- MInDS-14: multilingual spoken intent detection
- Nemotron Content Safety Audio Dataset
- Voxpopuli
- Groove MIDI Dataset (GMD): 13.6 Hours of Expressive Human Drumming as MIDI with Synthesized Audio (Google Magenta)
- Earnings-21: entity-dense earnings call ASR benchmark
- FLORAS: long-form speech recognition, translation and summarization benchmark
- EdAcc: Edinburgh International Accents of English Corpus
- Numb 3 Rs