Crystallography Open Database (COD) Full Snapshot with CIF Text, Parquet

Provider
Crystallography Open Database (Grazulis et al.); snapshot by LMucko
License
CC0-1.0 (source)
Size
3 files
Format
Parquet (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/LMucko/crystallography-open-database)
Access
Free and public. No account with the data provider is needed.
Category
Chemistry & Materials
Source
https://doi.org/10.1107/S0021889809016690

About Crystallography Open Database (COD) Full Snapshot with CIF Text, Parquet

A complete snapshot of the Crystallography Open Database (COD), the open-access collection of experimentally determined crystal structures of organic, inorganic, metal-organic compounds and minerals, taken on 2026-07-06. The single file cod_full.parquet (zstd, about 30 GB, measured 2026-11-15) has 533,486 rows (on-hold entries excluded), one per COD entry, with 74 COD metadata columns and the raw CIF text in a cif_text column. Metadata cover unit cell parameters and their uncertainties, cell volume, measurement temperature and pressure, space group in Hermann-Mauguin and Hall notation and number, Z and Z', chemical, mineral and common names, sum and cell formulas, determination method, radiation and wavelength, and the bibliographic source (authors, title, journal, year, DOI). Query with DuckDB, polars or pandas and parse cif_text with pymatgen, ASE or gemmi. Used for crystal structure search, simulated powder XRD, structure-property datasets and training crystal generative and language models. All COD data are dedicated to the public domain under CC0; acknowledge the original authors of each structure and cite Grazulis et al., J. Appl. Cryst. 2009 and Nucleic Acids Res. 2012.

How to load this dataset in Python

from datasets import load_dataset
ds = load_dataset("LMucko/crystallography-open-database")
print(ds)

Data structure

File types in sampled files: Parquet

Files

Example file: cod_full.parquet

Analyze this dataset without downloading it

On Scigantic, Crystallography Open Database (COD) Full Snapshot with CIF Text, Parquet opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Chemistry & Materials datasets