# Materials Project Dielectric Tensors (2024-11-14 Release)

## Facts

- Provider: Materials Project, Lawrence Berkeley National Laboratory
- License: CC-BY-4.0 (https://next-gen.materialsproject.org/about/terms)
- Format: JSON Lines (in sampled files)
- Stored at: Amazon S3, s3://materialsproject-build/collections/2024-11-14/dielectric (us-east-1)
- Access: public, readable without an account
- Category: Chemistry & Materials
- Source: https://doi.org/10.1063/1.4812323
- Page: https://scigantic.com/archive/055c351d-1ec6-581b-a323-71bffa4c72d1
- Keywords: Chemistry & Materials, DFT, JSON Lines, AWS Open Data

## About

The Materials Project dielectric collection from release 2024-11-14: electronic (high-frequency) and ionic contributions to the static dielectric tensor and refractive index from density functional perturbation theory in VASP (PBE with PAW), for 7,330 materials according to the release manifest. Documents are gzip-compressed JSON Lines partitioned by nelements=1 to 6, with manifest.parquet listing material ids and paths. Used to screen high-k gate dielectrics and optical materials and as the source of the Matbench dielectric task (refractive index). Read anonymously with the AWS CLI (--no-sign-request), boto3 or the mp-api client, which uses these buckets internally; Materials Project releases its data under CC-BY-4.0 (GNoME-derived entries in other collections are CC-BY-NC and are not part of this folder). Cite Jain et al., APL Materials 1, 011002 (2013).

## Load the data

```python
import os
import pyarrow.parquet as pq
pf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'manifest.parquet'))
print(pf.metadata)
df = pf.read_row_group(0).to_pandas()
df.head()
```

Run in a Scigantic notebook on 2026-11-17 against `manifest.parquet`: Parquet 7,330 rows, 6 columns, 1 row groups; columns ['material_id:string', 'last_updated:timestamp[ns]', 'nelements:int64', 'symmetry_number:int64', 'sourced_from_path:string', '__index_level_0__:int64'].

From any machine:

```python
import boto3
from botocore import UNSIGNED
from botocore.client import Config
s3 = boto3.client('s3', region_name='us-east-1', config=Config(signature_version=UNSIGNED))
s3.list_objects_v2(Bucket='materialsproject-build', Prefix='collections/2024-11-14/dielectric/', Delimiter='/')
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

File types in sampled files: JSON Lines

Example file: `collections/2024-11-14/dielectric/nelements=1/symmetry_number=138.jsonl.gz`

Path pattern: `{prefix}/{YYYY-MM-DD}/{seg2}/{seg3}/{filename}`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/055c351d-1ec6-581b-a323-71bffa4c72d1
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/055c351d-1ec6-581b-a323-71bffa4c72d1
- Over MCP: `get_schema_card` with id `055c351d-1ec6-581b-a323-71bffa4c72d1` at https://api.scigantic.com/mcp

## Related topics

- [Chemistry & Materials datasets](https://scigantic.com/topics/chemistry-and-materials)
- [DFT datasets](https://scigantic.com/topics/dft)
- [JSON Lines datasets](https://scigantic.com/topics/json-lines)
