# S2AND: Author Name Disambiguation Benchmark, Eight Bibliographic Datasets plus Semantic Scholar Production Models (Allen Institute for AI)

## Facts

- Provider: Allen Institute for AI, Semantic Scholar (Shivashankar Subramanian, Daniel King, Doug Downey, Sergey Feldman)
- License: ODC-By-1.0 (https://github.com/allenai/S2AND)
- Format: JSON (in sampled files)
- Stored at: Amazon S3, s3://ai2-s2-research-public/s2and-release (us-west-2)
- Access: public, readable without an account
- Category: Natural Language Processing
- Source: https://api.semanticscholar.org/CorpusID:232233421
- Page: https://scigantic.com/archive/92bf782d-3325-5651-af54-11778a66eaf8
- Keywords: Natural Language Processing, benchmark, JSON, AWS Open Data

## About

S2AND is a benchmark for author name disambiguation (AND): deciding which author mentions (signatures) on scholarly papers belong to the same real person. It unifies eight existing labeled AND datasets into one format, each in its own folder: aminer, arnetminer, inspire, kisti, medline, pubmed, qian and zbmath, each with signatures, papers and gold cluster files, organized into name blocks (for example all 'j smith' signatures). The release also holds full_union_seed_1-5 training pickles, name_counts.pickle (first and last name frequency counts), a fastText language-ID model (lid.176.bin), Semantic Scholar production clustering models (production_model_v1.0 to v1.2), and s2and_and_big_blocks_linker_dataset_20260513/. A newer Arrow layout is at s2and-release-arrow/ in the same bucket. Load with the s2and Python package (ANDData). Some affiliation data comes from the Microsoft Academic Graph. Used for bibliometrics, scholarly knowledge graphs and entity resolution research. License: dataset under ODC-BY. Cite Subramanian, King, Downey and Feldman, S2AND: A Benchmark and Evaluation System for Author Name Disambiguation, JCDL 2021.

## Load the data

```python
import boto3
from botocore import UNSIGNED
from botocore.client import Config
s3 = boto3.client('s3', region_name='us-west-2', config=Config(signature_version=UNSIGNED))
s3.list_objects_v2(Bucket='ai2-s2-research-public', Prefix='s2and-release/', Delimiter='/')
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

File types in sampled files: JSON

Example file: `s2and-release/.feature_cache/aminer/51/all_features.json`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/92bf782d-3325-5651-af54-11778a66eaf8
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/92bf782d-3325-5651-af54-11778a66eaf8
- Over MCP: `get_schema_card` with id `92bf782d-3325-5651-af54-11778a66eaf8` at https://api.scigantic.com/mcp

## Related topics

- [JSON datasets](https://scigantic.com/topics/json)
- [Benchmark datasets](https://scigantic.com/topics/benchmark)
- [Natural Language Processing datasets](https://scigantic.com/topics/natural-language-processing)
