# ARIES: Corpus of Scientific Paper Edits Made in Response to Peer Review Comments (OpenReview, Allen Institute for AI)

## Facts

- Provider: Allen Institute for AI (Mike D'Arcy et al.)
- License: ODC-By-1.0 (https://github.com/allenai/aries)
- Format: JSON Lines (in sampled files)
- Stored at: Amazon S3, s3://ai2-s2-research-public/aries (us-west-2)
- Access: public, readable without an account
- Category: Natural Language Processing
- Source: https://arxiv.org/abs/2306.12587
- Page: https://scigantic.com/archive/b6ba0116-84f0-57d0-b3ef-f67bdb47911d
- Keywords: Natural Language Processing, JSON Lines, AWS Open Data

## About

ARIES pairs peer review comments with the edits authors made to their papers in response, built from OpenReview submissions with an original and a revised PDF. Files: paper_edits.jsonl (paragraph-level edits between source and target versions, keyed by OpenReview PDF ids), review_comments.jsonl (review comments keyed by doc_id and comment_id), edit_labels_train/dev/test.jsonl (comment-to-edit alignment labels; train and dev are synthetic labels derived from author responses, test is manually annotated), alignment_human_eval.jsonl, review_replies.jsonl (reviews and author responses used to build the synthetic data), raw_split_ids.json, generated_edits.jsonl (GPT-generated edits for test comments, with annotations), gpt3_cache.sqlite, and s2orc.tar.gz with S2ORC full-text parses of the papers. Tasks: aligning review feedback to revisions and generating edits that address a reviewer comment, for research on scientific writing assistance and peer review. Load with any JSON-lines reader; code is in allenai/aries. License: ODC-BY 1.0. Cite D'Arcy, Ross, Bransom, Kuehl, Bragg, Hope and Downey, ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews, arXiv:2306.12587.

## Load the data

```python
import boto3
from botocore import UNSIGNED
from botocore.client import Config
s3 = boto3.client('s3', region_name='us-west-2', config=Config(signature_version=UNSIGNED))
s3.list_objects_v2(Bucket='ai2-s2-research-public', Prefix='aries/', Delimiter='/')
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

File types in sampled files: JSON Lines

Example file: `aries/LICENSE`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/b6ba0116-84f0-57d0-b3ef-f67bdb47911d
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/b6ba0116-84f0-57d0-b3ef-f67bdb47911d
- Over MCP: `get_schema_card` with id `b6ba0116-84f0-57d0-b3ef-f67bdb47911d` at https://api.scigantic.com/mcp

## Related topics

- [JSON Lines datasets](https://scigantic.com/topics/json-lines)
- [Natural Language Processing datasets](https://scigantic.com/topics/natural-language-processing)
