Habermas Machine Dataset: Human Deliberation Opinions, Group Statements and Preference Rankings from AI-Mediated Deliberation (Google DeepMind, Science 2024)

Provider
Google DeepMind (Michael Henry Tessler, Michiel A. Bakker, Christopher Summerfield et al.)
License
CC-BY-4.0 (source)
Format
Parquet (in sampled files)
Stored at
Google Cloud Storage, gs://habermas_machine/datasets (us)
Access
Free and public. No account with the data provider is needed.
Category
Machine Learning & AI
Source
https://www.science.org/doi/10.1126/science.adq2852

About this dataset

Data from experiments in which an AI mediator, the Habermas Machine, helped small groups of people find common ground on social and political questions, reported in Science 2024. Participants (N = 5,734 in the study) wrote personal opinions on a question, the system generated candidate group statements, participants ranked and critiqued them, and the statement was refined over rounds; AI-generated statements were compared with ones written by human mediators, and the findings were replicated in a virtual citizens' assembly with a demographically representative UK sample. The datasets/ folder holds five Parquet tables (about 450 MB): hm_all_candidate_comparisons (pairwise comparisons of candidate statements), hm_all_final_preference_rankings, hm_all_position_statement_ratings (participants' agreement with statements), hm_all_question_importances_ratings and hm_all_round_survey_responses (per-round survey answers). Read with pandas.read_parquet. Used to study opinion change, consensus formation and deliberative democracy, and to train and evaluate reward models and statement generators for collective decision making. License: CC BY 4.0 for the materials (Google DeepMind). Cite Tessler, Bakker et al., AI can help humans find common ground in democratic deliberation, Science 2024 (doi 10.1126/science.adq2852).

How to access this dataset in Python

import gcsfs
fs = gcsfs.GCSFileSystem(token='anon')
fs.ls('habermas_machine/datasets/', detail=False)[:10]

Lists the files with anonymous access. Runs on any machine, with no cloud account.

Data structure

File types in sampled files: Parquet

Files

Example file: datasets/

Analyze this dataset without downloading it

On Scigantic, Habermas Machine Dataset: Human Deliberation Opinions, Group Statements and Preference Rankings from AI-Mediated Deliberation (Google DeepMind, Science 2024) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Machine Learning & AI datasets