SciSciNet v1: Science of Science Data Lake of Papers with Citations, Funding, Patents and Media Links (Northwestern CSSI)

Provider
Northwestern University Center for Science of Science and Innovation (Lin, Yin, Liu, Wang et al.)
License
CC0-1.0 (source)
Size
29 files
Format
TSV (in sampled files)
Stored at
Hugging Face (https://huggingface.co/datasets/Northwestern-CSSI/sciscinet-v1)
Access
Free and public. No account with the data provider is needed.
DOI
10.6084/m9.figshare.c.6076908
Category
Open Data
Source
https://doi.org/10.1038/s41597-023-02198-9

About this dataset

SciSciNet is a large integrated data lake for science of science research, built by Northwestern University's Center for Science of Science and Innovation (CSSI). This is version 1, built on Microsoft Academic Graph, and its record is in Scientific Data 2023. It joins the scientific publications of Microsoft Academic Graph, with authors, affiliations, journals, conference series and fields, to the citation network (SciSciNet_PaperReferences, 34.8 GB). It also gives paper-level indicators in SciSciNet_PaperDetails, plus author gender inference and links to outside sources: NIH and NSF grants, US patents, clinical trials, Nobel laureates, news coverage (Newsfeed) and Twitter mentions. Economists and sociologists of science use it to study research productivity, team science, the impact of funding, the gender gap in citations and the flow from papers into patents and policy. There are 22 TSV tables (about 141 GB) with Word descriptors of the schema; read them with pandas, polars or DuckDB. Every table is deposited on figshare under CC0 by the authors (collection DOI 10.6084/m9.figshare.c.6076908). A newer, gated v2 built on OpenAlex is separate. Cite Lin et al., SciSciNet, Scientific Data 2023, doi 10.1038/s41597-023-02198-9.

How to load this dataset in Python

import pandas as pd
df = pd.read_csv("hf://datasets/Northwestern-CSSI/sciscinet-v1/SciSciNet_Affiliations.tsv", sep='\t')
df.head()

Data structure

File types in sampled files: TSV

Files

Example file: SciSciNet_Affiliations.tsv

Analyze this dataset without downloading it

On Scigantic, SciSciNet v1: Science of Science Data Lake of Papers with Citations, Funding, Patents and Media Links (Northwestern CSSI) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Open Data datasets