SciganticTopicsExplore

Machine Learning & AI datasets

147 public Machine Learning & AI datasets in the Scigantic catalog, from providers including NVIDIA, Amazon and Meta AI. 145 can be read without an account, and 89 carry an open license (19 are non-commercial or no-derivatives). Common formats: Parquet, JSON Lines and JSON. 8 have loading code that was run against a real file. Each opens in a hosted Jupyter notebook with the data mounted, so nothing has to be downloaded first.

DatasetProviderLicenseAccess
BodyM Dataset
PNGloading code checked
AmazonCreative Commons Attribution-Non Commercial 4.0…public
Humor Detection from Product Question Answering Systems
CSVloading code checked
Amazon[CDLA-Sharing](https://cdla.io/sharing-1-0/)public
NAIP data embedded with Clay v1.5
Parquetloading code checked
clay via Source CooperativeCC-BY-4.0public
Trazo Field Boundary Annotations
TIFFloading code checked
wri-data-lab via Source CooperativeCC-BY-4.0public
Clay Model v0 Embeddings
loading code checked
brunosan via Source Cooperativenot statedpublic
Clay v1 Embeddings for California NAIP
Parquetloading code checked
clay via Source Cooperativenot statedpublic
KITTI Vision Benchmark Suite
JPEGloading code checked
Max Planck Campus TübingenCreative Commons Attribution-NonCommercial-Share… non-commercial or no-derivativespublic
Sentinel 2 Embeddings
Parquetloading code checked
earthgenome via Source Cooperativenot statedpublic
AI2 Reasoning Challenge (ARC) 2018
Allen Institute for AI[CC BY-SA](https://creativecommons.org/licenses/…public
AI2 Tablestore (November 2015 Snapshot)
Allen Institute for AI[CC BY-SA](https://creativecommons.org/licenses/…public
AI2 TabMCQ: Multiple Choice Questions aligned with the Aristo Tablestore
Allen Institute for AI[CC BY-SA](https://creativecommons.org/licenses/…public
Airborne Object Tracking Dataset
CSVJSON
AmazonCommunity Data License Agreement – Permissive…public
Amazon Seller Contact Intent Sequence
CSV
Amazonhttps://cdla.dev/permissive-1-0/public
Amazon-PQA
JSON
Amazonhttps://cdla.dev/permissive-1-0/public
Answer Reformulation
CSV
Amazon[cc-by-sa 4.0](https://creativecommons.org/licen…public
Anthropic Economic Index
CSV
Anthropic Economic ResearchCC-BY-4.0public
Aristo Tuple KB
Allen Institute for AI[CC BY-SA](https://creativecommons.org/licenses/…public
arXiv Metadata Snapshot (weekly mirror of the Cornell arXiv OAI dataset)
Parquet
Cornell University arXiv; mirrored by Hugging Face librarianCC0-1.0public
Automatic Speech Recognition (ASR) Error Robustness
AmazonSee https://github.com/anjiefang/asr-error-robus…public
ChessBench: 10 Million Chess Games with Stockfish 16 Action-Value, State-Value and Best-Move Annotations (Google DeepMind)
Google DeepMind (Anian Ruoss, Gregoire Deletang et al.)CC-BY-4.0public
CLIP Embeddings of 562,842 Library of Congress Historical Map Sheets (Sanborn maps, atlases, city views)
JSON
Library of Congress Computing Cultural Heritage (Huang and LCC-BY-4.0public
COCO - Common Objects in Context - fast.ai datasets
fast.aiCreative Commons http://cocodataset.org/#termsof…public
CoTracker 3 Kubric
Meta AIapache-2.0public
CSU Synthetic Attribution Benchmark for Explainable AI in Geoscience
JSON
Mamalakis, Ebert-Uphoff and Barnes (Colorado State UniversitCC-BY-4.0public
Daring Anteater
JSON Lines
NVIDIAcc-by-4.0public
Deutsche Bahn Train Delay and Cancellation Data
Parquet
Deutsche Bahn (source data); collected by piebroCC-BY-4.0public
DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue
JSON
Amazon[CDLA-Sharing](https://cdla.io/sharing-1-0/)public
DigiData
JSON Lines
Meta AIcc-by-4.0public
DiTEC-WDN: Large-Scale Water Distribution Network Simulation Dataset
Parquet
DiTEC project, University of Groningen data science group (rCC-BY-4.0public
Enriched Topical-Chat Dataset for Knowledge-Grounded Dialogue Systems
JSON
Amazon[CDLA-Sharing](https://cdla.io/sharing-1-0/)public
EOTA-OCR
Parquet
govscape via Source CooperativeCC0-1.0public
Fashion-MNIST
Parquet
Zalando Research (Han Xiao, Kashif Rasul, Roland Vollgraf)MITpublic
FreshRetailNet-50K: Fresh Retail Demand with Stockout Annotations
Parquet
Dingdong Inc.CC-BY-4.0public
Google Cloud AI/ML Sample Datasets
Google CloudApache 2.0public
Habermas Machine Dataset: Human Deliberation Opinions, Group Statements and Preference Rankings from AI-Mediated Deliberation (Google DeepMind, Science 2024)
Parquet
Google DeepMind (Michael Henry Tessler, Michiel A. Bakker, CCC-BY-4.0public
HelpSteer
PNGJSON Lines
NVIDIAcc-by-4.0public
HelpSteer 2
JSON Lines
NVIDIAcc-by-4.0public
HelpSteer 3
JSON Lines
NVIDIAcc-by-4.0public
Judges Verdict
JSON
NVIDIAcc-by-sa-4.0public
Kimodo Motion Gen Benchmark
JSON
NVIDIAcc-by-4.0public
Learning to Rank and Filter - community question answering
CSV
Amazon[CDLA-Permissive](https://cdla.dev/permissive-1-…public
LGND Embeddings
PNG
clay via Source CooperativeCC-BY-4.0public
Lichess Chess Position Evaluations (Stockfish)
Parquet
Lichess (lichess.org)CC0-1.0public
Lichess Chess Puzzles Database
Parquet
Lichess (lichess.org)CC0-1.0public
Lichess Rated Standard Chess Games Database
Parquet
Lichess (lichess.org)CC0-1.0public
Llamafirewall Alignmentcheck Evals
JSON
Meta AImitpublic
Los Alamos National Laboratory Cyber-Security Event Datasets (2015 and 2017)
Los Alamos National Laboratory (Alexander D. Kent and othersCC0-1.0public
Milling Tool Wear Time Series across Three Machine Tools (Flank Wear VB, Forces, Spindle Torque)
Parquet
Stiehl et al. (original); Parquet conversion by alpha-by-betCC-BY-4.0public
Monash Time Series Forecasting Repository
Rakshitha Godahewa, Christoph Bergmeir, Geoffrey Webb, Rob HCC-BY-4.0public
Multiview Extended Video with Activities (MEVA)
Kitwarehttp://mevadata.org/resources/MEVA-data-license.…public
Nemotron Agentic V 1
JSON Lines
NVIDIAcc-by-4.0public
Nemotron Cascade RL RLHF
Parquet
NVIDIAcc-by-4.0public
Nemotron Cascade RM Training
JSON Lines
NVIDIAcc-by-4.0public
Nemotron Personas Brazil
Parquet
NVIDIAcc-by-4.0public
Nemotron Personas Singapore
ParquetPNG
NVIDIAcc-by-4.0public
Nemotron Personas USA
Parquet
NVIDIAcc-by-4.0public
Nemotron RL Agent Calendar Scheduling
JSON Lines
NVIDIAcc-by-4.0public
Nemotron RL Agent Workplace Assistant
JSON Lines
NVIDIAcc-by-4.0public
Nemotron RL Agentic Conversational Tool Use Pivot V 1
JSON Lines
NVIDIAcc-by-4.0public
Nemotron RL Agentic Function Calling Pivot V 1
JSON Lines
NVIDIAcc-by-4.0public
Nemotron RL Bixbench Hypothesis
TSVCSV
NVIDIAcc-by-4.0public
Nemotron RL Identity Following V 1
JSON Lines
NVIDIAcc-by-4.0public
Nemotron SFT Agentic V 2
JSON Lines
NVIDIAcc-by-4.0public
Nemotron SFT OpenCode V 1
JSON Lines
NVIDIAcc-by-4.0public
NeuralGCM Pre-trained Model Checkpoints (v1)
Google Research (NeuralGCM team)CC-BY-SA-4.0public
OGB ogbg-code2: Code Summarization as Graph Prediction (Open Graph Benchmark)
JSON Lines
Open Graph Benchmark team (Hu et al., Stanford)MITpublic
OGB ogbg-ppa: Protein Association Graph Classification (Open Graph Benchmark)
JSON Lines
Open Graph Benchmark team (Hu et al., Stanford)CC0-1.0public
Open Food Facts Images
JPEGJSON
Open Food FactsAll data contained in this dataset is licenced…public
OpenScience
JSON Lines
NVIDIAcc-by-4.0public
OpenScienceReasoning 2
Parquet
NVIDIAcc-by-4.0public
PD12M
JPEG
Spawninghttps://cdla.dev/permissive-2-0/public
Pre- and post-purchase product questions
CSV
Amazon[Apache-2.0](https://www.apache.org/licenses/LIC…public
Product Comparison Dataset for Online Shopping
TSV
Amazon[CC-BY-SA 4.0](https://creativecommons.org/licen…public
Retrieval Synthetic NVDocs V 1
ParquetJSON
NVIDIAcc-by-4.0public
RxR (Room-Across-Room): Multilingual Vision-and-Language Navigation Instructions in English, Hindi and Telugu with Pose Traces for Matterport3D (Google Research)
NumPy
Google Research (Ku, Anderson, Patel, Ie, Baldridge)CC-BY-4.0public
Sft Datablend V 1
JSON Lines
NVIDIAcc-by-4.0public
Sophos/ReversingLabs 20 Million malware detection dataset
Sophos AISee the [Terms of Use](https://github.com/sophos…public
Surya Bench
NetCDF
NASA IMPACTCreative Commons Attribution 4.0 International.public
TechQA RAG Eval
JSON
NVIDIAapache-2.0public
The Massively Multilingual Image Dataset (MMID)
Penn NLPSee citation instructions at…public
TSBench
JSONNumPy
Amazon Web Services[CC BY](https://creativecommons.org/licenses/by/…public
TwitterFollowGraph: Temporal User-Author Follow Graph
Twitter Cortex (El-Kishky et al.)CC-BY-4.0public
VoiSeR
JSON
Amazon[cc-by-sa 4.0](https://creativecommons.org/licen…public
When 2 Call
JSON Lines
NVIDIAcc-by-4.0public
Wind AI Bench
HDF5
National Laboratory of the RockiesCreative Commons Attribution 4.0 United States…public
Wind AI Bench
HDF5
National Laboratory of the RockiesCreative Commons Attribution 4.0 United States…public
Wind AI Bench
HDF5
National Laboratory of the RockiesCreative Commons Attribution 4.0 United States…public
Wizard of Tasks
JSON
Amazon[cc-by-sa 4.0](https://creativecommons.org/licen…public
Y NQ
CSV
Meta AIapache-2.0public
ZEST: ZEroShot learning from Task descriptions
Allen Institute for AI[CC BY](https://creativecommons.org/licenses/by/…public
MNIST Handwritten Digits
Yann LeCun, Corinna Cortes, Christopher J.C. BurgesCC BY-SA 3.0public
AbstentionBench
JSONCSV
Meta AIcc-by-nc-4.0 non-commercial or no-derivativespublic
AEF-v1 embeddings Rasteret Collection
Parquet
terrafloww via Source Cooperativenot statedpublic
AlphaEarth Foundations GeoZarr Mosaic
JSON
tge-labs via Source Cooperativenot statedpublic
AlphaEarth Foundations Satellite Embedding Dataset - ZARR
firststreet via Source Cooperativenot statedpublic
Amazon Berkeley Objects Dataset
CSV
AmazonCreative Commons Attribution-NonCommercial 4.0… non-commercial or no-derivativespublic
Amazon Bin Image Dataset
JPEG
AmazonCreative Commons Attribution-NonCommercial-Share… non-commercial or no-derivativespublic
Astrophysics Division Galaxy Segmentation Benchmark Dataset
FITS
NASAThere are no restrictions on the use of this…public
CIMemories
JSONCSV
Meta AIcc-by-nc-4.0 non-commercial or no-derivativespublic
Community coral reef image classification training data
PNG
MERMAID[Creative Commons Attribution-NonCommercial-Shar… non-commercial or no-derivativespublic
Consented Activities of People
Visym LabsCustom (see documentation)public
DigitalCorpora
Simson GarfinkelThere are no restrictions on the use of this…public
Earth Index Embeddings
Parquet
earthgenome via Source Cooperativenot statedpublic
Embeddings
Parquet
geovibes via Source Cooperativenot statedpublic
ESA WorldCover 2021
major-tom via Source Cooperativenot statedpublic
Essential-Web v1.0: 24T tokens of organized web data
Parquet
EssentialAICustom (see documentation)public
FACTORY
JSON Lines
Meta AIcc-by-nc-4.0 non-commercial or no-derivativespublic
FashionLocalTriplets
JPEG
AmazonCreative Commons Non-Commercial 4.0 non-commercial or no-derivativespublic
FTW Foundation Model Features
mvrl via Source Cooperativenot statedpublic
FTW Inference Inputs
TIFF
ftw via Source Cooperativenot statedpublic
FTW Inference output
TIFFJSON
ftw via Source Cooperativenot statedpublic
Google Satellite Embeddings v1
Parquet
cr458 via Source Cooperativenot statedpublic
Humor patterns used for querying Alexa traffic
JSON
AmazonCDLA-Sharing licensepublic
Image classification - fast.ai datasets
fast.aiVaries by dataset - see documentation linkpublic
Image localization - fast.ai datasets
fast.aiVaries by dataset - see documentation linkpublic
LAFC-Evict: counterfactual labels for learning-augmented cache eviction
Soroush VahidiMixed per trace family (see LICENSE): wiki2018…public
LCFO
Parquet
Meta AIcc-by-nc-4.0 non-commercial or no-derivativespublic
Major TOM Elliot-Pretrain
TIFF
major-tom via Source Cooperativenot statedpublic
Major-TOM Elliot-Pretrain
TIFF
major-tom via Source Cooperativenot statedpublic
Mars Spectrometry 2: Gas Chromatography for the Sample Analysis at Mars Data (SAM) Instrument
CSV
NASAThere are no restrictions on the use, access…public
Mars Spectrometry: Detect Evidence for Past Habitability
CSV
NASAThere are no restrictions on the use, access…public
MegaScenes
Cornell University https://www.cs.cornell.edu/~snavely/Creative Commons Attribution 4.0 International…public
MMRB 2 Image
Meta AIcc-by-nc-sa-4.0 non-commercial or no-derivativespublic
Multi Token Completion
CSV
AmazonDatasets are published under… non-commercial or no-derivativespublic
Multimedia Commons
JPEG
Multimedia CommonsCustom (see documentation)public
NASA Lunar FM Bench (SomBench): multimodal LRO tiles, benchmarks and Lunar FM weights
NASA IMPACT and IBM ResearchCC-BY-4.0 (data and bucket README); model…public
NASA SOHO/LASCO2 comet challenge on AWS
NASAThere are no restrictions on the use of this…public
Nemotron ClimbLab
PNGParquet
NVIDIAcc-by-nc-4.0 non-commercial or no-derivativespublic
Nemotron ClimbMix
PNGParquet
NVIDIAcc-by-nc-4.0 non-commercial or no-derivativespublic
NLP - fast.ai datasets
fast.aiVaries by dataset - see documentation linkpublic
OpenSurfaces
Cornell UniversityThe annotations are licensed under a Creative…public
PersonPath22
JSON
Amazon Web ServicesCreative Commons Attribution-NonCommercial 4.0… non-commercial or no-derivativespublic
Principia Bench
PNGJSON Lines
Meta AIcc-by-nc-4.0 non-commercial or no-derivativespublic
PyEnvs and CallArgs
AmazonCustom (see documentation)public
PyEnvs and CallArgs
AmazonCustom (see documentation)public
Recycling The Web
PNG
Meta AIcc-by-nc-4.0 non-commercial or no-derivativespublic
Search
Parquet
geovibes via Source Cooperativenot statedpublic
Solar Dynamics Observatory (SDO) Machine Learning Dataset
NASAThere are no restrictions on the use of this…public
Voices Obscured in Complex Environmental Settings (VOiCES)
In-Q-TelCreative Commons BY 4.0 (see…public
WikiSum: Coherent Summarization Dataset for Efficient Human-Evaluation
AmazonDataset is published under… non-commercial or no-derivativespublic
Wildchat RIP Filtered By 70 B Llama
JSON Lines
Meta AIcc-by-nc-4.0 non-commercial or no-derivativespublic
Wildchat RIP Filtered By 8 B Llama
JSON Lines
Meta AIcc-by-nc-4.0 non-commercial or no-derivativespublic
Xiph.Org Test Media
Xiph.orgVarious. Most are under the CC-BY license.…public
ImageNet
not statedpublic
ISBI Challenge
not statedpublic
ASL 1000
NVIDIA CorporationPlease see the [NVIDIA Dataset…credentialed
YouTube 8 Million - Data Lakehouse Ready
Amazon Web Serviceshttps://github.com/aws-samples/data-lake-as-code…credentialed

Related topics