# Nutrition5k: RGB-D Food Imagery with Per-Ingredient Mass, Calories and Macronutrients (Google Research)

## Facts

- Provider: Thames, Karpur, Norris, Xia, Panait, Weyand and Sim (Google Research)
- License: CC-BY-4.0 (https://github.com/google-research-datasets/Nutrition5k)
- Stored at: Google Cloud Storage, gs://nutrition5k_dataset/nutrition5k_dataset (us)
- Access: public, readable without an account
- Category: Health & Biomedical
- Source: https://arxiv.org/abs/2103.03375
- Page: https://scigantic.com/archive/a11e9e31-39a8-51a6-ac87-ad2a993da22b
- Keywords: Health & Biomedical, Google Cloud Storage

## About

Visual and nutritional data for about 5,000 real cafeteria plates scanned in Google cafeterias in California, released with Thames et al., 'Nutrition5k: Towards Automatic Nutritional Understanding of Generic Food' (CVPR 2021). Each of 5,006 dishes was captured on a custom rig with four rotating side-angle videos from Raspberry Pi cameras at 30 and 60 degree angles, plus an overhead RealSense RGB-D image when available (raw 16-bit depth at 10,000 units per meter, and colorized depth). Dishes were built incrementally, one ingredient at a time, and weighed, so labels give a fine-grained ingredient list, per-ingredient mass, total mass and calories, and fat, protein and carbohydrate masses, with per-gram nutrition taken from the USDA Food and Nutrient Database. Listed 2026-11-19: nutrition5k_dataset/ holds imagery/ (side_angles videos, realsense_overhead), metadata/ (dish_metadata_cafe1.csv, dish_metadata_cafe2.csv, ingredient_metadata.csv), dish_ids/ (official train and test splits) and scripts/ (frame extraction and evaluation of calorie and macronutrient regression). A 181 GB tarball of everything sits at the bucket root. Released under CC BY 4.0; cite Thames et al. 2021.

## Load the data

```python
import gcsfs
fs = gcsfs.GCSFileSystem(token='anon')
fs.ls('nutrition5k_dataset/nutrition5k_dataset/', detail=False)[:10]
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

Example file: `nutrition5k_dataset/dish_ids/splits/depth_test_ids.txt`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/a11e9e31-39a8-51a6-ac87-ad2a993da22b
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/a11e9e31-39a8-51a6-ac87-ad2a993da22b
- Over MCP: `get_schema_card` with id `a11e9e31-39a8-51a6-ac87-ad2a993da22b` at https://api.scigantic.com/mcp

## Related topics

- [Health & Biomedical datasets](https://scigantic.com/topics/health-and-biomedical)
