# SciVid CalMS21: Resident-Intruder Mouse Social Interaction Video Clips for Behavior Classification (Google DeepMind)

## Facts

- Provider: Google DeepMind (SciVid); source data Sun, Karigo et al., Caltech and Northwestern University
- License: CC-BY-4.0 (https://github.com/google-deepmind/scivid)
- Stored at: Google Cloud Storage, gs://scivid/full/calms21_slim (us)
- Access: public, readable without an account
- Category: Neuroscience
- Source: https://arxiv.org/abs/2104.02710
- Page: https://scigantic.com/archive/233d9f89-e169-5692-a8e0-4f3d22522d3c
- Keywords: Neuroscience, benchmark, Google Cloud Storage

## About

Preprocessed CalMS21 (Caltech Mouse Social Interactions 2021) videos of freely behaving mice in the standard resident-intruder assay, for frame-level classification of social behaviors, as packaged in the SciVid benchmark. The original CalMS21 release has over 1 million frames with frame-level behavior annotations and 6 million unlabeled frames of tracked poses. SciVid filtered and spatially downsampled the videos (scale 0.5) and held out part of the original train split for validation, giving about 27,000 training samples with train, validation and test shards (calms21_test_split_ids_shuffle_scale05.array_record-00000-of-01024 and onward). Used to benchmark video models for automated rodent behavior annotation in behavioral neuroscience. SciVid (Hasson et al., SciVid: Cross-Domain Evaluation of Video Models in Scientific Applications, ICCV 2025, arXiv:2507.03578) is a five-task benchmark for video foundation models in science; this folder is one task. Files are ArrayRecord shards, read with the array_record Python package or the loaders in the google-deepmind/scivid repository. License: SciVid materials CC BY 4.0 (Google DeepMind); CalMS21 is CC BY 4.0 at CaltechDATA (DOI 10.22002/D1.1991). Cite SciVid and Sun et al., The Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions, arXiv:2104.02710.

## Load the data

```python
import gcsfs
fs = gcsfs.GCSFileSystem(token='anon')
fs.ls('scivid/full/calms21_slim/', detail=False)[:10]
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

Example file: `full/calms21_slim/`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/233d9f89-e169-5692-a8e0-4f3d22522d3c
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/233d9f89-e169-5692-a8e0-4f3d22522d3c
- Over MCP: `get_schema_card` with id `233d9f89-e169-5692-a8e0-4f3d22522d3c` at https://api.scigantic.com/mcp

## Related topics

- [Neuroscience datasets](https://scigantic.com/topics/neuroscience)
- [Benchmark datasets](https://scigantic.com/topics/benchmark)
