# SciVid Fly-vs-Fly: Drosophila Social Behavior Video Clips for Action Classification (Google DeepMind SciVid Benchmark)

## Facts

- Provider: Google DeepMind (SciVid); source data Eyjolfsdottir et al., Caltech and HHMI
- License: CC-BY-4.0 (https://github.com/google-deepmind/scivid)
- Stored at: Google Cloud Storage, gs://scivid/full/fly_vs_fly (us)
- Access: public, readable without an account
- Category: Neuroscience
- Source: https://arxiv.org/abs/2507.03578
- Page: https://scigantic.com/archive/9f0559db-c4a2-54ab-9865-35889c9cc687
- Keywords: Neuroscience, benchmark, Google Cloud Storage

## About

Preprocessed Fly-vs-Fly videos of interacting fruit flies (Drosophila melanogaster) for frame-level social behavior classification, as packaged in the SciVid benchmark. Fly-vs-Fly (Eyjolfsdottir et al., Detecting social actions of fruit flies, ECCV 2014; Caltech and HHMI) has 22 hours of video of pairs of fruit flies engaged in 10 expert-annotated social interactions in three contexts: Boy meets boy, Aggression (male-male aggression under genetic manipulation) and Courtship. SciVid filtered the clips as described by Task Programming (Sun et al., CVPR 2021) and provides about 1 million training samples, with train, validation and test splits (for example test_fly_split_ids_shuffle.array_record-00000-of-00100) of short video windows and behavior labels. Used to test whether general video models transfer to animal behavior analysis in neuroscience and ethology. SciVid (Hasson et al., SciVid: Cross-Domain Evaluation of Video Models in Scientific Applications, ICCV 2025, arXiv:2507.03578) is a five-task benchmark for video foundation models in science; this folder is one task. Files are ArrayRecord shards, read with the array_record Python package or the loaders in the google-deepmind/scivid repository. License: SciVid materials CC BY 4.0 (Google DeepMind); the source Fly-vs-Fly data are CC0 at CaltechDATA (DOI 10.22002/D1.1893). Cite SciVid and Eyjolfsdottir et al. 2014.

## Load the data

```python
import gcsfs
fs = gcsfs.GCSFileSystem(token='anon')
fs.ls('scivid/full/fly_vs_fly/', detail=False)[:10]
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

Example file: `full/fly_vs_fly/`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/9f0559db-c4a2-54ab-9865-35889c9cc687
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/9f0559db-c4a2-54ab-9865-35889c9cc687
- Over MCP: `get_schema_card` with id `9f0559db-c4a2-54ab-9865-35889c9cc687` at https://api.scigantic.com/mcp

## Related topics

- [Neuroscience datasets](https://scigantic.com/topics/neuroscience)
- [Benchmark datasets](https://scigantic.com/topics/benchmark)
