# SciVid STIR: Surgical Tattoos in Infrared Point-Tracking Clips of Soft Tissue in Endoscopic Video (Google DeepMind)

## Facts

- Provider: Google DeepMind (SciVid); source data University of British Columbia and Intuitive Surgical
- License: CC-BY-4.0 (https://github.com/google-deepmind/scivid)
- Stored at: Google Cloud Storage, gs://scivid/full/stir (us)
- Access: public, readable without an account
- Category: Health & Biomedical
- Source: https://arxiv.org/abs/2309.16782
- Page: https://scigantic.com/archive/81669914-f4fe-50eb-b844-5a420d736822
- Keywords: Health & Biomedical, benchmark, Google Cloud Storage

## About

Preprocessed STIR (Surgical Tattoos in Infrared) clips for point tracking on deforming soft tissue in surgical endoscopy video, as packaged in the SciVid benchmark. STIR, from the University of British Columbia and Intuitive Surgical, marks tissue with infrared-visible tattoo points that are invisible in the visible-light video, giving ground-truth start and end positions of tracked points across surgical sequences. SciVid filtered and downsampled the clips and normalized query and target points by image size. The folder holds three sets of 100 shards: full_val_stir, short_val_stir and test_stir. There is no training split; models are evaluated on how well tracking transfers to tissue motion in minimally invasive surgery. SciVid (Hasson et al., SciVid: Cross-Domain Evaluation of Video Models in Scientific Applications, ICCV 2025, arXiv:2507.03578) is a five-task benchmark for video foundation models in science; this folder is one task. Files are ArrayRecord shards, read with the array_record Python package or the loaders in the google-deepmind/scivid repository. License: SciVid materials CC BY 4.0 (Google DeepMind); STIR is under a Creative Commons Attribution license at IEEE DataPort (DOI 10.21227/w8g4-g548). Cite SciVid and the STIR paper, arXiv:2309.16782.

## Load the data

```python
import gcsfs
fs = gcsfs.GCSFileSystem(token='anon')
fs.ls('scivid/full/stir/', detail=False)[:10]
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

Example file: `full/stir/`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/81669914-f4fe-50eb-b844-5a420d736822
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/81669914-f4fe-50eb-b844-5a420d736822
- Over MCP: `get_schema_card` with id `81669914-f4fe-50eb-b844-5a420d736822` at https://api.scigantic.com/mcp

## Related topics

- [Benchmark datasets](https://scigantic.com/topics/benchmark)
- [Health & Biomedical datasets](https://scigantic.com/topics/health-and-biomedical)
