MIND Global Land Embeddings (Matryoshka Implicit Neural Distillation, 0.01 degree)

Provider
TGE Labs (Taylor Geospatial)
License
CC-BY-4.0 (source)
Format
Zarr (in sampled files)
Stored at
Amazon S3, s3://us-west-2.opendata.source.coop/tge-labs/mind (us-west-2)
Access
Free and public. No account with the data provider is needed.
Category
Earth Observation & Geospatial
Source
https://source.coop/tge-labs/mind

About this dataset

Precomputed global land embeddings from MIND (Matryoshka Implicit Neural Distillation), a location encoder that maps latitude and longitude to a 3,072-dimensional representation distilled from Earth observation teacher embeddings. The Matryoshka training means leading dimensions carry broad geographic patterns and later chunks add finer spatial variation, so users can truncate to 64, 256 or more dimensions for a downstream task without retraining. Files: mind.zarr (Zarr v3, all 3,072 dimensions on a 0.01 degree, about 1 km, EPSG:4326 grid over global land, chunked across space and embedding dimension, group 0 finest and groups 1-6 coarser overviews), mind_rgb.tif (PCA-to-RGB Cloud Optimized GeoTIFF for viewing), and mind_hex_r4.parquet / mind_hex_r5.parquet (GeoParquet H3 resolution 4 and 5 summaries of the first 64 dimensions). Read an area and a subset of dimensions with xarray.open_zarr and rioxarray (decode_coords='all'); values are stored encoded and the README shows decoding and ocean masking. Model weights are on Torch Hub for generating embeddings at arbitrary coordinates. Useful as covariates for species distribution, crop, socioeconomic and environmental regression. Licensed CC BY 4.0; cite the MIND paper.

How to access this dataset in Python

import boto3
from botocore import UNSIGNED
from botocore.client import Config
s3 = boto3.client('s3', region_name='us-west-2', config=Config(signature_version=UNSIGNED))
s3.list_objects_v2(Bucket='us-west-2.opendata.source.coop', Prefix='tge-labs/mind/', Delimiter='/')

Lists the files with anonymous access. Runs on any machine, with no cloud account.

Data structure

File types in sampled files: Zarr

Files

Example file: tge-labs/mind/mind.zarr/0/embedding/c/0/1/14

Analyze this dataset without downloading it

On Scigantic, MIND Global Land Embeddings (Matryoshka Implicit Neural Distillation, 0.01 degree) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Earth Observation & Geospatial datasets