National Reef Monitoring Network - Global benthic cover data (photoquadrat image annotations)
- Provider
- AODN
- License
- http://creativecommons.org/licenses/by/4.0/
- Size
- 252 objects, 3,813,959 bytes
- Records
- 120,561 rows (exact, full read 2026-10-04)
- Format
- Parquet (in sampled files)
- Stored at
- Amazon S3, s3://aodn-cloud-optimised/diver_photoquadrat_score_qc.parquet (ap-southeast-2)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Life Sciences
- Source
- https://catalogue-imos.aodn.org.au/geonetwork/srv/eng/catalog.search#/metadata/0a65be6d-1c76-49ac-a151-80acf123612c
About this dataset
The National Reef Monitoring Network (NRMN) brings together shallow reef surveys conducted around Australia into a centralised database; the IMOS NRMN Sub-Facility collates, cleans, stores and makes this data available from Reef Life Survey, Parks Australia, the IMOS Understanding of Marine Imagery Sub-Facility, DBCA (WA), DEW (SA), DPIRD (NSW), Tasmanian Parks and Wildlife Service, Parks Victoria and IMAS. This dataset contains habitat composition scored from photoquadrats taken by RLS and ATRC divers along 50 m transects on shallow rocky and coral reefs: 20 images per transect at 2.5 m intervals, annotated with a point-overlay approach (usually 5 points per image) using standardised label schemes, either full-biodiversity or targeted (e.g. habitat-forming corals only). Values are percent cover per 50 m transect-analysis, keyed by dataset_id. Squidle+ is the image and annotation platform; this collection supersedes the retired RLS 'Habitat Quadrats' collection. This store is the quality-controlled percent-cover table as hive-partitioned parquet: 120,561 rows, 10,807 transect analyses, 2,892 sites in 47 countries, 2006-09 to 2026-03, partitioned by survey year and 20-degree cell.
How to load this dataset in Python
import os
import pyarrow.parquet as pq
pf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'timestamp=1767225600/polygon=01030000000100000005000000000000000040604000000000000049C00000000000C0624000000000000049C00000000000C062400000000000003EC000000000004060400000000000003EC0000000000040604000000000000049C0/ep_m13_pq_scores.csv-0.parquet'))
print(pf.metadata)
df = pf.read_row_group(0).to_pandas()
df.head()Run in a Scigantic notebook on 2026-11-04 against timestamp=1767225600/polygon=01030000000100000005000000000000000040604000000000000049C00000000000C0624000000000000049C00000000000C062400000000000003EC000000000004060400000000000003EC0000000000040604000000000000049C0/ep_m13_pq_scores.csv-0.parquet: Parquet 454 rows, 27 columns, 1 row groups; columns ['TIME:timestamp[ns]', 'area:string', 'date:string', 'hour:string', 'tags:string', 'depth:float', 'country:string', 'program:string', 'database:string', 'filename:string'].
From any machine
# Task: read the schema and dataset identity without touching a data file (_common_metadata at the root)
import pyarrow.parquet as pq, s3fs, ast
fs = s3fs.S3FileSystem(anon=True, client_kwargs={'region_name': 'ap-southeast-2'})
for store in ['diver_benthic_cover_in_situ_qc', 'diver_photoquadrat_score_qc', 'diver_photoquadrat_qc_DwC', 'diver_site_information_qc']:
schema = pq.read_schema(f'aodn-cloud-optimised/{store}.parquet/_common_metadata', filesystem=fs)
meta = {k.decode(): v.decode() for k, v in schema.metadata.items()}
print(store, '|', len(schema), 'columns |', ast.literal_eval(meta['global_attributes']))
print(' ', ast.literal_eval(meta.get('latitude') or meta.get('decimalLatitude')))Lists the files with anonymous access. Runs on any machine, with no cloud account.
Data structure
File types in sampled files: Parquet
Fields
TIME | timestamp[ns]; 'Derived timestamp' = date plus hour when known; 2006-09-02 to 2026-03-12; no nulls |
area | string; state/territory or overseas region, 120 distinct (Queensland 27,374 | NSW 21,498 | WA 19,473 | Victoria 9,554 |… |
date | string YYYY-MM-DD local date |
hour | string HH:mm:ss local; null 8.4% |
tags | string; annotation tags: '' (most), 'dead', 'bleached', 'bleached|dead'; never null |
depth | float32 m |
country | string; 47 countries, Australia 95,131 rows |
polygon | string (hive key); WKB hex of a 20 x 20 degree cell; 76 cells in use worldwide; all SA rows in the 120E-140E / 40S-20S… |
program | string; single value 'RLS' |
database | string; 'Squidle+' 74,280 (scored in Squidle+, sq_annotation_set_id set) | 'NRMN' 46,281 (legacy scores held in the… |
filename | string; single value 'ep_m13_pq_scores.csv' |
latitude | float32 degrees_north; site coordinate, 2 dp; -55.05 to 78.45 |
location | string; 179 regions ('Encounter', 'Adelaide', 'Kangaroo Island', 'Yorke Peninsula', 'SA - Western' for SA) |
longitude | float32 degrees_east; -179.14 to 177.18 |
rls_label | string; RLS standardised habitat label, 77 distinct (Turfing algae (<2 cm high algal/sediment mat on rock), Crustose… |
site_code | string; 2,892 distinct; 99.1% present in diver_site_information_qc |
site_name | string; 2,875 distinct |
timestamp | int64 (hive key); epoch seconds of 1 Jan of the survey year, 2006..2026 |
dataset_id | string; 10,807 distinct; one 50 m transect-analysis, e.g. '912352572_53_9535' = <survey_id>_<label_scheme… |
visibility | string m; null 22.7% |
and 9 more
Analyze this dataset without downloading it
On Scigantic, National Reef Monitoring Network - Global benthic cover data (photoquadrat image annotations) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Life Sciences datasets
- OpenOrganelle jrc_fly-fsb-1: Drosophila Fan-Shaped Body Neuropil, 4 nm Isotropic FIB-SEM
- KABR Raw Drone Videos of Giraffes and Zebras, Mpala Research Centre, Kenya
- Cell Organelle Segmentation in Electron Microscopy (COSEM) on AWS
- KABR Drone Maneuver Test-Clip Library: 41 Wildlife Drone Clips Labeled per Frame for Autonomous Flight Policy Evaluation
- CryoET Data Portal
- Pacific Ocean Sound Recordings
- Cell Painting Image Collection
- USNM Bumblebee Specimen Images: 73,497 Smithsonian Bombus and Xylocopa Specimens with Darwin Core Occurrence Data