# National Reef Monitoring Network - Global benthic cover data (photoquadrat image annotations)

## Facts

- Provider: AODN
- License: http://creativecommons.org/licenses/by/4.0/
- Size: 252 objects, 3,813,959 bytes
- Records: 120,561 rows (exact, full read 2026-10-04)
- Format: Parquet (in sampled files)
- Stored at: Amazon S3, s3://aodn-cloud-optimised/diver_photoquadrat_score_qc.parquet (ap-southeast-2)
- Access: public, readable without an account
- Category: Life Sciences
- Source: https://catalogue-imos.aodn.org.au/geonetwork/srv/eng/catalog.search#/metadata/0a65be6d-1c76-49ac-a151-80acf123612c
- Page: https://scigantic.com/archive/11a1891b-d0d0-5dcc-96de-ae6129582fc6
- Keywords: Life Sciences, Parquet, AWS Open Data

## About

The National Reef Monitoring Network (NRMN) brings together shallow reef surveys conducted around Australia into a centralised database; the IMOS NRMN Sub-Facility collates, cleans, stores and makes this data available from Reef Life Survey, Parks Australia, the IMOS Understanding of Marine Imagery Sub-Facility, DBCA (WA), DEW (SA), DPIRD (NSW), Tasmanian Parks and Wildlife Service, Parks Victoria and IMAS. This dataset contains habitat composition scored from photoquadrats taken by RLS and ATRC divers along 50 m transects on shallow rocky and coral reefs: 20 images per transect at 2.5 m intervals, annotated with a point-overlay approach (usually 5 points per image) using standardised label schemes, either full-biodiversity or targeted (e.g. habitat-forming corals only). Values are percent cover per 50 m transect-analysis, keyed by dataset_id. Squidle+ is the image and annotation platform; this collection supersedes the retired RLS 'Habitat Quadrats' collection. This store is the quality-controlled percent-cover table as hive-partitioned parquet: 120,561 rows, 10,807 transect analyses, 2,892 sites in 47 countries, 2006-09 to 2026-03, partitioned by survey year and 20-degree cell.

## Load the data

```python
import os
import pyarrow.parquet as pq
pf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'timestamp=1767225600/polygon=01030000000100000005000000000000000040604000000000000049C00000000000C0624000000000000049C00000000000C062400000000000003EC000000000004060400000000000003EC0000000000040604000000000000049C0/ep_m13_pq_scores.csv-0.parquet'))
print(pf.metadata)
df = pf.read_row_group(0).to_pandas()
df.head()
```

Run in a Scigantic notebook on 2026-11-04 against `timestamp=1767225600/polygon=01030000000100000005000000000000000040604000000000000049C00000000000C0624000000000000049C00000000000C062400000000000003EC000000000004060400000000000003EC0000000000040604000000000000049C0/ep_m13_pq_scores.csv-0.parquet`: Parquet 454 rows, 27 columns, 1 row groups; columns ['TIME:timestamp[ns]', 'area:string', 'date:string', 'hour:string', 'tags:string', 'depth:float', 'country:string', 'program:string', 'database:string', 'filename:string'].

From any machine:

```python
# Task: read the schema and dataset identity without touching a data file (_common_metadata at the root)
import pyarrow.parquet as pq, s3fs, ast
fs = s3fs.S3FileSystem(anon=True, client_kwargs={'region_name': 'ap-southeast-2'})
for store in ['diver_benthic_cover_in_situ_qc', 'diver_photoquadrat_score_qc', 'diver_photoquadrat_qc_DwC', 'diver_site_information_qc']:
    schema = pq.read_schema(f'aodn-cloud-optimised/{store}.parquet/_common_metadata', filesystem=fs)
    meta = {k.decode(): v.decode() for k, v in schema.metadata.items()}
    print(store, '|', len(schema), 'columns |', ast.literal_eval(meta['global_attributes']))
    print('   ', ast.literal_eval(meta.get('latitude') or meta.get('decimalLatitude')))
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

File types in sampled files: Parquet

| Field | Type |
| --- | --- |
| `TIME` | timestamp[ns]; 'Derived timestamp' = date plus hour when known; 2006-09-02 to 2026-03-12; no nulls |
| `area` | string; state/territory or overseas region, 120 distinct (Queensland 27,374 \| NSW 21,498 \| WA 19,473 \| Victoria 9,554 \|… |
| `date` | string YYYY-MM-DD local date |
| `hour` | string HH:mm:ss local; null 8.4% |
| `tags` | string; annotation tags: '' (most), 'dead', 'bleached', 'bleached\|dead'; never null |
| `depth` | float32 m |
| `country` | string; 47 countries, Australia 95,131 rows |
| `polygon` | string (hive key); WKB hex of a 20 x 20 degree cell; 76 cells in use worldwide; all SA rows in the 120E-140E / 40S-20S… |
| `program` | string; single value 'RLS' |
| `database` | string; 'Squidle+' 74,280 (scored in Squidle+, sq_annotation_set_id set) \| 'NRMN' 46,281 (legacy scores held in the… |
| `filename` | string; single value 'ep_m13_pq_scores.csv' |
| `latitude` | float32 degrees_north; site coordinate, 2 dp; -55.05 to 78.45 |
| `location` | string; 179 regions ('Encounter', 'Adelaide', 'Kangaroo Island', 'Yorke Peninsula', 'SA - Western' for SA) |
| `longitude` | float32 degrees_east; -179.14 to 177.18 |
| `rls_label` | string; RLS standardised habitat label, 77 distinct (Turfing algae (<2 cm high algal/sediment mat on rock), Crustose… |
| `site_code` | string; 2,892 distinct; 99.1% present in diver_site_information_qc |
| `site_name` | string; 2,875 distinct |
| `timestamp` | int64 (hive key); epoch seconds of 1 Jan of the survey year, 2006..2026 |
| `dataset_id` | string; 10,807 distinct; one 50 m transect-analysis, e.g. '912352572_53_9535' = <survey_id>_<label_scheme… |
| `visibility` | string m; null 22.7% |

and 9 more fields

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/11a1891b-d0d0-5dcc-96de-ae6129582fc6
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/11a1891b-d0d0-5dcc-96de-ae6129582fc6
- Over MCP: `get_schema_card` with id `11a1891b-d0d0-5dcc-96de-ae6129582fc6` at https://api.scigantic.com/mcp

## Related topics

- [Parquet datasets](https://scigantic.com/topics/parquet)
- [Life Sciences datasets](https://scigantic.com/topics/life-sciences)
