# National Reef Monitoring Network - Benthic cover data (in situ surveys)

## Facts

- Provider: AODN
- License: http://creativecommons.org/licenses/by/4.0/
- Size: 96 objects, 4,813,982 bytes
- Records: 489,046 rows (exact, full read 2026-10-04)
- Format: Parquet (in sampled files)
- Stored at: Amazon S3, s3://aodn-cloud-optimised/diver_benthic_cover_in_situ_qc.parquet (ap-southeast-2)
- Access: public, readable without an account
- Category: Life Sciences
- Source: https://catalogue-imos.aodn.org.au/geonetwork/srv/eng/catalog.search#/metadata/ec424e4f-0f55-41a5-a3f2-726bc4541947
- Page: https://scigantic.com/archive/32aab664-2cde-583a-be7d-82a7197ee349
- Keywords: Life Sciences, Parquet, AWS Open Data

## About

The National Reef Monitoring Network (NRMN) brings together shallow reef surveys conducted around Australia into a centralised database. The IMOS NRMN Sub-Facility collates, cleans, stores and makes this data rapidly available from contributors including Reef Life Survey, Parks Australia, DBCA (Western Australia), DEW (South Australia), DPI (New South Wales), Tasmanian Parks and Wildlife Service and Parks Victoria. This dataset contains the cover of macroalgae and sessile invertebrates scored in situ at Australian Temperate Reef Collaboration (ATRC) sites: quadrats are placed at 10 m spacing along each transect (5 per 50 m transect), and the canopy, mid-storey and substrate layers are assessed in sequence in each single 50-point quadrat by divers skilled in macroalgal identification. This store is the quality-controlled table as hive-partitioned parquet: 489,046 point-count rows (one per species per quadrat) from 14,419 transects at 720 sites in TAS, WA, VIC, SA and NSW, 1992-03 to 2025-03, partitioned by survey year and 20-degree cell.

## Load the data

```python
import os
import pyarrow.parquet as pq
pf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'timestamp=978307200/polygon=01030000000100000005000000000000000080614000000000000044C0000000000000644000000000000044C0000000000000644000000000000034C0000000000080614000000000000034C0000000000080614000000000000044C0/ep_m3_isq_public_data.csv-0.parquet'))
print(pf.metadata)
df = pf.read_row_group(0).to_pandas()
df.head()
```

Run in a Scigantic notebook on 2026-10-04 against `timestamp=978307200/polygon=01030000000100000005000000000000000080614000000000000044C0000000000000644000000000000044C0000000000000644000000000000034C0000000000080614000000000000034C0000000000080614000000000000044C0/ep_m3_isq_public_data.csv-0.parquet`: Parquet 1,000 rows, 30 columns, 1 row groups; columns ['TIME:timestamp[ns]', 'area:string', 'geom:string', 'hour:string', 'class:string', 'depth:float', 'order:string', 'realm:string', 'total:int32', 'family:string'].

From any machine:

```python
# Task: read the schema and dataset identity without touching a data file (_common_metadata at the root)
import pyarrow.parquet as pq, s3fs, ast
fs = s3fs.S3FileSystem(anon=True, client_kwargs={'region_name': 'ap-southeast-2'})
for store in ['diver_benthic_cover_in_situ_qc', 'diver_photoquadrat_score_qc', 'diver_photoquadrat_qc_DwC', 'diver_site_information_qc']:
    schema = pq.read_schema(f'aodn-cloud-optimised/{store}.parquet/_common_metadata', filesystem=fs)
    meta = {k.decode(): v.decode() for k, v in schema.metadata.items()}
    print(store, '|', len(schema), 'columns |', ast.literal_eval(meta['global_attributes']))
    print('   ', ast.literal_eval(meta.get('latitude') or meta.get('decimalLatitude')))
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

File types in sampled files: Parquet

| Field | Type |
| --- | --- |
| `TIME` | timestamp[ns]; 'Derived timestamp' = survey_date plus hour when hour is known (21.6% of rows have a non-midnight time)… |
| `area` | string; state/territory: Tasmania 293,497 \| Western Australia 61,518 \| Victoria 54,016 \| South Australia 42,104 \| New… |
| `geom` | string; EWKB hex of the site point with SRID 4326 (prefix 0101000020E6100000); duplicates latitude/longitude |
| `hour` | string HH:mm:ss local time; null in 78.2% of rows |
| `class` | string; taxonomic class of the scored element (Phaeophyceae, Florideophyceae ...); null 18% |
| `depth` | float32 m; transect depth 1.1 to 15.0 m, median 5.3 |
| `order` | string; taxonomic order; null 19.6% |
| `realm` | string; MEOW realm, single value 'Temperate Australasia' |
| `total` | int32; number of quadrat points (of 50) that fell on this species in this quadrat; 0 to 322, median 6. Sum over species… |
| `family` | string; taxonomic family; null 26.8% |
| `phylum` | string; Rhodophyta, Heterokontophyta, Porifera, Bryozoa ...; 28 nulls |
| `country` | string; single value 'Australia' |
| `polygon` | string (hive partition key); WKB hex of the 20-degree cell; 6 cells in use; every South Australian row is in the… |
| `program` | string; ATRC 437,775 \| Parks Vic 43,145 \| FRDC 8,126 rows (no RLS rows in this table) |
| `quadrat` | string; Q1..Q5 (5 x 50-point quadrats per 50 m transect) plus 28 rows 'No specimen found' |
| `filename` | string; single value 'ep_m3_isq_public_data.csv' (the NRMN endpoint export this store was built from) |
| `latitude` | float32 degrees_north; SITE coordinate rounded to 2 dp, -43.64 to -30.12 |
| `location` | string; 36 regions, e.g. 'Encounter', 'Yorke Peninsula', 'Eyre Peninsula', 'SA - Western', 'Upper Spencer Gulf'… |
| `ecoregion` | string; MEOW ecoregion: Bassian, Cape Howe, Houtman, South Australian Gulfs (30,344 rows), Leeuwin, Western Bassian… |
| `longitude` | float32 degrees_east; site coordinate, 114.94 to 150.84 |

and 12 more fields

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/32aab664-2cde-583a-be7d-82a7197ee349
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/32aab664-2cde-583a-be7d-82a7197ee349
- Over MCP: `get_schema_card` with id `32aab664-2cde-583a-be7d-82a7197ee349` at https://api.scigantic.com/mcp

## Related topics

- [Parquet datasets](https://scigantic.com/topics/parquet)
- [Life Sciences datasets](https://scigantic.com/topics/life-sciences)
