# Moorings - Estuarine and coastal water quality monitoring - Near real time

## Facts

- Provider: AODN
- License: http://creativecommons.org/licenses/by/4.0/
- Size: 32 objects, 9,134,850 bytes
- Records: 263,012 rows on 2026-10-04 (SA-ST-KILDA 55,738; SA-STANSBURY 48,881; SA-AMERICAN-RIVER 47,541; SA-BOSTON-BAY 44,261; SA-COFFIN-BAY 38,001; SA-VICTOR-HARBOR 26,239; VIC-WESTERN-PORT 2,351); grows daily
- Format: Parquet (in sampled files)
- Stored at: Amazon S3, s3://aodn-cloud-optimised/mooring_estuarine_coastal_water_quality_monitoring_realtime_qc.parquet (ap-southeast-2)
- Access: public, readable without an account
- Category: Environmental Science
- Source: https://catalogue-imos.aodn.org.au/geonetwork/srv/eng/catalog.search#/metadata/f3c16fdb-72fc-4b55-bff1-3b5b5722f38f
- Page: https://scigantic.com/archive/7fa49df9-b523-5738-929e-9134b83db955
- Keywords: Environmental Science, Parquet, AWS Open Data

## About

The IMOS Estuarine and Coastal Moorings Facility provides a national, standardised network of estuarine and coastal moorings focused on water quality. The collection brings together IMOS-funded buoys and co-invested monitoring networks, notably the South Australian Harmful Algal Bloom (HAB) coastal monitoring network run by SARDI. Small telemetered buoys (Xylem DB range) are anchored in shallow water and measure pressure, temperature, salinity, chlorophyll-a fluorescence, dissolved oxygen, turbidity and fDOM, with optional extra sensors. Near real-time data at 15 minute intervals are processed by SARDI and automatically quality controlled with IOOS QARTOD tests (location, gross range, spike, rate of change, flat line); every value carries an IOC flag (1 pass, 3 questionable, 4 fail, 9 missing). This store holds the near real-time stream as hive-partitioned parquet: on 2026-10-04 it held 263,012 rows from seven sites (six South Australian aquaculture and gulf sites: American River, Boston Bay, Coffin Bay, St Kilda, Stansbury, Victor Harbor, plus Western Port in Victoria), covering 2025-12-18 to 2026-10-04 and updated several times a day. These are the SA Harmful Algal Bloom coastal monitoring buoys: the near-real-time temperature, salinity, dissolved oxygen, chlorophyll fluorescence and turbidity record at the Adelaide, Yorke Peninsula, Kangaroo Island and Eyre Peninsula sites during the 2025-26 Karenia algal bloom response.

## Load the data

```python
import os
import pyarrow.parquet as pq
pf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'site_code=SA-AMERICAN-RIVER/timestamp=1767225600/polygon=010300000001000000050000000000000000C0604000000000000042C0000000000040614000000000000042C0000000000040614000000000000040C00000000000C0604000000000000040C00000000000C0604000000000000042C0/SARDI_ESTUARINE-COASTAL-MOORINGS_BKT_20260129T210000Z_SA-AMERICAN-RIVER_FV00_SACM-AMR-20260129_HAI-AHIW2A-CAD.nc-0.parquet'))
print(pf.metadata)
df = pf.read_row_group(0).to_pandas()
df.head()
```

Run in a Scigantic notebook on 2026-10-05 against `site_code=SA-AMERICAN-RIVER/timestamp=1767225600/polygon=010300000001000000050000000000000000C0604000000000000042C0000000000040614000000000000042C0000000000040614000000000000040C00000000000C0604000000000000040C00000000000C0604000000000000042C0/SARDI_ESTUARINE-COASTAL-MOORINGS_BKT_20260129T210000Z_SA`: Parquet 13,738 rows, 46 columns, 1 row groups; columns ['TEMP:float', 'TIME:timestamp[ns]', 'FLUSI:float', 'FLU670:float', 'FLU690:float', 'project:string', 'CPHL_PPB:float', 'LATITUDE:double', 'filename:string', 'LONGITUDE:double'].

From any machine:

```python
# Task: read the schema and the dataset-level metadata (GeoNetwork uuid, title, QC tests) without touching any data file
import json, pyarrow.parquet as pq, s3fs
fs = s3fs.S3FileSystem(anon=True, client_kwargs={'region_name': 'ap-southeast-2'})
root = 'aodn-cloud-optimised/mooring_estuarine_coastal_water_quality_monitoring_realtime_qc.parquet'
with fs.open(root + '/_common_metadata', 'rb') as f:
    schema = pq.read_schema(f)
print(len(schema.names), 'columns;', [n for n in schema.names if not n.endswith('_quality_control')])
print(schema.metadata[b'global_attributes'].decode())            # metadata_uuid, title, quality_control_tests_applied
print(schema.metadata[b'CPHL'].decode())                         # per-column attrs: units, long_name, sensor serial, flag meanings
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

File types in sampled files: Parquet

| Field | Type |
| --- | --- |
| `TIME` | timestamp[ns], tz-naive UTC; 15 min cadence per instrument, the two instruments at a site are offset by 2-4 min so… |
| `site_code` | string (hive partition key, read back as categorical): SA-AMERICAN-RIVER, SA-BOSTON-BAY, SA-COFFIN-BAY, SA-ST-KILDA… |
| `timestamp` | int64 hive partition key = epoch seconds of 1 January of the observation year (1735689600 = 2025-01-01, 1767225600 =… |
| `polygon` | string hive partition key: WKB hex (little-endian Polygon) of a 4x4 degree box, e.g. (132,-36)-(136,-32) for Boston Bay… |
| `LATITUDE / LONGITUDE` | double, degrees_north / degrees_east, WGS84, nominal mooring position, one constant per site: American River… |
| `LATITUDE_GPS / LONGITUDE_GPS` | double, latitude/longitude at most recent GPS fix, carried forward between fixes; present on every row |
| `NOMINAL_DEPTH` | float, m, positive down, 0.9 at every site |
| `DEPTH` | double, m, actual depth from pressure (TEOS-10); EXO2 rows only; QC-passed values 0.41-1.08 m; Boston Bay reports about… |
| `TEMP` | float, degC, sea_water_temperature; both instruments, every row; QC-passed range 12.6-24.5 (2026-10-04) |
| `PSAL` | float, practical salinity (units '1'); EXO2 rows; QC-passed range 33.0-37.3 |
| `SPEC_CNDC` | float, S m-1, specific conductivity at 25 degC (converted from uS/cm x 1e-4); EXO2 rows |
| `DOXY` | float, mg l-1, dissolved oxygen concentration; EXO2 rows; QC-passed 6.5-10.9 |
| `DOXS` | float, percent, oxygen saturation; EXO2 rows; QC-passed 91-121 |
| `CPHL` | float, mg m-3, chlorophyll-a INFERRED from fluorescence (factory Rhodamine WT calibration, not extracted pigment); EXO2… |
| `CPHL_RFU` | float, relative fluorescence units, raw chlorophyll signal behind CPHL; EXO2 rows |
| `CPHL_PPB` | float, ppb (uranine-calibrated) chlorophyll fluorescence from the second fluorometer; BKT rows only; null at… |
| `FLU670 / FLU690 / FLUSI` | float, ppb / ppb / dimensionless; 670 nm and 690 nm fluorescence intensity and their spectral shift index FLUSI = C x… |
| `PHYCO / PHYCO_RFU` | float, mg m-3 / rfu, phycoerythrin (cyanobacteria pigment) fluorescence; EXO2 rows; 96,391 of 131,874 PHYCO values… |
| `TURB` | float, FNU, turbidity; EXO2 rows; QC-passed 1.0-1751.6, median 5.2 |
| `FDOM` | float, QSU, fluorescent dissolved organic matter; EXO2 rows; 72,041 of 131,874 flagged 3, 2,178 flagged 9 |

and 4 more fields

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/7fa49df9-b523-5738-929e-9134b83db955
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/7fa49df9-b523-5738-929e-9134b83db955
- Over MCP: `get_schema_card` with id `7fa49df9-b523-5738-929e-9134b83db955` at https://api.scigantic.com/mcp

## Related topics

- [Parquet datasets](https://scigantic.com/topics/parquet)
- [Environmental Science datasets](https://scigantic.com/topics/environmental-science)
