Moorings - Estuarine and coastal water quality monitoring - Near real time
- Provider
- AODN
- License
- http://creativecommons.org/licenses/by/4.0/
- Size
- 32 objects, 9,134,850 bytes
- Records
- 263,012 rows on 2026-10-04 (SA-ST-KILDA 55,738; SA-STANSBURY 48,881; SA-AMERICAN-RIVER 47,541; SA-BOSTON-BAY 44,261; SA-COFFIN-BAY 38,001; SA-VICTOR-HARBOR 26,239; VIC-WESTERN-PORT 2,351); grows daily
- Format
- Parquet (in sampled files)
- Stored at
- Amazon S3, s3://aodn-cloud-optimised/mooring_estuarine_coastal_water_quality_monitoring_realtime_qc.parquet (ap-southeast-2)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Environmental Science
- Source
- https://catalogue-imos.aodn.org.au/geonetwork/srv/eng/catalog.search#/metadata/f3c16fdb-72fc-4b55-bff1-3b5b5722f38f
About Moorings - Estuarine and coastal water quality monitoring - Near real time
The IMOS Estuarine and Coastal Moorings Facility provides a national, standardised network of estuarine and coastal moorings focused on water quality. The collection brings together IMOS-funded buoys and co-invested monitoring networks, notably the South Australian Harmful Algal Bloom (HAB) coastal monitoring network run by SARDI. Small telemetered buoys (Xylem DB range) are anchored in shallow water and measure pressure, temperature, salinity, chlorophyll-a fluorescence, dissolved oxygen, turbidity and fDOM, with optional extra sensors. Near real-time data at 15 minute intervals are processed by SARDI and automatically quality controlled with IOOS QARTOD tests (location, gross range, spike, rate of change, flat line); every value carries an IOC flag (1 pass, 3 questionable, 4 fail, 9 missing). This store holds the near real-time stream as hive-partitioned parquet: on 2026-10-04 it held 263,012 rows from seven sites (six South Australian aquaculture and gulf sites: American River, Boston Bay, Coffin Bay, St Kilda, Stansbury, Victor Harbor, plus Western Port in Victoria), covering 2025-12-18 to 2026-10-04 and updated several times a day. These are the SA Harmful Algal Bloom coastal monitoring buoys: the near-real-time temperature, salinity, dissolved oxygen, chlorophyll fluorescence and turbidity record at the Adelaide, Yorke Peninsula, Kangaroo Island and Eyre Peninsula sites during the 2025-26 Karenia algal bloom response.
How to load this dataset in Python
import os
import pyarrow.parquet as pq
pf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'site_code=SA-AMERICAN-RIVER/timestamp=1767225600/polygon=010300000001000000050000000000000000C0604000000000000042C0000000000040614000000000000042C0000000000040614000000000000040C00000000000C0604000000000000040C00000000000C0604000000000000042C0/SARDI_ESTUARINE-COASTAL-MOORINGS_BKT_20260129T210000Z_SA-AMERICAN-RIVER_FV00_SACM-AMR-20260129_HAI-AHIW2A-CAD.nc-0.parquet'))
print(pf.metadata)
df = pf.read_row_group(0).to_pandas()
df.head()Run in a Scigantic notebook on 2026-10-05 against site_code=SA-AMERICAN-RIVER/timestamp=1767225600/polygon=010300000001000000050000000000000000C0604000000000000042C0000000000040614000000000000042C0000000000040614000000000000040C00000000000C0604000000000000040C00000000000C0604000000000000042C0/SARDI_ESTUARINE-COASTAL-MOORINGS_BKT_20260129T210000Z_SA: Parquet 13,738 rows, 46 columns, 1 row groups; columns ['TEMP:float', 'TIME:timestamp[ns]', 'FLUSI:float', 'FLU670:float', 'FLU690:float', 'project:string', 'CPHL_PPB:float', 'LATITUDE:double', 'filename:string', 'LONGITUDE:double'].
From any machine
# Task: read the schema and the dataset-level metadata (GeoNetwork uuid, title, QC tests) without touching any data file
import json, pyarrow.parquet as pq, s3fs
fs = s3fs.S3FileSystem(anon=True, client_kwargs={'region_name': 'ap-southeast-2'})
root = 'aodn-cloud-optimised/mooring_estuarine_coastal_water_quality_monitoring_realtime_qc.parquet'
with fs.open(root + '/_common_metadata', 'rb') as f:
schema = pq.read_schema(f)
print(len(schema.names), 'columns;', [n for n in schema.names if not n.endswith('_quality_control')])
print(schema.metadata[b'global_attributes'].decode()) # metadata_uuid, title, quality_control_tests_applied
print(schema.metadata[b'CPHL'].decode()) # per-column attrs: units, long_name, sensor serial, flag meaningsLists the files with anonymous access. Runs on any machine, with no cloud account.
Data structure
File types in sampled files: Parquet
Fields
TIME | timestamp[ns], tz-naive UTC; 15 min cadence per instrument, the two instruments at a site are offset by 2-4 min so… |
site_code | string (hive partition key, read back as categorical): SA-AMERICAN-RIVER, SA-BOSTON-BAY, SA-COFFIN-BAY, SA-ST-KILDA… |
timestamp | int64 hive partition key = epoch seconds of 1 January of the observation year (1735689600 = 2025-01-01, 1767225600 =… |
polygon | string hive partition key: WKB hex (little-endian Polygon) of a 4x4 degree box, e.g. (132,-36)-(136,-32) for Boston Bay… |
LATITUDE / LONGITUDE | double, degrees_north / degrees_east, WGS84, nominal mooring position, one constant per site: American River… |
LATITUDE_GPS / LONGITUDE_GPS | double, latitude/longitude at most recent GPS fix, carried forward between fixes; present on every row |
NOMINAL_DEPTH | float, m, positive down, 0.9 at every site |
DEPTH | double, m, actual depth from pressure (TEOS-10); EXO2 rows only; QC-passed values 0.41-1.08 m; Boston Bay reports about… |
TEMP | float, degC, sea_water_temperature; both instruments, every row; QC-passed range 12.6-24.5 (2026-10-04) |
PSAL | float, practical salinity (units '1'); EXO2 rows; QC-passed range 33.0-37.3 |
SPEC_CNDC | float, S m-1, specific conductivity at 25 degC (converted from uS/cm x 1e-4); EXO2 rows |
DOXY | float, mg l-1, dissolved oxygen concentration; EXO2 rows; QC-passed 6.5-10.9 |
DOXS | float, percent, oxygen saturation; EXO2 rows; QC-passed 91-121 |
CPHL | float, mg m-3, chlorophyll-a INFERRED from fluorescence (factory Rhodamine WT calibration, not extracted pigment); EXO2… |
CPHL_RFU | float, relative fluorescence units, raw chlorophyll signal behind CPHL; EXO2 rows |
CPHL_PPB | float, ppb (uranine-calibrated) chlorophyll fluorescence from the second fluorometer; BKT rows only; null at… |
FLU670 / FLU690 / FLUSI | float, ppb / ppb / dimensionless; 670 nm and 690 nm fluorescence intensity and their spectral shift index FLUSI = C x… |
PHYCO / PHYCO_RFU | float, mg m-3 / rfu, phycoerythrin (cyanobacteria pigment) fluorescence; EXO2 rows; 96,391 of 131,874 PHYCO values… |
TURB | float, FNU, turbidity; EXO2 rows; QC-passed 1.0-1751.6, median 5.2 |
FDOM | float, QSU, fluorescent dissolved organic matter; EXO2 rows; 72,041 of 131,874 flagged 3, 2,178 flagged 9 |
and 4 more
Analyze this dataset without downloading it
On Scigantic, Moorings - Estuarine and coastal water quality monitoring - Near real time opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Environmental Science datasets
- DEA Fuel Moisture Content (Sentinel-2, Australia)
- NEON Tree Crowns, DeepTreeAttention Edition: 41,738 Species-Labelled Crowns at 38 NEON Sites
- GLOBIO 4 Terrestrial Mean Species Abundance (MSA) Biodiversity Intactness, 2015 and SSP 2050 Scenarios
- Multi-perspective plains zebras: four drone-swarm missions on one synchronised timebase
- PUUM passive acoustic recordings: unlabelled Hawaiian bird audio from Pu'u Maka'ala Natural Area Reserve
- OBIS: Ocean Biodiversity Information System (2024)
- Secondary Forest Brazil
- Africa industrial asset data: steel, cement, coal, power, paper and pulp, brick kilns and waste (APAD)