South Australian Algal Bloom Water Testing - Phytoplankton cell counts - Weekly mirror of the SA Government feature service

Provider
Government of South Australia (Department for Environment and Water; PIRSA/SARDI; EPA), mirrored by Scigantic
License
Not stated by the publisher; Crown copyright, Government of South Australia. Mirrored for research use with attribution; no redistribution licence granted.
Size
6 objects, 1.84 MB on 2026-10-04 (two current parquet files, one dated snapshot pair, README, MANIFEST)
Records
samples.parquet 94,155 rows (2026-10-04 pull); sites.parquet 858 rows. Growth about 650 sample rows per week
Format
Parquet, JSON (in sampled files)
Stored at
Amazon S3, s3://scigantic-sa-open-data/hab-monitoring (us-east-1)
Access
Free and public. No account with the data provider is needed.
Category
Environmental Science
Source
https://experience.arcgis.com/experience/5f0d6b22301a47bf91d198cabb030670

About this dataset

A weekly, dated mirror of the South Australian Government's Harmful Algal Bloom Water Testing program, the public data behind the SA Algal Bloom Water Testing Open Data Dashboard. Since the Karenia mikimotoi bloom was identified off the Fleurieu Peninsula in March 2025, SARDI (offshore), the EPA (onshore) and ad hoc sampling have counted phytoplankton cells per litre at hundreds of sites: the 21 Adelaide metropolitan beaches and jetties sampled every week (Largs Bay, Grange, Henley, Glenelg, Brighton, Port River and West Lakes among them), plus Gulf St Vincent, Spencer Gulf, the Yorke and Eyre peninsulas, the Fleurieu, Kangaroo Island, the Coorong and the South East, publishing the results only through an ArcGIS feature service with no CSV and no history. Search terms people use: SA algae, algal bloom Adelaide beaches, Karenia mikimotoi, red tide, harmful algal bloom, cells per litre. This archive holds a full parquet copy of that service (94,155 result rows across 858 sites, 2025-03-18 onward, about 650 new rows a week, 623 distinct taxon and summary labels including eight spellings of Karenia), re-pulled every Monday with a snapshot kept for every pull, plus a manifest with upstream edit dates and checksums. The whole dataset is under 1 MB and reads in seconds. No licence is stated by the publisher; the data is Crown copyright, Government of South Australia, mirrored for research use with attribution.

How to load this dataset in Python

import os
import pyarrow.parquet as pq
pf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'snapshots/2026-10-04/samples.parquet'))
print(pf.metadata)
df = pf.read_row_group(0).to_pandas()
df.head()

Run in a Scigantic notebook on 2026-10-05 against snapshots/2026-10-04/samples.parquet: Parquet 94,155 rows, 15 columns, 1 row groups; columns ['OBJECTID:int64', 'Site_Number:int64', 'Site_Description:large_string', 'Date_Sample_Collected:date32[day]', 'Date_Sample_Received:date32[day]', 'Date_Analysis:large_string', 'Date_Report:large_string', 'Monitoring_program:large_string', 'Test_.

From any machine

# Task: read the mirror from anywhere, no credentials
import pandas as pd
so = {'anon': True, 'client_kwargs': {'region_name': 'us-east-1'}}
s = pd.read_parquet('s3://scigantic-sa-open-data/hab-monitoring/samples.parquet', storage_options=so)
sites = pd.read_parquet('s3://scigantic-sa-open-data/hab-monitoring/sites.parquet', storage_options=so)
print(len(s), s.Date_Sample_Collected.max())

Lists the files with anonymous access. Runs on any machine, with no cloud account.

Data structure

File types in sampled files: Parquet, JSON

Fields

samples.OBJECTIDint64; upstream row id, 1..94155, unique; system-maintained upstream so it may change if the publisher reloads the table
samples.Site_Numberint64; joins sites.SiteNumber (99.9% resolve; 27 Karenia rows at sites not in the sites layer)
samples.Site_Descriptionstring; site name as written on the lab sheet (e.g. 'Mundoo Barrage Upstream'); prefer sites.SiteName after the join
samples.Date_Sample_Collecteddate32; 2025-03-18 .. 2026-09-24; the analysis axis
samples.Date_Sample_Receiveddate32; lab receipt date
samples.Date_Analysisstring (upstream type is string); often null
samples.Date_Reportstring 'YYYY-MM-DD' or null; latest 2026-09-25
samples.Monitoring_programstring; Metropolitan 41,816 | Regional - Yorke Peninsula 14,171 | Regional - Eyre Peninsula 10,654 | Regional -…
samples.Test_Namestring; lab batch file name e.g. '00104054_S-154_1_amended.csv' (973 distinct); groups the results of one lab run, not…
samples.Species_Groupstring or null (10% null); Dinoflagellates 43,092 | Diatoms 19,631 | Other 12,072 | Cyanoprokaryota | Cryptophytes |…
samples.Result_Namestring; taxon or summary label, 623 distinct: 'Karenia sp.' 4,751, 'Karenia spp.' 4,572, 'Karenia mikimotoi' 1,348…
samples.Result_Value_Stringstring or null; free text for non-numeric results (analyst notes such as 'The identification for this organism is…
samples.Result_Value_Numericdouble or null (13% null); cells per litre when Units == 'Cells/L'
samples.Unitsstring; 'Cells/L' on 88,991 rows, null on 5,164 (the text-only rows)
samples.Result_Labelstring; the dashboard's display text: '0 Cells/L' 48,525 | 'Detected in sample but not observed during cell counts'…
sites.OBJECTIDint64
sites.SiteNamestring; e.g. 'Largs Bay Jetty', 'Port River Dock One', 'Grange Jetty'
sites.SiteNumberint64; join key (1000001.. for program sites, 1xxxx for ad hoc)
sites.Longitude / sites.Latitudedouble; upstream attribute copies of the point
sites.lon / sites.latdouble; the feature geometry in EPSG:4326 (added by the mirror); 133.60..140.85 E, -38.06..-32.13

and 6 more

Files

/mnt/archive/  (= s3://scigantic-sa-open-data/hab-monitoring/, us-east-1, anonymous)
  README.md          provenance, column notes, licence status (1.9 KB)
  MANIFEST.json      pulledAt, upstream editingInfo dates, per-file rows/bytes/sha256, pull history (4 KB)
  samples.parquet    table 1 HarmfulAlgalBloom_SampleData, full copy, zstd, 868 KB, 94,155 rows
  sites.parquet      layer 0 HarmfulAlgalBloom_MonitoringSites, full copy, zstd, 49 KB, 858 rows
  snapshots/<YYYY-MM-DD>/samples.parquet, sites.parquet   one pair per weekly pull, never deleted (first: 2026-10-04)

Analyze this dataset without downloading it

On Scigantic, South Australian Algal Bloom Water Testing - Phytoplankton cell counts - Weekly mirror of the SA Government feature service opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Environmental Science datasets