South Australian Algal Bloom Water Testing - Phytoplankton cell counts - Weekly mirror of the SA Government feature service
- Provider
- Government of South Australia (Department for Environment and Water; PIRSA/SARDI; EPA), mirrored by Scigantic
- License
- Not stated by the publisher; Crown copyright, Government of South Australia. Mirrored for research use with attribution; no redistribution licence granted.
- Size
- 6 objects, 1.84 MB on 2026-10-04 (two current parquet files, one dated snapshot pair, README, MANIFEST)
- Records
- samples.parquet 94,155 rows (2026-10-04 pull); sites.parquet 858 rows. Growth about 650 sample rows per week
- Format
- Parquet, JSON (in sampled files)
- Stored at
- Amazon S3, s3://scigantic-sa-open-data/hab-monitoring (us-east-1)
- Access
- Free and public. No account with the data provider is needed.
- Category
- Environmental Science
- Source
- https://experience.arcgis.com/experience/5f0d6b22301a47bf91d198cabb030670
About this dataset
A weekly, dated mirror of the South Australian Government's Harmful Algal Bloom Water Testing program, the public data behind the SA Algal Bloom Water Testing Open Data Dashboard. Since the Karenia mikimotoi bloom was identified off the Fleurieu Peninsula in March 2025, SARDI (offshore), the EPA (onshore) and ad hoc sampling have counted phytoplankton cells per litre at hundreds of sites: the 21 Adelaide metropolitan beaches and jetties sampled every week (Largs Bay, Grange, Henley, Glenelg, Brighton, Port River and West Lakes among them), plus Gulf St Vincent, Spencer Gulf, the Yorke and Eyre peninsulas, the Fleurieu, Kangaroo Island, the Coorong and the South East, publishing the results only through an ArcGIS feature service with no CSV and no history. Search terms people use: SA algae, algal bloom Adelaide beaches, Karenia mikimotoi, red tide, harmful algal bloom, cells per litre. This archive holds a full parquet copy of that service (94,155 result rows across 858 sites, 2025-03-18 onward, about 650 new rows a week, 623 distinct taxon and summary labels including eight spellings of Karenia), re-pulled every Monday with a snapshot kept for every pull, plus a manifest with upstream edit dates and checksums. The whole dataset is under 1 MB and reads in seconds. No licence is stated by the publisher; the data is Crown copyright, Government of South Australia, mirrored for research use with attribution.
How to load this dataset in Python
import os
import pyarrow.parquet as pq
pf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'snapshots/2026-10-04/samples.parquet'))
print(pf.metadata)
df = pf.read_row_group(0).to_pandas()
df.head()Run in a Scigantic notebook on 2026-10-05 against snapshots/2026-10-04/samples.parquet: Parquet 94,155 rows, 15 columns, 1 row groups; columns ['OBJECTID:int64', 'Site_Number:int64', 'Site_Description:large_string', 'Date_Sample_Collected:date32[day]', 'Date_Sample_Received:date32[day]', 'Date_Analysis:large_string', 'Date_Report:large_string', 'Monitoring_program:large_string', 'Test_.
From any machine
# Task: read the mirror from anywhere, no credentials
import pandas as pd
so = {'anon': True, 'client_kwargs': {'region_name': 'us-east-1'}}
s = pd.read_parquet('s3://scigantic-sa-open-data/hab-monitoring/samples.parquet', storage_options=so)
sites = pd.read_parquet('s3://scigantic-sa-open-data/hab-monitoring/sites.parquet', storage_options=so)
print(len(s), s.Date_Sample_Collected.max())Lists the files with anonymous access. Runs on any machine, with no cloud account.
Data structure
File types in sampled files: Parquet, JSON
Fields
samples.OBJECTID | int64; upstream row id, 1..94155, unique; system-maintained upstream so it may change if the publisher reloads the table |
samples.Site_Number | int64; joins sites.SiteNumber (99.9% resolve; 27 Karenia rows at sites not in the sites layer) |
samples.Site_Description | string; site name as written on the lab sheet (e.g. 'Mundoo Barrage Upstream'); prefer sites.SiteName after the join |
samples.Date_Sample_Collected | date32; 2025-03-18 .. 2026-09-24; the analysis axis |
samples.Date_Sample_Received | date32; lab receipt date |
samples.Date_Analysis | string (upstream type is string); often null |
samples.Date_Report | string 'YYYY-MM-DD' or null; latest 2026-09-25 |
samples.Monitoring_program | string; Metropolitan 41,816 | Regional - Yorke Peninsula 14,171 | Regional - Eyre Peninsula 10,654 | Regional -… |
samples.Test_Name | string; lab batch file name e.g. '00104054_S-154_1_amended.csv' (973 distinct); groups the results of one lab run, not… |
samples.Species_Group | string or null (10% null); Dinoflagellates 43,092 | Diatoms 19,631 | Other 12,072 | Cyanoprokaryota | Cryptophytes |… |
samples.Result_Name | string; taxon or summary label, 623 distinct: 'Karenia sp.' 4,751, 'Karenia spp.' 4,572, 'Karenia mikimotoi' 1,348… |
samples.Result_Value_String | string or null; free text for non-numeric results (analyst notes such as 'The identification for this organism is… |
samples.Result_Value_Numeric | double or null (13% null); cells per litre when Units == 'Cells/L' |
samples.Units | string; 'Cells/L' on 88,991 rows, null on 5,164 (the text-only rows) |
samples.Result_Label | string; the dashboard's display text: '0 Cells/L' 48,525 | 'Detected in sample but not observed during cell counts'… |
sites.OBJECTID | int64 |
sites.SiteName | string; e.g. 'Largs Bay Jetty', 'Port River Dock One', 'Grange Jetty' |
sites.SiteNumber | int64; join key (1000001.. for program sites, 1xxxx for ad hoc) |
sites.Longitude / sites.Latitude | double; upstream attribute copies of the point |
sites.lon / sites.lat | double; the feature geometry in EPSG:4326 (added by the mirror); 133.60..140.85 E, -38.06..-32.13 |
and 6 more
Files
/mnt/archive/ (= s3://scigantic-sa-open-data/hab-monitoring/, us-east-1, anonymous)
README.md provenance, column notes, licence status (1.9 KB)
MANIFEST.json pulledAt, upstream editingInfo dates, per-file rows/bytes/sha256, pull history (4 KB)
samples.parquet table 1 HarmfulAlgalBloom_SampleData, full copy, zstd, 868 KB, 94,155 rows
sites.parquet layer 0 HarmfulAlgalBloom_MonitoringSites, full copy, zstd, 49 KB, 858 rows
snapshots/<YYYY-MM-DD>/samples.parquet, sites.parquet one pair per weekly pull, never deleted (first: 2026-10-04)
Analyze this dataset without downloading it
On Scigantic, South Australian Algal Bloom Water Testing - Phytoplankton cell counts - Weekly mirror of the SA Government feature service opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Environmental Science datasets
- Japanese Farmland Parcel Polygons
- FireFusion WA 1000m
- Archival Tag Depth and Temperature Records from Eastern Bering Sea Red King Crab, 2009-2010
- Biome Health Project Maasai Mara 2018
- SWAN Ocean Surface Wave Hindcast 1979-2020, US East Coast, Gulf of Mexico, Puerto Rico and US Virgin Islands (raw model output)
- Archival Tag Depth and Temperature Records from Eastern Bering Sea Snow Crab, 2010-2012
- USGS National Hydrography
- InsectSet459: 26,399 audio recordings of 459 Orthoptera and Cicadidae species