# South Australian Algal Bloom Water Testing - Phytoplankton cell counts - Weekly mirror of the SA Government feature service

## Facts

- Provider: Government of South Australia (Department for Environment and Water; PIRSA/SARDI; EPA), mirrored by Scigantic
- License: Not stated by the publisher; Crown copyright, Government of South Australia. Mirrored for research use with attribution; no redistribution licence granted.
- Size: 6 objects, 1.84 MB on 2026-10-04 (two current parquet files, one dated snapshot pair, README, MANIFEST)
- Records: samples.parquet 94,155 rows (2026-10-04 pull); sites.parquet 858 rows. Growth about 650 sample rows per week
- Format: Parquet, JSON (in sampled files)
- Stored at: Amazon S3, s3://scigantic-sa-open-data/hab-monitoring (us-east-1)
- Access: public, readable without an account
- Category: Environmental Science
- Source: https://experience.arcgis.com/experience/5f0d6b22301a47bf91d198cabb030670
- Page: https://scigantic.com/archive/4459582a-9ed2-59fa-b381-0e2433c46eca
- Keywords: Environmental Science, Parquet, JSON, AWS Open Data

## About

A weekly, dated mirror of the South Australian Government's Harmful Algal Bloom Water Testing program, the public data behind the SA Algal Bloom Water Testing Open Data Dashboard. Since the Karenia mikimotoi bloom was identified off the Fleurieu Peninsula in March 2025, SARDI (offshore), the EPA (onshore) and ad hoc sampling have counted phytoplankton cells per litre at hundreds of sites: the 21 Adelaide metropolitan beaches and jetties sampled every week (Largs Bay, Grange, Henley, Glenelg, Brighton, Port River and West Lakes among them), plus Gulf St Vincent, Spencer Gulf, the Yorke and Eyre peninsulas, the Fleurieu, Kangaroo Island, the Coorong and the South East, publishing the results only through an ArcGIS feature service with no CSV and no history. Search terms people use: SA algae, algal bloom Adelaide beaches, Karenia mikimotoi, red tide, harmful algal bloom, cells per litre. This archive holds a full parquet copy of that service (94,155 result rows across 858 sites, 2025-03-18 onward, about 650 new rows a week, 623 distinct taxon and summary labels including eight spellings of Karenia), re-pulled every Monday with a snapshot kept for every pull, plus a manifest with upstream edit dates and checksums. The whole dataset is under 1 MB and reads in seconds. No licence is stated by the publisher; the data is Crown copyright, Government of South Australia, mirrored for research use with attribution.

## Load the data

```python
import os
import pyarrow.parquet as pq
pf = pq.ParquetFile(os.path.join(os.environ['SCIGANTIC_MOUNT_PATH'], 'snapshots/2026-10-04/samples.parquet'))
print(pf.metadata)
df = pf.read_row_group(0).to_pandas()
df.head()
```

Run in a Scigantic notebook on 2026-10-05 against `snapshots/2026-10-04/samples.parquet`: Parquet 94,155 rows, 15 columns, 1 row groups; columns ['OBJECTID:int64', 'Site_Number:int64', 'Site_Description:large_string', 'Date_Sample_Collected:date32[day]', 'Date_Sample_Received:date32[day]', 'Date_Analysis:large_string', 'Date_Report:large_string', 'Monitoring_program:large_string', 'Test_.

From any machine:

```python
# Task: read the mirror from anywhere, no credentials
import pandas as pd
so = {'anon': True, 'client_kwargs': {'region_name': 'us-east-1'}}
s = pd.read_parquet('s3://scigantic-sa-open-data/hab-monitoring/samples.parquet', storage_options=so)
sites = pd.read_parquet('s3://scigantic-sa-open-data/hab-monitoring/sites.parquet', storage_options=so)
print(len(s), s.Date_Sample_Collected.max())
```

Lists the files with anonymous access. Runs on any machine, with no cloud account.

## Data structure

File types in sampled files: Parquet, JSON

| Field | Type |
| --- | --- |
| `samples.OBJECTID` | int64; upstream row id, 1..94155, unique; system-maintained upstream so it may change if the publisher reloads the table |
| `samples.Site_Number` | int64; joins sites.SiteNumber (99.9% resolve; 27 Karenia rows at sites not in the sites layer) |
| `samples.Site_Description` | string; site name as written on the lab sheet (e.g. 'Mundoo Barrage Upstream'); prefer sites.SiteName after the join |
| `samples.Date_Sample_Collected` | date32; 2025-03-18 .. 2026-09-24; the analysis axis |
| `samples.Date_Sample_Received` | date32; lab receipt date |
| `samples.Date_Analysis` | string (upstream type is string); often null |
| `samples.Date_Report` | string 'YYYY-MM-DD' or null; latest 2026-09-25 |
| `samples.Monitoring_program` | string; Metropolitan 41,816 \| Regional - Yorke Peninsula 14,171 \| Regional - Eyre Peninsula 10,654 \| Regional -… |
| `samples.Test_Name` | string; lab batch file name e.g. '00104054_S-154_1_amended.csv' (973 distinct); groups the results of one lab run, not… |
| `samples.Species_Group` | string or null (10% null); Dinoflagellates 43,092 \| Diatoms 19,631 \| Other 12,072 \| Cyanoprokaryota \| Cryptophytes \|… |
| `samples.Result_Name` | string; taxon or summary label, 623 distinct: 'Karenia sp.' 4,751, 'Karenia spp.' 4,572, 'Karenia mikimotoi' 1,348… |
| `samples.Result_Value_String` | string or null; free text for non-numeric results (analyst notes such as 'The identification for this organism is… |
| `samples.Result_Value_Numeric` | double or null (13% null); cells per litre when Units == 'Cells/L' |
| `samples.Units` | string; 'Cells/L' on 88,991 rows, null on 5,164 (the text-only rows) |
| `samples.Result_Label` | string; the dashboard's display text: '0 Cells/L' 48,525 \| 'Detected in sample but not observed during cell counts'… |
| `sites.OBJECTID` | int64 |
| `sites.SiteName` | string; e.g. 'Largs Bay Jetty', 'Port River Dock One', 'Grange Jetty' |
| `sites.SiteNumber` | int64; join key (1000001.. for program sites, 1xxxx for ad hoc) |
| `sites.Longitude / sites.Latitude` | double; upstream attribute copies of the point |
| `sites.lon / sites.lat` | double; the feature geometry in EPSG:4326 (added by the mirror); 133.60..140.85 E, -38.06..-32.13 |

and 6 more fields

Files:

```text
/mnt/archive/  (= s3://scigantic-sa-open-data/hab-monitoring/, us-east-1, anonymous)
  README.md          provenance, column notes, licence status (1.9 KB)
  MANIFEST.json      pulledAt, upstream editingInfo dates, per-file rows/bytes/sha256, pull history (4 KB)
  samples.parquet    table 1 HarmfulAlgalBloom_SampleData, full copy, zstd, 868 KB, 94,155 rows
  sites.parquet      layer 0 HarmfulAlgalBloom_MonitoringSites, full copy, zstd, 49 KB, 858 rows
  snapshots/<YYYY-MM-DD>/samples.parquet, sites.parquet   one pair per weekly pull, never deleted (first: 2026-10-04)
```

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/4459582a-9ed2-59fa-b381-0e2433c46eca
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/4459582a-9ed2-59fa-b381-0e2433c46eca
- Over MCP: `get_schema_card` with id `4459582a-9ed2-59fa-b381-0e2433c46eca` at https://api.scigantic.com/mcp

## Related topics

- [Parquet datasets](https://scigantic.com/topics/parquet)
- [JSON datasets](https://scigantic.com/topics/json)
- [Environmental Science datasets](https://scigantic.com/topics/environmental-science)
