# SuryaBench ARPIL: Hourly SDO/HMI Binary Maps of Active Regions and Polarity Inversion Lines (2010-2024)

## Facts

- Provider: NASA-IBM AI4Science (Surya / SuryaBench team); Jinsu Hong, Kang Yang, Berkay Aydin (Georgia State University)
- License: CC-BY-4.0 (https://huggingface.co/datasets/nasa-ibm-ai4science/surya-bench-ar-segmentation)
- Size: 7 files
- Format: CSV (in sampled files)
- Stored at: Hugging Face, https://huggingface.co/datasets/nasa-ibm-ai4science/surya-bench-ar-segmentation
- Access: public, readable without an account
- Category: Astronomy & Space
- Source: https://github.com/NASA-IMPACT/Surya
- Page: https://scigantic.com/archive/fd2824bd-24c8-53e5-a2c1-a6b58bc858b9
- Keywords: Astronomy & Space, image segmentation, heliophysics, benchmark, CSV, Hugging Face

## About

Hourly binary segmentation masks of solar active regions (ARs) and polarity inversion lines (PILs) derived from SDO Helioseismic and Magnetic Imager (HMI) line-of-sight magnetograms, released by Hong, Yang and Aydin (Georgia State University) as the segmentation task of SuryaBench, the benchmark suite for the NASA-IBM Surya heliophysics foundation model. Each HDF5 file holds a (2, 4096, 4096) full-disk array with two keys: intersection, the binary map of strong-gradient PILs, and union_with_intersect, the map of active regions that contain those PILs. There are 128,352 hourly instances from 13 May 2010 to 31 December 2024, about 53 kB each and 1.2 GB in total. Splits follow the shared SuryaBench calendar: train.csv (15 February to 31 December of 2010 to 2019), validation.csv (15 to 31 January), leaky_validation.csv (1 to 14 January and 1 to 14 February) and test.csv (all of 2020 to 2024), each indexing timestamps and file paths so masks can be paired with the Surya core SDO stack (s3://nasa-surya-bench). Intended for magnetogram segmentation, flare-precursor feature extraction and AR tracking. Read with h5py. CC-BY-4.0 as stated in the card.

## Load the data

```python
import pandas as pd
df = pd.read_csv("hf://datasets/nasa-ibm-ai4science/surya-bench-ar-segmentation/leaky_validation.csv")
df.head()
```

## Data structure

File types in sampled files: CSV

Example file: `leaky_validation.csv`

## Open it

- In a hosted notebook with the data mounted: https://scigantic.com/archive/fd2824bd-24c8-53e5-a2c1-a6b58bc858b9
- Full record as JSON (schema card included): https://api.scigantic.com/api/archives/fd2824bd-24c8-53e5-a2c1-a6b58bc858b9
- Over MCP: `get_schema_card` with id `fd2824bd-24c8-53e5-a2c1-a6b58bc858b9` at https://api.scigantic.com/mcp

## Related topics

- [CSV datasets](https://scigantic.com/topics/csv)
- [Benchmark datasets](https://scigantic.com/topics/benchmark)
- [Image segmentation datasets](https://scigantic.com/topics/image-segmentation)
- [Astronomy & Space datasets](https://scigantic.com/topics/astronomy-and-space)
- [Heliophysics datasets](https://scigantic.com/topics/heliophysics)
