HPRC Release 2 IMPG All-vs-All Haplotype Alignments (PAF/TPA)

Provider
Human Pangenome Reference Consortium (HPRC) / pangenome team
License
CC0-1.0 (source)
Stored at
Amazon S3, s3://human-pangenomics/pangenomes/freeze/release2/impg (us-west-2)
Access
Free and public. No account with the data provider is needed.
Category
Genomics & Bioinformatics
Source
https://github.com/human-pangenomics/hpp_pangenome_resources

About HPRC Release 2 IMPG All-vs-All Haplotype Alignments (PAF/TPA)

The all-vs-all whole-genome alignment that underlies the HPRC Release 2 PGGB graphs, published separately for IMPG (implicit pangenome graph), a tool that queries homologous regions across many assemblies by projecting through pairwise alignments without building a graph. Alignments cover the year-2 HPRC phased haplotype assemblies (232 individuals) plus the GRCh38 and CHM13 references. The release has two layers: pafs/ holds the all-vs-all alignment as a single gzipped PAF (minimap2-style pairwise alignment format with CIGAR) and a separate PAF of all 465 haplotypes aligned to GRCh38; tpas/ holds the same alignments in IMPG's compact TPA format, one file per haplotype (466 files). Typical uses are extracting all haplotype sequences homologous to a gene or locus (impg query), building local graphs for a region with pggb, or computing pairwise similarity between assemblies. Read PAF with any text tool or pafpy; TPA requires impg. Released CC0 1.0 by the Human Pangenome Reference Consortium; cite the HPRC2 preprint.

How to access HPRC Release 2 IMPG All-vs-All Haplotype Alignments (PAF/TPA) in Python

import boto3
from botocore import UNSIGNED
from botocore.client import Config
s3 = boto3.client('s3', region_name='us-west-2', config=Config(signature_version=UNSIGNED))
s3.list_objects_v2(Bucket='human-pangenomics', Prefix='pangenomes/freeze/release2/impg/', Delimiter='/')

Lists the files with anonymous access. Runs on any machine, with no cloud account.

Data structure

Files

Example file: pangenomes/freeze/release2/impg/pafs/all-vs-1/GCA_000001405.15_GRCh38_no_alt_analysis_set.PanSN.merged.paf.gz

Analyze this dataset without downloading it

On Scigantic, HPRC Release 2 IMPG All-vs-All Haplotype Alignments (PAF/TPA) opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.

This page is also available as Markdown and as JSON.

Related Genomics & Bioinformatics datasets