Character Similarity Dataset: Phenoscape Ontology Trait Descriptions and Pairwise Semantic Similarity for Fishes and Vertebrates
- Provider
- Imageomics Institute (Jim Balhoff, Soumyashree Kar, Juan Garcia, Hilmar Lapp)
- License
- CC-BY-3.0 (source)
- Size
- 24 files
- Format
- TSV (in sampled files)
- Stored at
- Hugging Face (https://huggingface.co/datasets/imageomics/char-sim-data)
- Access
- Free and public. No account with the data provider is needed.
- DOI
- 10.57967/hf/6891
- Category
- Genomics & Bioinformatics
- Source
- https://huggingface.co/datasets/imageomics/char-sim-data
About this dataset
About 19,000 textual descriptions of anatomical traits (phenotypic characters) of fishes and other vertebrates, taken from the Phenoscape Knowledgebase, paired with ontology-based semantic similarity scores between trait descriptions (maxIC, Jaccard and SimGIC). The Phenoscape Knowledgebase is built on OBO ontologies, chiefly the Uberon anatomy ontology, so the scores measure how close two phenotype annotations are in ontology space. The dataset was built to train and evaluate text encoders that align free-text character descriptions with ontological similarity; the reference model Trait2Vec reaches a Spearman correlation of 0.7057 on the test set. raw-source/ holds the Phenoscape build files phenex-data-merged.ofn.gz (OWL functional syntax) and phenoscape-kb-tbox-classified.ttl.gz (Turtle); processed-data/ holds gzipped TSV pair tables split into training, all-non-train and non-overlap sets (80 percent training) for four fish orders (Characiformes, Cypriniformes, Gymnotiformes, Siluriformes) and their union. About 41 GB. Licensed CC BY 3.0 by the Imageomics Institute; cite the dataset (Balhoff, Kar, Garcia, Lapp, doi:10.57967/hf/6891) and Phenoscape.
How to load this dataset in Python
from huggingface_hub import hf_hub_download
path = hf_hub_download(repo_id="imageomics/char-sim-data", filename="processed-data/all/data_10p_ALL_NON_TRAIN.tsv.gz", repo_type="dataset")
print(path)Data structure
File types in sampled files: TSV
Files
Example file: processed-data/all/data_10p_ALL_NON_TRAIN.tsv.gz
Analyze this dataset without downloading it
On Scigantic, Character Similarity Dataset: Phenoscape Ontology Trait Descriptions and Pairwise Semantic Similarity for Fishes and Vertebrates opens in a hosted JupyterLab notebook with the data already mounted, so you can read files where they are stored instead of copying them first. Each notebook includes an AI assistant that can see the mounted files and write and run analysis code. Open the dataset page to launch a notebook, or browse the full catalog.
This page is also available as Markdown and as JSON.
Related Genomics & Bioinformatics datasets
- TCGA-ESCA Esophageal Carcinoma (GDC open-access tables, 185 cases)
- UniProt
- Inferelator Saccharomyces Cerevisiae Single-Cell Data Set
- Supplemental data for "The genome of a sea spider corroborates a shared Hox cluster motif in arthropods with reduced posterior tagma"
- Genomic Characterization of Metastatic Castration Resistant Prostate Cancer
- OpenCRAVAT
- UK Biobank Linkage Disequilibrium Matrices
- Genomic-NIAH: needle-in-a-haystack long-context retrieval benchmark for DNA language models