Academics | The Hong Kong University of Science and Technology

Pivot:Enhancing Pathology Image-Text Alignment with a Pathology Knowledge Base
Hanlin Long
Hanlin Long
Pivot:Enhancing Pathology Image-Text Alignment with a Pathology Knowledge Base
P ivot aligns pathological images, pathological ontologies, and text. First, identify pathological terms within pathological images. Then, use their explanations as additional information for captions to enrich the text in image-text alignment. This enables more accurate semantic capture and helps pathological CLIP-like models achieve stronger zero-shot performance.