Pivot:Enhancing Pathology Image-Text Alignment with a Pathology Knowledge Base
Hanlin Long
P
ivot aligns pathological images, pathological ontologies, and text. First, identify pathological terms within pathological images. Then, use their explanations as additional information for captions to enrich the text in image-text alignment. This enables more accurate semantic capture and helps pathological CLIP-like models achieve stronger zero-shot performance.
cao@ust.hk | HKUST(GZ) Medical Data Intelligence Laboratory