Vision-Language Models for Feature Detection of Macular Diseases on Optical Coherence Tomography.

ABSTRACT:

Importance

Vision-language models (VLMs) are a novel artificial intelligence technology capable of processing image and text inputs. While demonstrating strong generalist capabilities, their performance in ophthalmology has not been extensively studied.

Objective

To assess the performance of the Gemini Pro VLM in expert-level tasks for macular diseases from optical coherence tomography (OCT) scans.

Design, setting, and participants

This was a cross-sectional diagnostic accuracy study evaluating a generalist VLM on ophthalmology-specific tasks using the open-source Optical Coherence Tomography Image Database. The dataset included OCT B-scans from 50 unique patients: healthy individuals and those with macular hole, diabetic macular edema, central serous chorioretinopath

SUBMITTER: Antaki F 

PROVIDER: S-EPMC11066758 | biostudies-literature | 2024 Jun

REPOSITORIES: biostudies-literature