Cross-modal contrastive learning for unified placenta analysis using photographs

Yimu Pan, Manas Mehta, Jeffery A. Goldstein, Joseph Ngonzi, Lisa M. Bebell, Drucilla J. Roberts, Chrystalle Katte Carreon, Kelly Gallagher, Rachel E. Walker, Alison D. Gernand, James Wang

Research output: Contribution to journalArticlepeer-review

Abstract

The placenta is vital to maternal and child health but often overlooked in pregnancy studies. Addressing the need for a more accessible and cost-effective method of placental assessment, our study introduces a computational tool designed for the analysis of placental photographs. Leveraging images and pathology reports collected from sites in the United States and Uganda over a 12-year period, we developed a cross-modal contrastive learning algorithm consisting of pre-alignment, distillation, and retrieval modules. Moreover, the proposed robustness evaluation protocol enables statistical assessment of performance improvements, provides deeper insight into the impact of different features on predictions, and offers practical guidance for its application in a variety of settings. Through extensive experimentation, our tool demonstrates an average area under the receiver operating characteristic curve score of over 82% in both internal and external validations, which underscores the potential of our tool to enhance clinical care across diverse environments.

Original languageEnglish (US)
Article number101097
JournalPatterns
Volume5
Issue number12
DOIs
StatePublished - Dec 13 2024

All Science Journal Classification (ASJC) codes

  • General Decision Sciences

Fingerprint

Dive into the research topics of 'Cross-modal contrastive learning for unified placenta analysis using photographs'. Together they form a unique fingerprint.

Cite this