IBIIS & AIMI Seminar: Learning to Read X-Ray: Applications to Heart Failure Monitoring

October 19, 2022 @ 12:00 pm – 1:00 pm
ZOOM: https://stanford.zoom.us/j/93555578704?pwd=eTdhRHM4K0w5WGVmSElSWGkzN3VqQT09
Ramzi Totah

Polina Golland, PhD
Professor of Electrical Engineering and Computer Science
PI in the Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology

Title: Learning to Read X-Ray: Applications to Heart Failure Monitoring

Abstract: We propose and demonstrate a novel approach to training image classification models based on large collections of images with limited labels. We take advantage of availability of radiology reports to construct joint multimodal embedding that serves as a basis for classification. We demonstrate the advantages of this approach in application to assessment of pulmonary edema severity in congestive heart failure that motivated the development of the method.