Polina Golland, PhD
Professor of Electrical Engineering and Computer Science
PI in the Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology
Title: Learning to Read X-Ray: Applications to Heart Failure Monitoring
Abstract: We propose and demonstrate a novel approach to training image classification models based on large collections of images with limited labels. We take advantage of availability of radiology reports to construct joint multimodal embedding that serves as a basis for classification. We demonstrate the advantages of this approach in application to assessment of pulmonary edema severity in congestive heart failure that motivated the development of the method.