Back to articles
Volume: 33 | Article ID: art00011
Breast Cancer Tissue Sub-Region Classification from Second Harmonic Generation Imagery via Machine Learning
  DOI :  10.2352/ISSN.2470-1173.2021.10.IPAS-247  Published OnlineJanuary 2021

Cancer treatment involves complex decision-making processes. A better understanding of recurrence risk at diagnosis, as well as prediction of treatment response (e.g., to choose the most cost-effective treatment path in an informed manner) are needed to produce the best possible outcomes at the patient level. Prior work shows that the forward/backward (F/B) ratio calculated from Second Harmonic Generation (SHG) imagery can be indicative of risk of recurrence if relevant tissue sub-regions are selected. The choice of which sub-regions to image is currently made by human experts, which is subjective and labor intensive. In this paper, we investigate machine learning methods to automatically identify tissue sub-regions that are most relevant to the prediction of breast cancer recurrence. We formulate the task as a multi-class classification problem and use support vector machine (SVM) classifiers as the inference engine. Given the limited amount of data available, we focus on exploring the feature extraction stage. To that end, we evaluate methods leveraging handcrafted features, deep features extracted from pre-trained models, as well as features extracted via transfer learning. The results show a steady trend of improvement on the classification accuracy as the features become more data-driven and customized to the task at hand. This is an indication that having larger amounts of labeled data could be beneficial for improving automated methods of classification. The best results achieved, using features learned via transfer learning from ResNet-101, correspond to 85% accuracy in a 3-class problem and 94% accuracy in a binary classification problem.

Subject Areas :
Views 23
Downloads 4
 articleview.views 23
 articleview.downloads 4
  Cite this article 

Wencheng Wu, Beilei Xu, Edgar A. Bernal, Robert L. Hill, Danielle Desa, Edward B. Brown, "Breast Cancer Tissue Sub-Region Classification from Second Harmonic Generation Imagery via Machine Learningin Proc. IS&T Int’l. Symp. on Electronic Imaging: Image Processing: Algorithms and Systems XIX,  2021,  pp 247-1 - 247-6,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2021
Electronic Imaging
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane Springfield, VA 22151 USA