Back to articles
Articles
Volume: 29 | Article ID: art00007
Image
Finding a Needle in a Haystack: Recognizing Surgical Instruments through Vision and Manipulation
  DOI :  10.2352/ISSN.2470-1173.2017.9.IRIACV-264  Published OnlineJanuary 2017
Abstract

This paper presents an accurate and robust surgical instrument recognition algorithm to be used as part of a Robotic Scrub Nurse (RSN). Surgical instruments are often cluttered, occluded and displaying specular light, which cause a challenge for conventional vision algorithms. A learning-through-interaction paradigm was proposed to tackle this challenge. The approach combines computer vision with robot manipulation to achieve active recognition. The unknown instrument is firstly segmented out as blobs and its poses estimated, then the RSN system picks it up and presents it to an optical sensor in an established pose. Lastly the unknown instrument is recognized with high confidence. Experiments were conducted to evaluate the performance of the proposed segmentation and recognition algorithms, respectively. It is found out that the proposed patch-based segmentation algorithm and the instrument recognition algorithm greatly outperform their benchmark comparisons. Such results indicate the applicability and effectiveness of our RSN system in performing accurate and robust surgical instrument recognition.

Subject Areas :
Views 30
Downloads 5
 articleview.views 30
 articleview.downloads 5
  Cite this article 

Tian Zhou, Juan P. Wachs, "Finding a Needle in a Haystack: Recognizing Surgical Instruments through Vision and Manipulationin Proc. IS&T Int’l. Symp. on Electronic Imaging: Intelligent Robotics and Industrial Applications using Computer Vision,  2017,  pp 37 - 45,  https://doi.org/10.2352/ISSN.2470-1173.2017.9.IRIACV-264

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2017
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology