Technique for registering 3D virtual CT images to endoscopic video

J. P. Helferty, William Evan Higgins

Research output: Chapter in Book/Report/Conference proceedingConference contribution

42 Scopus citations


We present a multi-modal image registration technique that matches virtual surface renderings, derived from 3D medical data, to corresponding endoscopic video. Our efforts focus on the chest. The views of the two image sources arise from inside the major bronchial airways, as shown in 3D CT chest images and live endoscopic video. Our technique is part of a large system for two-stage assessment of lung cancer. Stage-1 involves 3D CT assessment, which gives planning data for endoscopy. Stage-2 involves live endoscopy, supplemented by CT-based guidance. The registration technique is a critical component of this assessment. The technique draws upon the concept of normalized mutual information (NMI) and works in near real time on standard PCs. An optimization procedure iteratively adjusts the virtual viewpoint rendering until it matches a given video frame's viewpoint. The optimization technique ends when the NMI is maximized. Results are given for phantom and human cases.

Original languageEnglish (US)
Title of host publicationIEEE International Conference on Image Processing
Number of pages4
StatePublished - 2001
EventIEEE International Conference on Image Processing (ICIP) - Thessaloniki, Greece
Duration: Oct 7 2001Oct 10 2001


OtherIEEE International Conference on Image Processing (ICIP)

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Electrical and Electronic Engineering


Dive into the research topics of 'Technique for registering 3D virtual CT images to endoscopic video'. Together they form a unique fingerprint.

Cite this