Calibration of Optical See-Through Head Mounted Display with Mobile C-arm for Visualization of Cone Beam CT Data
Embargo until
Date
2017-04-28
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Johns Hopkins University
Abstract
This work proposes the visualization of Cone-Beam Computed Tomography (CBCT) volumes in situ via the Microsoft Hololens, an optical see-through Head-Mounted Display (HMD). The data is visualized in the display as virtual objects, or holograms. Such holograms allow the CBCT volume to be overlaid on the patient at the site where the data was acquired. This is useful in orthopedic surgeries due to the nature of the CBCT scans of interest. A known visual marker is tracked using both the Hololens and the RGBD (Red Green Blue Depth) optical camera rigidly mounted and calibrated to the C-arm. By combining the transformations, the calibration defines the spatial relationship between the HMD and the C-arm. The calibration process and visualization have been confirmed and enable advanced visualization of CBCT data for orthopedic surgery. The hardware capabilities of the Hololens currently limit the quality of the volume rendered and the precision of the calibration. However, future improvements to each component have been identified and with the ever-improving technology of HMDs, this limitation is only a temporary barrier to clinical usage.
Description
Keywords
HMD, C-arm, Calibration, Volume rendering, CBCT