The optical interface for augmented reality in computer-assisted navigation and 3D visualization in surgery

Project number: Research project P 12464 Project title: The Optical Interface for Computer-Assisted Surgery ABSTRACT OF THE PROJECT The basic goal of this two-year project is to provide x-ray vision for the surgeon. Preoperative x-ray, CT, MR and nuclear medicine images will be presented on mini-monitors and inserted transparently into the field of vision in such a way that the surgeon can "see inside" the patient during the operation. Three-dimensional objects (e.g. tumors) generated from the patient images have to be superimposed on the surgeons view of the patient in such a manner that they appear to belong to the real world. This will facilitate surgical navigation and reduce distress for the patient. The project is confined for the time being to applications in maxillo-facial and ENT surgery. The so-called head-mounted display (HMD), which takes the shape of a helmet or bulky "sun glasses", was used already in previous research. The HMD was regarded a fixed system without trying to influence its performance. In contrast to "virtual reality" applications using closed-view helmets, surgery requires eye contact with the surrounding real environment. This is called "augmented reality". This project is concerned with the optical interface combining the images and 3-D objects with the surgeons view of the real world. In the case of the HMD, there is one such interface in front of each eye. In contrast to previous research we focus on the interface with respect to image quality and overlay techniques. This will open up a further range of applications in surgery. The principal aim of the project its, firstly, to develop and construct a flange combining the optical and miniaturized computer display components in an optimized interface which can flexibly be attached to binocular magnifying glasses, HMDs, endoscopes and surgical stereo microscopes. Secondly, we will examine and optimize the optical properties of the interface with respect to the fusion of the real world view with digital images.