增强现实手术导航系统的设计与应用研究

发布时间：2018-01-31 23:06

本文关键词： 增强现实多模态影像手术导航谷歌眼镜 HoloLens　出处：《中国科学技术大学》2017年硕士论文　论文类型：学位论文

【摘要】：医学影像对疾病的检查与诊断起着重要作用。临床上常使用医学影像进行检查或诊断,实际临床治疗过程中,手术医生经常要在手术场景与图像显示屏之间来回切换视线,这在实际手术过程中会影响医生的正常操作。增强现实技术有解决这个问题的潜在能力,因此我们以乳腺癌病人的前哨淋巴结定位和整形手术为临床需求,以增强现实眼镜为基础,开发出两套增强现实手术导航系统,并分析其参数,实验验证其可行性。论文的主要研究内容如下:搭建一套基于谷歌眼镜的增强现实双模态影像导航系统,本系统包括一个CCD荧光相机、一个超声检测仪、一个LED激发光源、一个谷歌眼镜及一个数据处理电脑。电脑在获得荧光图像信息或超声信息后,根据谷歌眼镜的反馈,选择一种处理好的影像以WIFI传输的方式传输到谷歌眼镜。谷歌眼镜可以根据需要显示超声或荧光信息,实现双模态图像实时融合现实显示。通过琼脂仿体、离体乳腺组织、在体乳腺癌病人等的试验,说明本系统能通过荧光与超声两个模态的影像协助定位前哨淋巴结,为医生定位、切除乳腺癌病人前哨淋巴结提供精确导航。搭建一套基于HoloLens的增强现实影像导航系统,本系统包括一个Kinect、一个信息处理电脑和一个HoloLens。Kinect扫描获得的三维点云信息,通过电脑处理这些图像信息,获得模型各种参数。再将模型传输到HoloLens端,佩戴HoloLens后通过手势与语音控制实现三维模型在空间中的移动与配准。通过本系统模拟指导橡皮泥乳房的整形过程验证其导航效果。通过仿体实验与临床实验,我们初步验证了两套手术导航系统对乳腺癌病人前哨淋巴结定位与整形手术方面的指导作用,进一步说明这两套系统可以对乳腺癌病人手术提供精确指导。
[Abstract]:Medical imaging plays an important role in the examination and diagnosis of diseases. Surgeons often have to switch line of sight between the operation scene and the image display screen, which will affect the normal operation of doctors in the actual operation. Augmented reality technology has the potential to solve this problem. Therefore, we take the sentinel lymph node location and plastic surgery of breast cancer patients as the clinical needs, based on augmented reality glasses, we developed two sets of augmented reality surgery navigation system, and analyzed its parameters. The main contents of this paper are as follows: build an augmented reality bimodal image navigation system based on Google Glass. This system includes a CCD fluorescence camera and an ultrasonic detector. A LED excitation light source, a Google Glass, and a data processing computer. After obtaining fluorescent image information or ultrasonic information, the computer feedback from Google Glass. Select a processed image to be transmitted to Google Glass via WIFI. Goggles can display ultrasonic or fluorescent information as needed. To realize the realtime fusion of bimodal images. Through Agar imitating body, in vitro breast tissue, in vivo breast cancer patients, and so on. It shows that the system can help locate the sentinel lymph nodes by using two modes of fluorescence and ultrasound. The sentinel lymph nodes of breast cancer patients were resected to provide accurate navigation. An augmented reality image navigation system based on HoloLens was built. This system includes a Kinect. An information processing computer and a HoloLens.Kinect scan to obtain three-dimensional point cloud information, through the computer processing of these image information. Get the various parameters of the model. Then transfer the model to the HoloLens side. After wearing HoloLens, the movement and registration of 3D model in space are realized by gesture and voice control. The navigation effect is verified by simulating and guiding the plastic process of the puree breast. And clinical trials. We have preliminarily verified the guiding effect of two sets of surgical navigation systems on sentinel lymph node location and plastic surgery in breast cancer patients. It is further demonstrated that these two systems can provide accurate guidance for breast cancer patients.
【学位授予单位】：中国科学技术大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：R61;TP391.41

【相似文献】