基于Unity 3D的远程医疗系统的设计与实现

发布时间：2018-04-10 22:11

本文选题：Unity + 3D　；参考：《北京交通大学》2017年硕士论文

【摘要】：随着计算机技术、互联网技术的快速不断发展,虚拟现实技术逐渐趋向于成熟与完善,并广泛应用于生活中的各个领域。目前,虚拟现实技术已经触及到了远程医疗活动,并成为远程医疗活动中的另一种直观有效的服务形式。本文通过对远程医疗应用现状和虚拟现实技术的研究,将三维器官模型和虚拟现实技术相结合,设计并实现了一个基于Unity 3D的远程医疗系统。不同于传统的远程医疗系统,该系统的运用能够实现远距离共享三维手术画面。不同区域的医护人员只需要通过网络操作就可以实现虚拟的手术环境,不仅可以全面展示手术场景,还可以从任意方向和角度来观察,从而降低医疗费用、节省时间;该系统还能运用在医疗教学活动中,应用于手术培训、手术预演、临床诊断、医学辅助教学等环节。因此,设计远程医疗系统具有很高的实践意义和价值。本文的主要的工作成果有以下4方面:(1)研究了主流三维虚拟开发工具的功能及使用场景。对比目前主流的三维虚拟开发工具的特征与性能,选择了具有跨平台、编辑器友好、性能稳定等优势的Unity 3D作为系统的开发平台。(2)设计并实现了一个基于Unity 3D的会议系统。对于系统部署的网络环境,针对P2P网络通信特点,分析并提出NAT穿透的解决方案,并在此基础之上,设计数据分发网络,明确消息分发机制和传递途径,实现了适用于复杂网络环境的会议平台。(3)设计并实现了基于AssetBundle的画面更新机制。设计Frame同步模型,利用AssetBundle对多Prefab模型进行封装与解包,结合序列化与反序列化方法,实现画面从网络中快速更新。(4)实现了多终端下三维手术画面的实时同步。通过Unity 3D中Prefab模型将手术导航场景设置为预设并封装,生成XML配置文件,利用数据分发网络提供的通信服务,完成画面的Serialization和Deserialization,实时同步三维手术画面。本文最后采用动态测试的方法对系统进行了功能测试,设计的数据分发网络能在较复杂的网络环境下传输画面数据,转发性能上有较大提升。手术画面的同步延时在300ms左右,能满足远程医疗系统的要求。
[Abstract]:With the rapid development of computer technology and Internet technology, virtual reality technology gradually tends to mature and perfect, and is widely used in every field of life.At present, virtual reality technology has touched on telemedicine activities, and has become another kind of intuitive and effective service form in telemedicine activities.In this paper, a telemedicine system based on Unity 3D is designed and implemented based on the research of the status quo of telemedicine application and virtual reality technology, combining 3D organ model with virtual reality technology.Different from the traditional telemedicine system, the application of this system can realize long-distance sharing of three-dimensional surgical images.Doctors and nurses in different areas can realize virtual operation environment only through network operation, which can not only show the operation scene, but also can be observed from any direction and angle, so as to reduce the medical cost and save time.The system can also be used in medical teaching activities, surgery training, surgical preview, clinical diagnosis, medical assistant teaching and so on.Therefore, the design of telemedicine system has high practical significance and value.The main results of this paper are as follows: 1) the functions and usage scenarios of mainstream 3D virtual development tools are studied.Compared with the features and performance of the current mainstream 3D virtual development tools, Unity 3D, which has the advantages of cross-platform, friendly editor and stable performance, is selected as the development platform of the system and a conference system based on Unity 3D is designed and implemented.For the network environment of system deployment, according to the characteristics of P2P network communication, the solution of NAT penetration is analyzed and put forward. On this basis, the data distribution network is designed, and the message distribution mechanism and transmission path are defined.The design and implementation of AssetBundle based picture updating mechanism are presented.The Frame synchronization model is designed, the multi-#en2# model is encapsulated and unpacked by AssetBundle, and the method of serialization and deserialization is combined to realize the real-time synchronization of 3D surgical images under multiple terminals by rapidly updating the images from the network.The operation navigation scene is set to preset and encapsulated by Prefab model in Unity 3D, the XML configuration file is generated, and the communication service provided by the data distribution network is used to complete the Serialization and Deserialization of the screen and synchronize the 3D operation picture in real time.In the end, the function of the system is tested by the method of dynamic test. The designed data distribution network can transmit picture data in more complex network environment, and the forwarding performance is greatly improved.The synchronous delay of operation screen is about 300ms, which can meet the requirements of telemedicine system.
【学位授予单位】：北京交通大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP311.52

【参考文献】