模拟训练系统声音信号处理与交互技术研究

发布时间：2018-05-16 03:33

本文选题：模拟训练 + Unity3D　；参考：《沈阳理工大学》2017年硕士论文

【摘要】：模拟训练系统解决了许多传统军事训练演习中的限制和弊端,国内外已把它当做提高军事实力的一种重要手段,得到迅猛发展和普遍应用。虚拟现实系统是模拟训练系统的一种重要解决方案。人机交互是虚拟现实技术的重要内容,在仿真系统中,用户可以通过一系列方式和交互设备,与虚拟世界进行自然的交互。区别于传统人机交互方式,利用声音信息进行交互可提供附加的听觉反馈通道,丰富用户交互体验,将填补虚拟现实系统输入方式的空白。Unity3D是一个可以创建三维视频游戏、建筑可视化、实时三维动画等类型互动内容的综合型游戏引擎,其本身不具备高级人机声音交互功能。Kinect是与Xbox360游戏机配套使用的一款外设,内置四元线性非对称麦克风阵列,可以根据各麦克风接收到声音信号的时延差,计算出声源方位与角度。从开发模拟训练系统所涉及到的虚拟现实技术、人机交互技术、包括声源定位技术和语音增强技术的语音信号处理技术等出发,重点研究了声音定位输入技术,突破了传统虚拟现实系统输入方式的限制,填补了模拟训练系统输入的空白,实现了模拟训练系统中的声音信号处理与交互技术的设计。利用Unity3D引擎开发了一个模拟射击枪战的虚拟地形训练系统场景,经过Kinect体感设备的麦克风阵列进行声音采集,实现系统对声源方位的分辨,同时使用双声道噪声对消技术,对采集数据进行滤波除噪,从而提高定位性能和精度。自行设计了动态链接库DLL,实现了Unity3D引擎和Kinect的接口和数据融合。
[Abstract]:Simulation training system has solved many limitations and drawbacks in traditional military training exercises. It has been regarded as an important means to improve military strength and has been rapidly developed and widely applied at home and abroad. Virtual reality system is an important solution of simulation training system. Human-computer interaction is an important part of virtual reality technology. In the simulation system, users can interact with the virtual world through a series of ways and interactive devices. Different from the traditional human-computer interaction mode, using the sound information to interact can provide additional auditory feedback channel, enrich the user interaction experience, will fill in the blank of virtual reality system input mode. Unity3D is a 3D video game that can be created. The integrated game engine of architectural visualization, real-time 3D animation and other types of interactive content does not have advanced human-computer sound interaction function. Kinect is a peripheral device used with Xbox360 game console, and has a four-element linear asymmetric microphone array. The direction and angle of sound source can be calculated according to the delay difference of sound signal received by each microphone. Based on the virtual reality technology, human-computer interaction technology, including sound source location technology and speech signal processing technology, this paper focuses on the sound location input technology. It breaks through the limitation of traditional virtual reality system input method, fills the blank of analog training system input, and realizes the design of sound signal processing and interaction technology in analog training system. A virtual terrain training system scene is developed by using Unity3D engine, which simulates shooting gun battle. The scene is collected by microphone array of Kinect somatosensory equipment to realize the resolution of sound source azimuth. At the same time, dual-channel noise cancellation technology is used. Filtering and denoising the collected data to improve the positioning performance and accuracy. The dynamic link library DLL is designed, and the interface and data fusion between Unity3D engine and Kinect are realized.
【学位授予单位】：沈阳理工大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TN912.3

【参考文献】