基于MEMS传感器的虚拟现实射击识别设备与系统

发布时间：2018-04-30 10:51

本文选题：虚拟现实 + 人机交互　；参考：《山东大学》2017年硕士论文

【摘要】：随着虚拟现实技术的快速发展,虚拟现实影院开始出现,其中一类虚拟现实影院就是近年出现的虚拟射击影院。目前流行的虚拟射击影院支持很多观众坐在动感座椅上、戴着立体眼镜、并端着游戏枪对大屏幕显示内容进行射击。这类射击影院可以使观众有很强的沉浸感体验。而且,相较于戴VR头盔进行协同射击游戏的模式,更具共同存在感。射击识别系统是虚拟射击影院的核心部分。目前的射击识别系统大部分采用基于计算机视觉识别的交互方法。这类系统普遍存在不支持多人、交互范围受限等缺陷。近年来,由于传感器技术的快速发展,传感器种类越来越多,价格越来越便宜,精度越来越高。开始出现了一些基于MEMS(Micro-Electro-Mechanical System)传感器的交互装置和方法,其中包括一些射击交互设备。相较于基于计算机视觉的方法,这类方法具有不受摄像头相关参数的限制,成本较低等优势,所以开始得到更多的应用。但这类设备属于类鼠标设备,对玩家的真实射击体验缺少考虑。一个好的射击系统,其内容涉及到视觉、触觉、听觉等多通道感知的有效融合问题。目前的工作很少对此进行考虑,从而导致系统普遍缺少很好的用户体验。为此,本文提出了一种基于MEMS交互枪的交互射击影院技术方案,并提出了通过虚实枪视觉融合方法,为用户提供更加舒适和更具沉浸感的交互射击体验。系统基于用户相对于屏幕的位置和交互枪的指向方向,对虚拟场景进行渲染并投影,从而允许用户在一定范围内随意移动进行射击游戏,大大提高了用户的参与感和沉浸感。最后,论文运用心流理论,通过主观调查问卷的方式和采集用户生理电数据相结合的方式对用户的心流状态加以更加客观的剖析。通过对比的方式客观证明了论文提出的系统更具沉浸感,用户体验更佳。本文的主要工作与贡献主要概括如下:1.设计制作了基于MEMS的交互枪。交互枪的外形设计参考了 QBZ-95突击步枪,枪身采用ABS塑料1:1比例进行3D打印,保留了枪栓设计,去掉了可拆卸弹夹的设计,降低了操作复杂度,使玩家专注于游戏。交互枪的硬件部分包括MPU9150姿态传感器芯片、AVR单片机、用nRF24L01+芯片通信芯片、力反馈驱动电路和电磁铁组成。在内部的布局上考虑了电磁干扰问题,使得系统可以正常工作。2.提出了一种虚实枪交互融合方法。基于MEMS传感器的数据,结合Kinect检测到的人体骨骼节点数据,使得射击交互符合三点一线射击原理,使得用户产生虚拟枪与仿真枪重叠的错觉,提高了用户的交互射击体验。3.提出了基于用户生理电数据的评估模型。在系统评估测试中,对用户皮肤电、肌电、心率、呼吸率进行采集。结合主观评估结果,对用户心流状态进行判定和评估,更加客观的反应了用户的体验,弥补了依靠主观臆断的传统评估方法的不足。
[Abstract]:With the rapid development of virtual reality technology, virtual reality cinemas begin to appear. The popular virtual shooting theater supports many viewers to sit in dynamic seats, wear stereoscopic glasses, and shoot large screen displays with game guns. This kind of shooting cinema can give the audience a very strong immersive experience. Moreover, there is a greater sense of co-existence than the mode of collaborative shooting in VR helmets. Shooting recognition system is the core part of virtual shooting theater. Most of the current shooting recognition systems use interactive methods based on computer vision recognition. This kind of system has many defects, such as not supporting many people, limited interaction scope and so on. In recent years, with the rapid development of sensor technology, there are more and more kinds of sensors, the price is getting cheaper and the precision is getting higher and higher. A number of interactive devices and methods based on MEMS(Micro-Electro-Mechanical system sensors began to emerge, including shooting interactive devices. Compared with the methods based on computer vision, these methods have the advantages of not limited by camera parameters and low cost, so they have been applied more widely. But this kind of device belongs to the class mouse device, lacks consideration to the player's real shooting experience. A good shooting system involves the effective fusion of multi-channel perception such as vision, tactile and auditory. Current work rarely takes this into account, leading to a general lack of good user experience in the system. Therefore, this paper presents a technical scheme of interactive shooting theater based on MEMS interactive gun, and proposes a visual fusion method of virtual gun to provide users with more comfortable and immersive interactive shooting experience. Based on the user's position relative to the screen and the direction of the interactive gun, the system renders and projects the virtual scene, which allows the user to move freely in a certain range for shooting games, which greatly improves the user's sense of participation and immersion. Finally, by using the theory of cardiac flow, the paper makes a more objective analysis of the flow state of users through the combination of subjective questionnaire and the collection of physiological and electrical data of users. It is proved by comparison that the proposed system is more immersive and user experience is better. The main work and contributions of this paper are summarized as follows: 1. The interactive gun based on MEMS is designed and manufactured. The shape design of the interactive gun refers to the QBZ-95 assault rifle. The gun body uses ABS plastic 1:1 scale for 3D printing, retains the design of the bolt, removes the design of the detachable cartridge, reduces the operation complexity, and enables the player to focus on the game. The hardware of the interactive gun consists of a MPU9150 attitude sensor chip, a nRF24L01 chip communication chip, a force feedback drive circuit and an electromagnet. The problem of electromagnetic interference is considered in the internal layout, which makes the system work. 2. 2. An interactive fusion method of virtual gun is proposed. Based on the data of MEMS sensor and the data of human skeleton node detected by Kinect, the shooting interaction accords with the principle of 3.1 line shooting, which makes the user have the illusion that virtual gun and simulated gun overlap, and improves the user's interactive shooting experience. An evaluation model based on user electrophysiological data is proposed. In the system evaluation test, the user's skin electricity, myoelectricity, heart rate and respiration rate were collected. Combined with the subjective evaluation results, the user flow state is judged and evaluated, which reflects the user's experience more objectively and makes up for the shortcomings of the traditional evaluation methods which rely on subjective assumptions.
【学位授予单位】：山东大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP212;TP391.9

【相似文献】