基于多模传感的紧凑型手势交互构件研制

发布时间：2018-04-11 11:41

本文选题：人机交互 + 多模传感　；参考：《浙江大学》2017年硕士论文

【摘要】：手势交互是体感交互所聚焦的主要研究对象,单一模式交互具有其天生的局限性,融合视觉与运动两种模式在一定程度上可以互补,研制基于视觉、运动多模式传感的新型体感设备应用于手势交互,可为以后多模式融合交互应用打下基础。本文介绍和分析了国内外新型手势体感交互设备及手势应用场景,提出了一种以近红外(Near Infrared,NIR)视觉信号为主、辅以惯性运动信号的多模传感获取方式,研制了一款集成NIR光学模组、运动传感单元、高性能计算单元及低功耗控制电路一体化封装的新型多模紧凑型手势交互构件。本文在ARM Cortex-A5硬件平台上搭建了基于嵌入式Linux的软件平台,软件前端通过硬件触发、软件配合并行采集多模数据,同时于后端设计了一个基于低功耗蓝牙(BLE,Bluetooth Low Energy)4.0的通信机制。为了使手势识别中间件可以平滑地嵌入到软件系统里并高效运行,设计了一个基于多任务并行、模块化分层、优先级抢占的高性能软件框架,任务间通过缓冲池技术、零拷贝技术、双缓存切换技术进行高效、隔离度高的数据耦合。本构件从器件选择、控制电路、工作模式多个层面考虑低功耗设计,经测试构件最高功耗为0.757W。通过十层叠层高速PCB设计和立体层次结构设计完成构件的紧凑集成,最终完成一套长52mm、宽32mm、高18mm的小型样机。
[Abstract]:Gesture interaction is the main research object focused on somatosensory interaction. Single pattern interaction has its inherent limitations. To a certain extent, the two modes of combining vision and motion can complement each other.A new type of motion multi-mode sensing device is applied to gesture interaction, which can lay a foundation for the application of multi-mode fusion interaction in the future.This paper introduces and analyzes the new interactive equipment and the application scene of gesture, and puts forward a multi-mode sensor acquisition method, which is based on near infrared near near infrared (NIR) vision signal, supplemented by inertial motion signal.A new multi-mode compact gesture interaction component integrated with NIR optical module, motion sensing unit, high performance computing unit and low power control circuit is developed.In this paper, a software platform based on embedded Linux is built on the ARM Cortex-A5 hardware platform. The front-end of the software is triggered by hardware and the software acquires multi-mode data in parallel. At the same time, a communication mechanism based on low-power Bluetooth Low Energy)4.0 is designed at the back end.In order to embed the gesture recognition middleware smoothly into the software system and run efficiently, a high performance software framework based on multitask parallelism, modularization stratification and priority preemption is designed.Zero copy technology, double buffer switching technology for efficient, high isolation of data coupling.This component considers low power design from device selection, control circuit and working mode. The highest power consumption of the tested component is 0.757 W.The compact integration of the components is completed by the design of high speed PCB with 10 layers and the design of three-dimensional hierarchy, and a set of small prototypes with a length of 52 mm, a width of 32 mm and a high 18mm are finally completed.
【学位授予单位】：浙江大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP391.41;TP11

【参考文献】