基于WebRTC引擎的音频视频交互系统设计与实现

发布时间：2018-04-15 22:41

本文选题：WebRTC引擎 + 浏览器　；参考：《电子科技大学》2014年硕士论文

【摘要】：二十一世纪是信息高速发展和传播的世纪,语音通信逐渐进入了数字化的时代,VoIP(Voice over IP)网络电话的优势越来越明显,而人们对于信息的传递不仅仅只需要语音,具备语音视频等多媒体功能的信息传递工具才是未来信息时代的主角。WebRTC(Web Real-Time Communication)作为这样的Web开发引擎,其最大作用是提供一种实时通信,而这种通信基于互联网标准协议的。在多媒体通信领域,WebRTC依靠其自身的各种优势赢得了Web标准化制定组织W3C和IETF的全力支持,以及像Google、微软和苹果等世界著名IT企业的支持,使得其在互联网上能够迅速的传播开来。文章首先简要介绍了WebRTC的基本架构和组成,确立以WebRTC引擎为基础的具备音频视频交互功能系统的产品定位和设计实施目标;从分析WebRTC发展历程出发,明确了其发展方向与本文研究方向的一致性。以WebRTC为基础的程序设计要研究三个问题:第一个是对WebRTC规范加以明确,第二个是话音回声消除的原理、方法以及优化策略进行研究分析,提出适用于本次研究的算法,第三个对视频模块的WebM格式的VP8编码进行研究和分析。接下来要是对WebRTC相关技术和其他用于此次交互系统研发所用到的开发技术,如HTML5和C++等。再次,按照软件开发模型分为三个部分:产品需求分析、系统设计和系统实现。借由之前所提到的WebRTC的特点,简要分析了其市场发展前景,对本次研发的基于WebRTC引擎的交互系统整体需求进行概括,分解出音频模块和视频模块的详细需求,并按照这些需求建立整体及各个模块所要实现的目标;在此目标的基础上剖析了WebRTC引擎框架,制订了设计的总体原则以及会话机制和想成模型的设计,再分别从声音模块和视频模块两方面进行设计,音频方面利用Speexex设计优化回声消除功能AEC,视频方面分析优化了熵解码和普通环路滤波技术;在产品的实现上,除了对应需求分析和设计,还对WebRTC各类事件的实现和编译工具的安装部署进行了阐述,突出了音频模块数据结构、消息格式以及初始化的实现代码,视频模块图像文件、视频框架的实现。最后搭建软硬件测试环境,对比其他具备相同或相似功能的产品的出测试结果。测试重点放在音频的文件质量和回音消除以及降噪效果,视频清晰度及整体流畅性加以对比。由于本次研究时间有限,对于WebRTC通信安全方面以及下一步工作进行说明。
[Abstract]:Twenty-first Century is the rapid development of information and communication in voice communication has gradually entered the digital era, VoIP (Voice over IP) the advantage of Internet phone is more and more obvious, and people for the transmission of information not only need to have the voice, multimedia features such as audio and video information is the future of the information age protagonist.WebRTC (Web Real-Time Communication) such as Web engine development, its biggest role is to provide a real-time communication, and the communication based on the internet protocol standard. In the field of multimedia communication, WebRTC rely on a variety of its own advantages to win the full support of Web standard setting organization W3C and IETF, as well as Google, Microsoft and apple as the world the famous IT enterprise support, so that it can be quickly spread on the Internet. This paper briefly introduces the basic structure of WebRTC and the group To establish, with product positioning of audio and video interactive function of the system design and implementation of target based on WebRTC engine; starting from the analysis of the development of the WebRTC, the consistency of the direction and the direction of this study. Three research questions to program design based on WebRTC: the first is to clarify the WebRTC specification the second is the principle of voice, echo cancellation method, and the optimization strategies of research and analysis, put forward for the study of VP8 algorithm, encoding third of video module in WebM format for research and analysis. Then if used in WebRTC and other related technologies used in the interactive system research and development technology, such as the HTML5 and C++. Thirdly, according to the software development model is divided into three parts: demand analysis, system design and system implementation. Through the features mentioned before by WebRTC, briefly Analysis of the market prospect of this research, the overall demand for interactive system based on WebRTC engine is summarized, the decomposition of the detailed requirements of audio and video module, and in accordance with these needs to establish the overall and each module to achieve the goal; based on this goal on the analysis of the WebRTC engine framework, making the overall the principle of design and the session mechanism and to the design of the model, then design from two aspects of voice and video module, audio using Speexex optimization design of echo cancellation function AEC, video analysis and optimize the entropy decoding and loop filtering technology in general; the realization of the products, in addition to the requirements analysis and design, but also install the deployment of WebRTC events and the realization of the compiler tools are described, highlighting the audio module data structure, message format and initialization code The video module, image files, video frame. Finally, the test of hardware and software environment, compared to the other with the same or similar functions are the test results. The test focus elimination and noise reduction effect in audio file quality and echo, video clarity and fluency of the overall contrast. Due to the limited research time, for WebRTC communication security and the next work.

【学位授予单位】：电子科技大学
【学位级别】：硕士
【学位授予年份】：2014
【分类号】：TP393.09

【相似文献】