基于H.264的CAVLC嵌入式音视频同步算法研究

发布时间：2018-03-28 20:58

本文选题：H.264/AVC　切入点：音、视频同步　出处：《吉林大学》2012年硕士论文

【摘要】：近年来，计算机技术以及通信技术的不断革新与进步，对数字化信息产品的传输起到了巨大的促进作用。人们获得信息的渠道也从单一的媒体形式发展到多种媒体并存的形式，应运而生了一种崭新的媒体通信方式——多媒体通信。这种新型通信方式正在渗透到人们生活的每个角落，并且越来越多的人们发觉多媒体信息服务已经成为他们生活中不可或缺的一部分。在众多的多媒体应用中，如何控制多媒体信息通信中的视频信号与音频信号的同步变得尤为重要。本文提出了一种可以使音频信号、视频信号在媒体发送端、信道传输过程中以及媒体接收端实现完全同步的方法。把经过编码的原始音频信号通过在CAVLC熵编码的实现过程中嵌入到视频信号里，使得在媒体发送端既维持了音频媒体单元和视频媒体单元之间的同步性，同时又降低了媒体接收端用于实现同步控制方案的复杂程度。算法选择CAVLC熵编码的两种编码系数（最高频拖尾系数、除拖尾系数之外的第一个非零系数）作为音频信号的载体，将音频信号嵌入其中。每个系数嵌入1bit音频信号。算法的仿真实现是利用了H.264官方参考软件——JM11.0完成的。一共使用了9个不同的视频序列进行仿真测试，通过主观质量评价、峰值信噪比以及嵌入的开销等不同的评价标准进行分析对比。实验的结果表明，本文所提出的算法可以实现音、视频的完全同步。尽管对于视频序列的嵌入开销、峰值信噪比造成了影响。但由于影响值非常微小，并不会对于传输与存储带来较大的负担。并且对于原始音频序列来说，，没有产生任何影响。
[Abstract]:In recent years, with the continuous innovation and progress of computer technology and communication technology, the transmission of digital information products has been greatly promoted. People's access to information has also developed from a single form of media to a form of coexistence of multiple media. A new media communication mode, multimedia communication, has emerged, which is permeating every corner of people's life. And more and more people find that multimedia information service has become an indispensable part of their life. How to control the synchronization of video signal and audio signal in multimedia communication becomes more and more important. In this paper, an audio signal, video signal, and video signal are proposed. The method of complete synchronization in channel transmission and media receiver. The encoded original audio signal is embedded into the video signal through the realization of CAVLC entropy coding. The synchronization between the audio media unit and the video media unit is maintained at the media transmitter. At the same time, the complexity of the synchronization control scheme in the media receiver is reduced. The algorithm selects two encoding coefficients of CAVLC entropy coding (the highest frequency tail coefficient, the first non-zero coefficient other than the tail coefficient) as the carrier of audio signal. Embed the audio signal in it. Each coefficient is embedded in the 1bit audio signal. The simulation implementation of the algorithm is accomplished by using the H.264 official reference software-JM11.0. Nine different video sequences are used for simulation test, and the subjective quality evaluation is carried out. The experimental results show that the proposed algorithm can realize the complete synchronization of audio and video. The peak signal-to-noise ratio (PSNR) is very small and does not burden the transmission and storage, and has no effect on the original audio sequence.
【学位授予单位】：吉林大学
【学位级别】：硕士
【学位授予年份】：2012
【分类号】：TP391.41;TP368.1

【参考文献】