达芬奇环境下异构双核处理器多媒体信息处理系统设计与实现
发布时间：2018-09-08 06:26
【摘要】：随着嵌入式技术的不断发展以及无线快速数据通信需求的逐步增长,音视频等多媒体应用的发展也越来越受到人们的重视。人们迫切需要一种费用低廉且高质量的音视频实时通信产品,因此,音视频多媒体的开发具有广阔的发展空间。嵌入式处理器结构的不断发展和改进也为多媒体应用的开发提供了硬件基础。其中比较典型的有TI公司基于ARM+DSP异构双核架构的DM3730处理器,它是专门针对嵌入式系统设计的开放多媒体应用处理器,足以满足现阶段的多媒体通信的需要。而在操作系统方面,采用微内核架构的QNX实时操作系统在嵌入式系统终端领域逐步发展,以其实时性、安全性和可靠性等特点在通信领域占据一席之地。 VoIP技术由于其经济、灵活、功能丰富等优点越来越广泛地应用,而其与无线技术结合产生的无线VoIP通信技术是其最重要的发展趋势之一。经过对现有的无线VoIP通信领域相关技术的研究,本文针对实际情况开展了基于ARM+DSP异构双核平台下的音视频实时通信系统的研究与设计。在本系统设计中,采用了模块化的设计思想,完成了达芬奇子系统软件模块、SIP信令控制模块和无线网络传输模块等主要部分组成。该系统可以极大地提高消费者对于嵌入式音视频实时通信的体验。 本论文通过深入分析ARM+DSP异构双核处理器架构及其软件开发模式,并结合VoIP音视频多媒体通信技术进行系统设计。系统首先完成了整个系统的方案论证,确定各个部分的技术要点,然后根据ARM+DSP异构双核处理器的硬件特点,选定达芬奇软件框架进行异构双核系统应用程序的开发。依据达芬奇软件框架设计的原则和规范,实现了从底层语音和视频算法库的xDM标准封装到上层音视频实时通信应用程序的开发。将采用微内核架构的QNX嵌入式实时操作系统作为ARM核上的操作系统,通过跨平台的QT界面设计软件完成嵌入式终端操作界面的设计,实现了系统通信的控制和音视频播放,人机交互界面简洁友好。最后,搭建了OpenSIPS服务器并完成了终端上的SIP和RTP协议功能。通过对各个模块的功能和性能进行测试,结果显示整个系统运行良好,达到了当初论文设计的初衷,最终可以通过本系统进行音视频通信。
[Abstract]:With the development of embedded technology and the increasing demand of wireless fast data communication, people pay more and more attention to the development of multimedia applications such as audio and video. People urgently need a kind of low cost and high quality audio and video real-time communication product, so the development of audio and video multimedia has a broad development space. The continuous development and improvement of embedded processor architecture also provides the hardware basis for the development of multimedia applications. The typical DM3730 processor based on ARM DSP heterogeneous dual-core architecture in TI is an open multimedia application processor designed for embedded system, which can meet the needs of multimedia communication at this stage. In the aspect of operating system, the QNX real-time operating system based on microkernel has been developed gradually in the field of embedded system terminal. The characteristics of security and reliability occupy a place in the field of communication. VoIP technology is more and more widely used because of its advantages of economy, flexibility, rich functions, etc. The wireless VoIP communication technology combined with wireless technology is one of the most important development trends. Through the research of the existing wireless VoIP communication technology, this paper develops the research and design of the audio and video real-time communication system based on the ARM DSP heterogeneous dual-core platform. In the design of the system, the modular design idea is adopted, and the main components of the software module of da Vinci subsystem, SIP signaling control module and wireless network transmission module, are completed. This system can greatly improve the consumer's experience of embedded audio and video real-time communication. In this paper, the architecture of ARM DSP heterogeneous dual-core processor and its software development mode are deeply analyzed, and the system is designed based on VoIP audio and video multimedia communication technology. The system has completed the scheme demonstration of the whole system and determined the technical key points of each part. Then according to the hardware characteristics of the ARM DSP heterogeneous dual-core processor, Leonardo da Vinci software framework has been selected to develop the application program of the heterogeneous dual-core system. According to the design principles and specifications of Leonardo da Vinci software framework, the development of real-time audio and video communication application program from the xDM standard of the underlying voice and video algorithm library to the upper layer audio and video real-time communication program is realized. The embedded real-time operating system (QNX) with microkernel architecture is used as the operating system on the ARM core. The embedded terminal operation interface is designed by the cross-platform QT interface design software, which realizes the control of system communication and audio and video playback. The man-machine interface is simple and friendly. Finally, the OpenSIPS server is built and the functions of SIP and RTP on the terminal are completed. By testing the function and performance of each module, the result shows that the whole system is running well, which reaches the original intention of the paper, and finally can communicate audio and video through this system.
【学位授予单位】：西南交通大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP332;TN919.8
本文编号：2229641
[Abstract]:With the development of embedded technology and the increasing demand of wireless fast data communication, people pay more and more attention to the development of multimedia applications such as audio and video. People urgently need a kind of low cost and high quality audio and video real-time communication product, so the development of audio and video multimedia has a broad development space. The continuous development and improvement of embedded processor architecture also provides the hardware basis for the development of multimedia applications. The typical DM3730 processor based on ARM DSP heterogeneous dual-core architecture in TI is an open multimedia application processor designed for embedded system, which can meet the needs of multimedia communication at this stage. In the aspect of operating system, the QNX real-time operating system based on microkernel has been developed gradually in the field of embedded system terminal. The characteristics of security and reliability occupy a place in the field of communication. VoIP technology is more and more widely used because of its advantages of economy, flexibility, rich functions, etc. The wireless VoIP communication technology combined with wireless technology is one of the most important development trends. Through the research of the existing wireless VoIP communication technology, this paper develops the research and design of the audio and video real-time communication system based on the ARM DSP heterogeneous dual-core platform. In the design of the system, the modular design idea is adopted, and the main components of the software module of da Vinci subsystem, SIP signaling control module and wireless network transmission module, are completed. This system can greatly improve the consumer's experience of embedded audio and video real-time communication. In this paper, the architecture of ARM DSP heterogeneous dual-core processor and its software development mode are deeply analyzed, and the system is designed based on VoIP audio and video multimedia communication technology. The system has completed the scheme demonstration of the whole system and determined the technical key points of each part. Then according to the hardware characteristics of the ARM DSP heterogeneous dual-core processor, Leonardo da Vinci software framework has been selected to develop the application program of the heterogeneous dual-core system. According to the design principles and specifications of Leonardo da Vinci software framework, the development of real-time audio and video communication application program from the xDM standard of the underlying voice and video algorithm library to the upper layer audio and video real-time communication program is realized. The embedded real-time operating system (QNX) with microkernel architecture is used as the operating system on the ARM core. The embedded terminal operation interface is designed by the cross-platform QT interface design software, which realizes the control of system communication and audio and video playback. The man-machine interface is simple and friendly. Finally, the OpenSIPS server is built and the functions of SIP and RTP on the terminal are completed. By testing the function and performance of each module, the result shows that the whole system is running well, which reaches the original intention of the paper, and finally can communicate audio and video through this system.
【学位授予单位】：西南交通大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP332;TN919.8
【参考文献】
相关期刊论文 前10条
1 宋建勋;刘峰;;基于TMS320DM365多平台实时视频传输系统的设计与实现[J];电视技术;2011年07期
2 林朝龙;;基于RTP的网络视频传输的应用研究[J];信息化研究;2009年12期
3 李洪;胥秦秦;;H.264在ADSP-BF561上的实现与优化[J];电子技术应用;2009年02期
4 刘微;李向荣;;AVS解码器在DSP平台上的优化[J];电子器件;2010年01期
5 齐美彬;陈俊峰;;基于C64x~+内核的H.264编码数据Cache优化[J];合肥工业大学学报(自然科学版);2011年04期
6 管必聪;吕虹;;基于TMS320VC5509的G.729A算法实现[J];机电工程;2008年02期
7 黄皎;吴明春;陆晓春;刘修峰;丁彦;;Wi-Fi与嵌入式设备的融合技术研究[J];计算机工程;2011年08期
8 徐炽;张闻芳;;基于SIP协议的VOIP系统设计与实现[J];科学技术与工程;2008年10期
9 黄国睿;张平;魏广博;;多核处理器的关键技术及其发展趋势[J];计算机工程与设计;2009年10期
10 王原丽;方存果;;基于G.729A语音编解码系统的优化实现[J];武汉理工大学学报;2010年20期
相关硕士学位论文 前6条
1 于洁;基于SIP协议的VOIP客户端的软件的设计与实现[D];电子科技大学;2006年
2 陈国兵;嵌入式异构多核体系的片上通信[D];浙江大学;2007年
3 陈兴;基于Davinci的图像压缩编解码与网络传输[D];北方工业大学;2007年
4 刘可钊;多媒体通信中的音视频同步问题研究[D];南京理工大学;2007年
5 汪延东;基于达芬奇平台的IP可视电话终端的研究[D];山东大学;2010年
6 张辉;基于V4L2的嵌入式视频驱动程序开发与实现[D];安徽大学;2010年
，本文编号：2229641
本文链接：https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2229641.html
