分布式消息中间件的设计与实现

发布时间：2018-03-20 19:00

本文选题：分布式　切入点：消息中间件　出处：《华中科技大学》2016年硕士论文　论文类型：学位论文

【摘要】：随着互联网的迅猛发展,各种业务架构也越来越来越复杂,基本上完成了从传统单一架构到分布式架构的转变,这导致系统的维护变得越来越困难,因此迫切的需要一个中间层将各个子系统有机的粘合在一起,使得各个子系统之间低耦合,让整个系统易于维护且方便扩充。设计并实现了一个基于发布-订阅模式的消息中间件,整个中间件由服务器和客户端组成,客户端提供了发送消息和接收消息的接口,服务器则负责消息的可靠传递以及保证消息处理的性能。为了保证消息处理性能,特别定制一个简单、精炼的消息结构,使用消息存储模块对其进行存储和访问;为了保证消息的可靠传递,服务器需要对消息进行持久化存储并且会将消息进行备份,此外为了保证整个系统的稳定性,需要考虑当服务器宕机时的恢复处理。依次介绍了消息管理模块、消息备份机制、网络框架以及为了保证系统可靠性的控制器机制。消息管理提供了消息构造、存储、读取接口,并且为了保证读写性能,还包括消息索引机制以及“零拷贝”传输的实现;消息备份机制提供了多个消息备份之间的一致性状态维护;针对客户端和服务器不同的使用场景,使用了不同的网络框架;控制器则提供了对整个系统中服务器的管理,包括服务器的宕机恢复以及负责对整个系统进行负载均衡。最后对系统进行了性能测试,即对系统发送、接收消息的吞吐量进行了测试。
[Abstract]:With the rapid development of the Internet, various business architectures are becoming more and more complex, basically completing the transition from the traditional single architecture to the distributed architecture, which makes the maintenance of the system becoming more and more difficult. So there is an urgent need for an intermediate layer that organically binds the subsystems together, so that the subsystems are low in coupling. A message middleware based on publish-subscribe mode is designed and implemented. The middleware is composed of server and client. The client provides the interface between sending and receiving messages. The server is responsible for the reliable delivery of messages and the performance of message processing. In order to ensure the performance of message processing, a simple and refined message structure is specially customized, and the message storage module is used to store and access the message. In order to ensure the reliable delivery of messages, the server needs to persist the messages and back up the messages, in addition, to ensure the stability of the whole system, This paper introduces the message management module, message backup mechanism, network framework and controller mechanism in order to ensure the reliability of the system. In order to guarantee the read and write performance, it also includes the message index mechanism and the realization of "zero copy" transmission, and the message backup mechanism provides the consistent state maintenance between multiple message backups. For different usage scenarios of client and server, different network framework is used, and controller provides the management of server in the whole system. Finally, the performance of the system is tested, that is, the throughput of sending and receiving messages is tested.
【学位授予单位】：华中科技大学
【学位级别】：硕士
【学位授予年份】：2016
【分类号】：TP368.5;TP315

【参考文献】