集群数据库系统的日志复制和故障恢复

发布时间：2018-05-16 07:36

本文选题：日志复制 + 故障恢复　；参考：《软件学报》2017年03期

【摘要】：互联网、社交、购物、金融等各类应用直接面临海量用户的高并发访问,传统的单点数据库逐渐成为这些应用系统的瓶颈,而众多互联网应用能够良好运行的主要原因是使用了基于集群环境的数据管理系统作支撑.与传统数据库系统相比,基于集群环境的数据库系统具有更好的扩展性和可用性,而日志复制是保证这些特性的核心组件.传统的主备架构的日志复制在异常情况下对未决事务日志处理不佳,导致数据副本之间存在不一致的风险.另外,分布式系统领域的一致性算法缺乏对事务一致性的处理,而且在选主时存在活锁、多主和频繁选主的问题,无法直接适用于事务日志复制.提出了一种集群环境下的事务日志复制策略和恢复机制,能够有效处理未提交日志,提供了强弱两种读一致性,并且提出一种轻量级的选主算法,可以避免出现以上的选主问题.在开源Ocean Base分布式数据库系统中实现了上述机制,并使用基准测试工具对系统进行测试,通过一系列实验验证了系统的扩展性和可用性.
[Abstract]:The Internet, social networking, shopping, finance and other applications directly face a large number of users of high concurrent access, the traditional single-point database gradually become the bottleneck of these applications, The main reason why many Internet applications work well is that the data management system based on cluster environment is used as the support. Compared with the traditional database system, the database system based on cluster environment has better scalability and availability, and log replication is the core component to ensure these characteristics. Log replication in traditional master / standby architecture is not good for pending transaction logs in exceptional cases, which results in the risk of inconsistent data replicas. In addition, the consistency algorithms in distributed systems lack the processing of transaction consistency, and the problems of active lock, multi-host and frequent selections in the selection of hosts can not be directly applied to transaction log replication. This paper presents a transaction log replication strategy and recovery mechanism in cluster environment, which can deal with uncommitted logs effectively, provides strong and weak coherence, and proposes a lightweight master selection algorithm. The above selection problem can be avoided. The above mechanism is implemented in the open source Ocean Base distributed database system, and the system is tested with benchmark tools. The expansibility and availability of the system are verified by a series of experiments.
【作者单位】：华东师范大学计算机科学与软件工程学院;广西可信软件重点实验室(桂林电子科技大学);
【基金】：国家高技术研究发展计划(863)(2015AA015307) 国家自然科学基金(61332006,61432006,61672232) 广西可信软件重点实验室研究课题(kx201602)~~
【分类号】：TP311.13

【相似文献】