基于用户空间的云网关网络文件系统设计与实现

发布时间：2018-09-19 09:11

【摘要】：在信息化的日益显著的今天，数字化信息迅猛增长，人们对存储的需求从容量到速度都不断在提高。在这种背景下，云存储服务诞生并得到迅速的发展，催生了一个云存储时代。与此同时，利用云存储服务的云存储网关设备也得到了各界关注，特别是中小企业，对云网关的依赖逐渐增加。但是由于受到网速、带宽和存储设备本身等限制，云网关的速度一直是一个令人堪忧的问题。在此背景下，利用亚马逊平台提供的Amazon S3（Amazon Simple Storage Service，亚马逊简单存储服务）云存储服务，和NFS（Network File System，网络文件系统）搭建了一个云网关，使它通过各类传输协议将云端存储的数据共享给各类客户端。在现有的云网关架构上，以优化总体性能为目的，设计并实现了用户空间文件共享服务器，此服务器代替现有运行在内核空间的NFS服务器，简化了云网关本地运行流程中内核态和用户态的切换开销，达到提高速度、加快响应时间的效果。现有云网关的NFS服务器运行在系统内核空间下，它接收NFS客户端传递来的文件请求，并将该请求传递给工作在云网关用户空间下的S3FS（S3File System，S3文件系统），S3FS是云网关上负责将文件请求传递给S3的用户空间文件系统，请求从被NFS服务器到S3FS接收到，并返回结果，要经过多次内核空间到用户空间的数据拷贝，性能不佳，影响云网关的整体速度。针对以上原因，设计并实现了运行在用户空间下的文件共享服务器，它可以直接和同样运行在用户空间下的S3FS协同工作，，无需经过内核空间，降低了内核空间和用户空间之间的切换开销，达到提高云网关整体访问速度的目的。经测试证明，用户空间下的文件共享服务器能够代替现有运行现有内核态下的NFS与S3FS协同工作使云网关正常运行，挂载及各项文件操作能够顺利执行。优化后的云网关上传下载等各项服务响应速度均有提高，云网关的性能得到一定程度的提升。
[Abstract]:With the development of information technology, digital information is increasing rapidly, and the demand for storage is increasing from capacity to speed. In this context, cloud storage service was born and developed rapidly, which gave birth to a cloud storage era. At the same time, cloud storage gateway devices using cloud storage services have been concerned by all walks of life, especially for small and medium-sized enterprises, the dependence on cloud gateway is gradually increasing. However, due to the network speed, bandwidth and storage device itself constraints, cloud gateway speed has been a worrying problem. In this context, a cloud gateway is built using Amazon S3 (Amazon Simple Storage Service, Amazon simple Storage Service and NFS (Network File System, Network File system, which is provided by Amazon platform. Enable it to share data stored in the cloud to various clients through various transport protocols. Based on the existing cloud gateway architecture, the user space file sharing server is designed and implemented in order to optimize the overall capability. The server replaces the existing NFS server running in kernel space. The switching overhead of kernel state and user state in the local running process of cloud gateway is simplified to improve the speed and speed up the response time. The existing cloud gateway's NFS server runs in system kernel space and receives file requests from NFS clients. Passing the request to S3FS (S3File System,S3 File system) S3FS, which works in the cloud gateway user space, is the user space file system responsible for passing the file request to S3 on the cloud gateway. The request is received from the NFS server to the S3FS, and the result is returned. The performance of data copy from kernel space to user space is poor, which affects the overall speed of cloud gateway. For the above reasons, a file sharing server running in user space is designed and implemented. It can work directly with the S3FS running in the same user space without going through the kernel space. The switching overhead between kernel space and user space is reduced, and the whole access speed of cloud gateway is improved. It is proved by test that the file sharing server in user space can replace the existing NFS and S3FS in the kernel state to make the cloud gateway run normally and mount and all kinds of file operations can be executed smoothly. The response speed of the optimized cloud gateway is improved, and the performance of the cloud gateway is improved to some extent.
【学位授予单位】：华中科技大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333

【参考文献】