基于hadoop的云存储软件.doc

  
约42页DOC格式手机打开展开

基于hadoop的云存储软件,17600字自己原创的毕业论文,已经通过校内系统检测,重复率低,仅在本站独家出售,大家放心下载使用摘要 云计算时代,随着网络终端设备的广泛使用以及互联网技术的进一步普及,数据存储与备份技术已经与个人生活及组织的运作息息相关,企业与个人均面临着海量数据的管理难题。云存储及其相关技术的发展给数据...
编号:99-480900大小:1.24M
分类: 论文>计算机论文

内容介绍

此文档由会员 小丑88 发布

基于hadoop的云存储软件

17600字
自己原创的毕业论文,已经通过校内系统检测,重复率低,仅在本站独家出售,大家放心下载使用

摘要 云计算时代,随着网络终端设备的广泛使用以及互联网技术的进一步普及,数据存储与备份技术已经与个人生活及组织的运作息息相关,企业与个人均面临着海量数据的管理难题。云存储及其相关技术的发展给数据存储领域带来了革新,基于云存储的在线存储系统能够向用户提供永久的,存储空间可扩展的,便捷的,价格低廉的数据存储与备份服务。
本文从需求与问题出发,深入研究了实现基于云存储的文件同步存储系统的关键技术,主要分析了分布式文件系统 HDFS,阐述其体系结构,介绍其主要构成组件,详细分析其工作原理和数据维护方式,在对hadoop平台的文件调度充分研究的基础上,实现了基于Hadoop的云存储系统在用户的客户端方面的管理,采用B/S架构的方式,方便用户随时随地管理自己的存储空间和文件。本地文件上传到集群服务器中进行存储,而用户的文件数据存储到磁盘中之前,都必须经过分布式文件系统 HDFS的处理,实现将数据文件分散的存储在网络中的各个数据节点之中。最后,本文采用分层模块化的方法对系统进行设计与实现,并且在论文的最后两个章节对系统的功能模块进行了测试与分析,总结了研究成果和系统的可扩展功能,最后展望了下一步工作。
本文首先要阐述云存储的相关理论,需要介绍云存储的定义、云存储系统结构及其应用等内容;接着对HDFS数据管理机制及其实现技术进行详细分析,为论文下一步的研究提供了技术保障;最后,通过结合实际需求,在对某云存储服务系统业务分析的基础上,对服务系统存储体系结构、功能结构、数据库及运行环境进行设计,并对该系统加以实现,从而为小范围局域网络的数据存储提供了一个有效的解决方案。本文虽然现实了云存储功能,但是对于如何保障云中数据安全和个人用户隐私这一难题,仍未有效解决,这是今后研究的重点。
关键词:云计算;云存储;hadoop;HDFS;B/S架构


Hadoop cloud-based storage software
Abstract Cloud computing time, with the further spread of Internet technology and the widespread use of network terminal equipment, data storage and backup technology is already operational and is closely related to personal life and organization, businesses and individuals are faced with massive data management challenges.Development of cloud storage and related technologies to the field of data storage brings innovation to provide permanent, scalable storage space, convenient, inexpensive data storage and backup services to users of the system based oncloud storage online storage.
In this paper, starting from the needs and issues, in-depth study of the key technologies of cloud storage-based file synchronization storage system, analyzes the distributed file system HDFS, describes its architecture, describes its main constituent components, a detailed analysis of its working principle and data maintenance mode, based on the hadoop platform file scheduling full study on the realization of the cloud-based Hadoop source systems management at the client side user, the use of B / S architecture, user-friendly management of their storage anywhere space and file.Upload files to the local cluster server for storage, and the user's data is stored in the file to disk before, must undergo treatment HDFS distributed file system, to achieve the data among the various data files distributed storage nodes in the network.Finally, this paper uses a hierarchical modular approach to the design and implementation of the system, and in the last two chapters of the thesis functional modules of the system were tested and analyzed, summarized the research results and system scalability features, finally prospected the next step.
This paper first describes the theory of cloud storage, the need to introduce the definition of cloud storage, cloud storage system architecture and application content; then on HDFS data management mechanism and its implementation techniques for detailed analysis, the next step for the research paper provides a technical guarantee;Finally, through a combination of actual demand, on the basis of a cloud storage service systems business analysis, system storage services architecture, functional structure, databases and operating environment for the design, and the system to be implemented so as to small-scale local area network data storage provides an efficient solution.In this paper, although the reality of the cloud storage capabilities, but for how to protect cloud data security and personal privacy of the problem, yet effective solution, which is the focus of future research.
Key Words:Cloud Computing;Cloud Storage;hadoop;HDFS;B / S architecture

目录
第一章 引言 1
1.1 研究背景 1
1.2 研究意义 2
1.3 研究内容 2
第二章 相关技术研究介绍 4
2.1 B/S 架构 4
2.2 云存储概述 5
2.2.1 云计算 5
2.2.2 跨入云存储时代 7
2.3 Hadoop系统研究 8
2.3.1 hadoop简介 8
2.3.2 HDFS 设计理念 8
2.3.2 HDFS 体系结构 9
第三章 信息存储平台的分析 12
3.1 系统可行性分析 12
3.2系统设计目标 13
3.3系统功能需求 13
3.4 系统整体设计 14
3.4.1 登陆模块 15
3.4.2 管理员模块 15
3.4.3 普通用户模块 16
第四章 信息存储平台设计 18
4.1 云存储集群的搭建 18
4.2系统关键技术实现方法 21
4.2.1 登..