p2p网络拓扑结构在数字视频中的应用.rar
p2p网络拓扑结构在数字视频中的应用,p2p网络拓扑结构在数字视频中的应用3.2万字 60页硕士论文摘要p2p（peer to peer）技术在分布式系统和资源共享应用领域中得到迅速的发展，在视频应用领域，近几年国内外涌现出大量的使用p2p技术的产品。当前非结构化p2p网络主要使用集中式查找、洪泛式查找和混合式查找，随着网络规模的扩大，非结构化p2p网络暴...
该文档为压缩文件,包含的文件列表如下:
内容介绍
原文档由会员 刘瑞 发布
P2P网络拓扑结构在数字视频中的应用
3.2万字 60页
硕士论文
摘要
P2P（Peer to Peer）技术在分布式系统和资源共享应用领域中得到迅速的发展，在视频应用领域，近几年国内外涌现出大量的使用P2P技术的产品。当前非结构化P2P网络主要使用集中式查找、洪泛式查找和混合式查找，随着网络规模的扩大，非结构化P2P网络暴露出扩展性能较差的问题。本文针对P2P视频系统中的一些基本问题进行了研究和实验，包括：节点的路由和查找算法、数据调度和节点选择策略、网络通讯等。本文的主要研究工作和贡献如下：
（1）节点的路由和查找算法。查找的效率一直是分布式Hash表一个备受关注的指标，在分布式哈希表中，比较著名的协议包括Chord、Pastry、Tapestry和CAN（Content Addressable Network）等。本文结合具体的应用系统的特点和需要修改或者精简了路由查找算法，使它更适合P2P视频点播的应用。
（2）数据调度和节点选择策略。提出了节点学习历史经验的数据调度方法和超时数据的紧急调度方法。为了充分利用节点的资源能力、最大程度地减小中心服务器的压力，设计并实现了节点学习历史经验的自适应的数据调度和节点选择算法；另一方面，为了保证数据在规定的时间内到达，设计并实现了一种超时数据的紧急时刻调度算法。
（3）网络通讯。用户的网络环境多种多样，有些位于公网，有些位于各种各样的网关之后，为了使所有用户平等地使用系统的服务，设计并实现了UDP（User Datagram Protocol）打洞方案解决了部分网关之后的用户的通讯问题，使它们达到和公网上的用户平等的地位。
实验证明，本文提出的数据调度策略和网络通讯方法都是有效的，DHT在较小规模的实验环境中可行，目前还没有推广到大规模的网络环境中。
关键词：非结构化，结构化，分布式哈希，数据调度，穿越网关
Abstract
P2P(Peer to Peer) technology has been developing rapidly in fields of distributed system and resource sharing system. VOD(video on demand) based P2P technology becomes one of the hotspots. More and more software and products developed recent years. Centralized and flooding search are widely used in current non-structural P2P system. With the growth of the scales of P2P users, the extension capability becomes weaker. This paper pays attention to several basic issues and design in P2P VOD system, including routing and searching algorithm, choosing sending peers, communication through NAT(Network Address Translator) and so on. The main issues and contributions of this paper are as following:
The first is routing and searching algorithm. Speed is the most important question in searching using DHT(Distributed Hash Table), including some famous protocol such as Chord, CAN(Content Addressable Network), and Pastry. This paper modifies these protocols to adapt for the VOD requirement.
Second, data and sending node selection is related to the quality supplied to users. On one hand, we try our best to reduce the press of central video server, so I designed and realized one data and sending node selection strategy called self adaptive or study based selection. On another hand, in order to ensure the download time of data, I designed and realized one data and sending node selection strategy called emergent selection.
Not all the users are in Internet, but some users are behind NAT. In order to supply all users with the same usage, this paper designed and realized one method to communicate through NAT equally.
Experiment proves that the data and sending node selection strategy and communication method through NAT suggested in this paper is valid. DHT can act in small scale system, but still has not been used in large scale system.
Key Words: non-structural, structural, DHT(Distributed Hash Table), data and sending node selection, NAT
目 录
第一章 绪论 1
1.1 P2P技术简介 1
1.2 P2P在视频点播中的应用 3
1.3 国内P2P视频发展现状 6
1.4 国外P2P视频发展情况 8
1.5 P2P视频以何制胜 9
1.6 面临的挑战 9
1.7 本文的主要工作和文章结构 10
第二章 P2P查找算法及改进 12
2.1 P2P网络模型 12
2.2 分布式哈希搜索算法 16
2.2.1 Chord协议 16
2.2.2内容访问网络（Content-Addressable Network，CAN） 24
2.2.3 Pastry系统 29
第三章 关键技术的研究和运用 35
3.1 项目简介 35
3.2 基于划分区域的查找 38
3.3 数据调度策略 40
3.4 复杂网络环境中的通讯 46
3.4.1 基本概念 46
3.4.2 面临的困难及其解决的方法 48
3.4.3 实验 51
第四章 总结和展望 53
参考文献 54
致谢 56
参考文献
[21] 董海韬， 基于对等网络流媒体传输系统技术的研究，清华大学， 2005.5
[22] 马凌霄，基于p2p网络的流媒体技术研究，浙江大学， 2005年
[23] Chao Zhang, Hai Jin, Dafu Deng, Sirui Yang, Quan Yuan and Zuoning Yin, Cluster and Grid Computing Lab. Anysee: Multicast-based Peer-to-Peer Media Streaming Service System, 2005 Asia-Pacific Conference on Communications, Perth, Western Australia, 3 - 5 October 2005.
[24] Xinyan Zhang, Jiangchuan Liu, Bo Li, and Tak-Shing Peter Yum, CoolStreaming/DONet: A Data-driven Overlay Network for Peer-to-Peer Live Media Streaming, 2004
[25] Venkat Padmanabhan, Microsoft Research, Resilient Peer-to-Peer Streaming, 2003.3
[26] Kai Hwang, Internet Security and Cyber Trust for Integrated Web Services and P2P Grid Computing, 2005.12
[27] Meng Zhang, Jian-Guang Luo, Li Zhao, and Shi-Qiang Yang, A Peer-to-Peer Network for Live Media Streaming – Using a Push-Pull Approach, Tsinghua University, 2005
[28] Xiaojun Hei, Chao Liang, Jian Liang, Yong Liu and Keith W. Ross, Insights into PPLive: A Measurement Study of a Large Scale P2P IPTV System
3.2万字 60页
硕士论文
摘要
P2P（Peer to Peer）技术在分布式系统和资源共享应用领域中得到迅速的发展，在视频应用领域，近几年国内外涌现出大量的使用P2P技术的产品。当前非结构化P2P网络主要使用集中式查找、洪泛式查找和混合式查找，随着网络规模的扩大，非结构化P2P网络暴露出扩展性能较差的问题。本文针对P2P视频系统中的一些基本问题进行了研究和实验，包括：节点的路由和查找算法、数据调度和节点选择策略、网络通讯等。本文的主要研究工作和贡献如下：
（1）节点的路由和查找算法。查找的效率一直是分布式Hash表一个备受关注的指标，在分布式哈希表中，比较著名的协议包括Chord、Pastry、Tapestry和CAN（Content Addressable Network）等。本文结合具体的应用系统的特点和需要修改或者精简了路由查找算法，使它更适合P2P视频点播的应用。
（2）数据调度和节点选择策略。提出了节点学习历史经验的数据调度方法和超时数据的紧急调度方法。为了充分利用节点的资源能力、最大程度地减小中心服务器的压力，设计并实现了节点学习历史经验的自适应的数据调度和节点选择算法；另一方面，为了保证数据在规定的时间内到达，设计并实现了一种超时数据的紧急时刻调度算法。
（3）网络通讯。用户的网络环境多种多样，有些位于公网，有些位于各种各样的网关之后，为了使所有用户平等地使用系统的服务，设计并实现了UDP（User Datagram Protocol）打洞方案解决了部分网关之后的用户的通讯问题，使它们达到和公网上的用户平等的地位。
实验证明，本文提出的数据调度策略和网络通讯方法都是有效的，DHT在较小规模的实验环境中可行，目前还没有推广到大规模的网络环境中。
关键词：非结构化，结构化，分布式哈希，数据调度，穿越网关
Abstract
P2P(Peer to Peer) technology has been developing rapidly in fields of distributed system and resource sharing system. VOD(video on demand) based P2P technology becomes one of the hotspots. More and more software and products developed recent years. Centralized and flooding search are widely used in current non-structural P2P system. With the growth of the scales of P2P users, the extension capability becomes weaker. This paper pays attention to several basic issues and design in P2P VOD system, including routing and searching algorithm, choosing sending peers, communication through NAT(Network Address Translator) and so on. The main issues and contributions of this paper are as following:
The first is routing and searching algorithm. Speed is the most important question in searching using DHT(Distributed Hash Table), including some famous protocol such as Chord, CAN(Content Addressable Network), and Pastry. This paper modifies these protocols to adapt for the VOD requirement.
Second, data and sending node selection is related to the quality supplied to users. On one hand, we try our best to reduce the press of central video server, so I designed and realized one data and sending node selection strategy called self adaptive or study based selection. On another hand, in order to ensure the download time of data, I designed and realized one data and sending node selection strategy called emergent selection.
Not all the users are in Internet, but some users are behind NAT. In order to supply all users with the same usage, this paper designed and realized one method to communicate through NAT equally.
Experiment proves that the data and sending node selection strategy and communication method through NAT suggested in this paper is valid. DHT can act in small scale system, but still has not been used in large scale system.
Key Words: non-structural, structural, DHT(Distributed Hash Table), data and sending node selection, NAT
目 录
第一章 绪论 1
1.1 P2P技术简介 1
1.2 P2P在视频点播中的应用 3
1.3 国内P2P视频发展现状 6
1.4 国外P2P视频发展情况 8
1.5 P2P视频以何制胜 9
1.6 面临的挑战 9
1.7 本文的主要工作和文章结构 10
第二章 P2P查找算法及改进 12
2.1 P2P网络模型 12
2.2 分布式哈希搜索算法 16
2.2.1 Chord协议 16
2.2.2内容访问网络（Content-Addressable Network，CAN） 24
2.2.3 Pastry系统 29
第三章 关键技术的研究和运用 35
3.1 项目简介 35
3.2 基于划分区域的查找 38
3.3 数据调度策略 40
3.4 复杂网络环境中的通讯 46
3.4.1 基本概念 46
3.4.2 面临的困难及其解决的方法 48
3.4.3 实验 51
第四章 总结和展望 53
参考文献 54
致谢 56
参考文献
[21] 董海韬， 基于对等网络流媒体传输系统技术的研究，清华大学， 2005.5
[22] 马凌霄，基于p2p网络的流媒体技术研究，浙江大学， 2005年
[23] Chao Zhang, Hai Jin, Dafu Deng, Sirui Yang, Quan Yuan and Zuoning Yin, Cluster and Grid Computing Lab. Anysee: Multicast-based Peer-to-Peer Media Streaming Service System, 2005 Asia-Pacific Conference on Communications, Perth, Western Australia, 3 - 5 October 2005.
[24] Xinyan Zhang, Jiangchuan Liu, Bo Li, and Tak-Shing Peter Yum, CoolStreaming/DONet: A Data-driven Overlay Network for Peer-to-Peer Live Media Streaming, 2004
[25] Venkat Padmanabhan, Microsoft Research, Resilient Peer-to-Peer Streaming, 2003.3
[26] Kai Hwang, Internet Security and Cyber Trust for Integrated Web Services and P2P Grid Computing, 2005.12
[27] Meng Zhang, Jian-Guang Luo, Li Zhao, and Shi-Qiang Yang, A Peer-to-Peer Network for Live Media Streaming – Using a Push-Pull Approach, Tsinghua University, 2005
[28] Xiaojun Hei, Chao Liang, Jian Liang, Yong Liu and Keith W. Ross, Insights into PPLive: A Measurement Study of a Large Scale P2P IPTV System
