基于客户-服务器双端去重的Web预取新方法-《计算机技术与发展》

文章信息/Info

Title:: A New Web Prefetching Method Based on Client-server Double-ended Deduplication

Author(s):: YAO Yao; School of Information Engineering,Zhengzhou Institute of Technology,Zhengzhou 450044,China

摘要:: 网络数据量的不断增长和网络内容的不断多样化,使得提高网络访问效率、有效降低网络访问延迟成为当前网络存储领域面临的严峻挑战。Web缓存技术和预取技术是目前解决该难题的有效方法。针对缓存技术受限于命中率、预取技术受限于带宽等诸多问题,在Web预取系统引入数据去重技术,提出一种客户-服务器端双端数据去重的Web预取系统改进策略。首先改进传统预取系统框架,分别引入代理服务器端数据去重模块SDM和客户端数据去重模块CDM以及相关模块;然后采用LBFS算法实现双端数据去重;最后,将该方法应用于预取系统,评价其预取性能。实验结果表明,相对于标准传输,该系统一方面可以减少大约34%的字节传输量,另一方面降低大约8%的用户预期的访问延迟,从而优化预取系统。

Abstract:: The increasing amount of network data and the diversification of network contents make it a serious challenge to improve network access efficiency and reduce network access delay. Web caching technology and prefetching technology are currently effective ways to solve this problem. For the problem that the cache technology is limited by the hit rate and the prefetching technology is limited by the bandwidth,we propose a Web prefetching method based on the client-server double-end data deduplication technology. Firstly,the traditional Web prefetching system is improved. The proxy server data deduplication module (SDM) and the client data deduplication module (CDM) are introduced to implement the client-server dual-end data deduplication. Then,LBFS algorithm is used to achieve doubleend data deduplication. Finally,this method is applied to the prefetching system to evaluate its prefetching performance. The experimentshows that compared to standard transmission,on the one hand this system can reduce the amount of bytes transferred by about 34% ,andon the other hand,in order to optimize the prefetching system,it can reduce the expected access delay by about 8% of users.