ArticlePDF Available

Project Proxy/Cache: Eliminating Redundancy-Internet's Number One Enemy

  • May 2010
Authors:
Ivan Klimek at Technical University of Kosice - Technicka univerzita v Kosiciach
Ivan Klimek
Tomáš Korenko
Tomáš Korenko
Marián Keltika
Marián Keltika
Marián Keltika
  • This person is not on ResearchGate, or hasn't claimed this research yet.
Download full-text PDF
Read full-text
Download citation

Abstract and Figures

Peer-to-Peer (P2P) currently represents the single largest portion of Internet's traffic. It is well known that the redundancy rate in P2P networks is very high; in fact redundancy is the main concept behind P2P. Th is paper will show how much traffic P2P generates and how much of it is redundant. The popularity distribution in P2P networks will be studied. Thru it, it will be shown that caching of P2P data is viable. Based on these calculations we present how much disk space is required for what hit percentage. A working proof-of-concept P2P Pro xy/ Cache will be presented that was shown to be able to serve a segment of several thousand users on commodity PC hardware. The second biggest portion of Internet traffic is streamed video, mostly also because of redundancy. Therefore we developed a truly generic Flash caching mechanis m that will be also presented in this paper.
Figures - uploaded by Ivan Klimek
Author content
All figure content in this area was uploaded by Ivan Klimek
Content may be subject to copyright.
Content uploaded by Ivan Klimek
Author content
All content in this area was uploaded by Ivan Klimek on Apr 09, 2014
Content may be subject to copyright.
A preview of the PDF is not available
ResearchGate has not been able to resolve any citations for this publication.
Design and Evaluation of a Proxy Cache for Peer-to-Peer Traffic
Article
Full-text available
Peer-to-peer (P2P) systems generate a major fraction of the current Internet traffic, and they significantly increase the load on ISP networks and the cost of running and connecting customer networks (e.g., universities and companies) to the Internet. To mitigate these negative impacts, many previous works in the literature have proposed caching of P2P traffic, but very few (if any) have considered designing a caching system to actually do it. This paper demonstrates that caching P2P traffic is more complex than caching other Internet traffic, and it needs several new algorithms and storage systems. Then, the paper presents the design and evaluation of a complete, running, proxy cache for P2P traffic, called pCache. pCache transparently intercepts and serves traffic from different P2P systems. A new storage system is proposed and implemented in pCache. This storage system is optimized for storing P2P traffic, and it is shown to outperform other storage systems. In addition, a new algorithm to infer the information required to store and serve P2P traffic by the cache is proposed. Furthermore, extensive experiments to evaluate all aspects of pCache using actual implementation and real P2P traffic are presented.
Analyzing the Video Popularity Characteristics of Large-Scale User Generated Content Systems
Article
Full-text available
User generated content (UGC), now with millions of video producers and consumers, is reshaping the way people watch video and TV. In particular, UGC sites are creating new viewing patterns and social interactions, empowering users to be more creative, and generating new business opportunities. Compared to traditional video-on-demand (VoD) systems, UGC services allow users to request videos from a potentially unlimited selection in an asynchronous fashion. To better understand the impact of UGC services, we have analyzed the world's largest UGC VoD system, YouTube, and a popular similar system in Korea, Daum Videos. In this paper, we first empirically show how UGC services are fundamentally different from traditional VoD services. We then analyze the intrinsic statistical properties of UGC popularity distributions and discuss opportunities to leverage the latent demand for niche videos (or the so-called "the Long Tail" potential), which is not reached today due to information filtering or other system scarcity distortions. Based on traces collected across multiple days, we study the popularity lifetime of UGC videos and the relationship between requests and video age. Finally, we measure the level of content aliasing and illegal content in the system and show the problems aliasing creates in ranking the video popularity accurately. The results presented in this paper are crucial to understanding UGC VoD systems and may have major commercial and technical implications for site administrators and content owners.
P2P Proxy/Cache [Online; accessed 24
  • Sep 2009
  • I Klimek
Klimek, I.: P2P Proxy/Cache. In Proc. of of the Third International Conference on Internet Technologies and Applications (ITA 09), Wrexham, UK, September 2009. [Online; accessed 24-February-2010], [Online], Available: http://stargate.cnl.tuke.sk/~klimek/ita09.pdf
Accelerating High-Speed Networking with Intel® I/O Acceleration Technology [Online; accessed 24
  • Feb 2009
  • Intel Corporation
Intel Corporation: "Accelerating High-Speed Networking with Intel® I/O Acceleration Technology", 2009, [Online; accessed 24-February-2010], [Online], Available: http://download.intel.com/technology/comms/perfnet/download/ 98856.pdf
Internet Study 2007. ipoque
  • Nov 2007
  • H Schulze
  • K Mochalski
Schulze, H., Mochalski, K.: Internet Study 2007. ipoque, November 2007.