Experiences with a Continuous Network Tracing Infrastructure

Experiences with a Continuous Network Tracing Infrastructure

Hussain, Alefiya and Bartlett, Genevieve and Pryadkin, Yuri and Heidemann, John and Papadopoulos, Christos and Bannister, Joseph
USC/Information Sciences Institute

Alefiya Hussain, Genevieve Bartlett, Yuri Pryadkin, John Heidemann, Christos Papadopoulos and Joseph Bannister 2005. Experiences with a Continuous Network Tracing Infrastructure. Proceedings of the ACM SIGCOMM MineNet Workshop (Philadelphia, PA, USA, Aug. 2005), 185–190.

Abstract

One of the most pressing problems in network research is the lack of long-term trace data from ISPs. The Internet carries an enormous volume and variety of data; mining this data can provide valuable insight into the design and development of new protocols and applications. Although capture cards for high-speed links exist today, actually making the network traffic available for analysis involves more than just getting the packets off the wire, but also handling large and variable traffic loads, sanitizing and anonymizing the data, and coordinating access by multiple users. In this paper we discuss the requirements, challenges, and design of an effective traffic monitoring infrastructure for network research. We describe our experience in deploying and maintaining a multi-user system for continuous trace collection at a large regional ISP. We evaluate the performance of our system and show that it can support sustained collection and processing rates of over 160–300Mbits/s.

Reference

@inproceedings{Hussain05b,
  author = {Hussain, Alefiya and Bartlett, Genevieve and Pryadkin, Yuri and Heidemann, John and Papadopoulos, Christos and Bannister, Joseph},
  title = {Experiences with a Continuous Network Tracing Infrastructure},
  booktitle = {Proceedings of the  ACM SIGCOMM MineNet Workshop },
  year = {2005},
  sortdate = {2005-08-01},
  project = {ant, lander},
  jsubject = {network_observation},
  publisher = {ACM},
  address = {Philadelphia, PA, USA},
  month = aug,
  pages = {185--190},
  keywords = {network trace collection},
  url = {http://www.isi.edu/%7ejohnh/PAPERS/Hussain05b.html},
  pdfurl = {http://www.isi.edu/%7ejohnh/PAPERS/Hussain05b.pdf},
  myorganization = {USC/Information Sciences Institute},
  copyrightholder = {ACM},
  copyrightterms = {
  Permission to make digital or hard copies of all or part of this work
  for personal or classroom use is granted without fee provided that
  copies are not made or distributed for profit or commercial advantage
  and that copies bear this notice and the full citation on the first
  page. To copy otherwise, to republish, to post on servers or to
  redistribute to lists, requires prior specific permission and/or a
  fee.
  }
}

Copyright

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee.