Tag Archives: Hadoop

Software to Generate IP Hitlists with Hadoop Now Available

We are happy to release the set of map/reduce processing scripts that run in Hadoop to consume our Internet address censuses and output hitlists, as described in the paper “Selecting Representative IP Addresses for Internet Topology Studies“. These scripts depend on our internal Hadoop configuration and … Continue reading

Posted in Uncategorized | Tagged , , , , , , , | Leave a comment

New conference paper “Selecting Representative IP Addresses for Internet Topology Studies” to appear at IMC

The paper “Selecting Representative IP Addresses for Internet Topology Studies” (available at http://www.isi.edu/~xunfan/research/Fan10a.pdf) was accepted to appear at the ACM Internet Measurement Conference 2010 in Melbourne, Australia. From the abstract: An Internet hitlist is a set of addresses that cover … Continue reading

Posted in Uncategorized | Tagged , , , , , , , , | Leave a comment

ANT extensions for bzip2-splitting to appear in Hadoop

The ANT project is happy to announce that our extensions to Hadoop to support splitting of bzip2-compressed files have been accepted to appear in the next Hadoop release (will be 0.21.0). Support for compression is important in map/reduce because it … Continue reading

Posted in Uncategorized | Tagged , , , , | Leave a comment