LANDER:internet outage survey it30w-20091223 From Predict Jump to navigation Jump to search The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead. README version: 3238, last modified: 2012-12-21. This file describes the trace dataset "internet_outage_survey_it30w-20091223" provided by the LANDER project. The most recent version of this file can be found on-line at https://wiki.isi.edu/predict/index.php?title=LANDER:internet_outage_survey_it30w-20091223. [ ] Contents • 1 LANDER Metadata • 2 Dataset Contents • 3 Data Format • 3.1 Legacy Format • 4 Collection Method • 4.1 Probing Location(s) • 4.2 Beginning/Ending Date and Time Zone • 5 Results Using This Dataset • 6 Citation • 7 User Annotations LANDER Metadata (https://wiki.isi.edu/predict/index.php?title=LANDER:internet_outage_survey_it30w-20091223/landermeta) ┌─────────────────────────┬─────────────────────────────────────────────────────────────────────────────────────────────┐ │dataSetName │internet_outage_survey_it30w-20091223 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │status │usc-web-and-predict │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │shortDesc │outages in a sample of IPv4 /24 blocks │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │longDesc │To collect this data, a subset of Internet IP address blocks were pinged by sending ICMP │ │ │ECHO_REQUEST (PING) packet. The response (if it ever came within 11 minutes time interval) │ │ │was recorded in this data set. Probe was repeated every 11 minutes. In all, approximately 20k│ │ │/24 subnets were periodically reprobed. Outages are analyzed and reported on the responses. │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │datasetClass │Quasi-Restricted │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │commercialAllowed │true │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │requestReviewRequired │true │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │productReviewRequired │false │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │ongoingMeasurement │false │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │submissionMethod │Upload │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │collectionStartDate │2009-12-23 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │collectionStartTime │17:34:47 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │collectionEndDate │2010-01-06 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │collectionEndTime │17:35:45 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │availabilityStartDate │2013-03-04 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │availabilityStartTime │17:53:46 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │availabilityEndDate │2030-01-01 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │availabilityEndTime │00:00:00 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │anonymization │none │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │archivingAllowed │false │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │keywords │category:address-space-status-data, subcategory:network-outage, ip-address, sweep, │ │ │address-collection, ping, icmp │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │format │text, binary │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │access │https │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │hostName │USC-LANDER │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │providerName │USC │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │groupingId │ │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │groupingSummaryFlag │false │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │retrievalInstructions │download │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │byteSize │3145728 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │expirationDays │14 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │uncompressedSize │2575384 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │impactDoi │10.23721/109/1353863 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │useAgreement │dua-ni-160816 │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │irbRequired │false │ ├─────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────┤ │privateAccessInstructions│See http://www.isi.edu/ant/traces/index.html#getting_datasets for information on obtaining │ │ │this dataset. │ │ │See https://wiki.isi.edu/predict/index.php?title=LANDER:internet_outage_survey_it30w-20091223│ │ │for details on this dataset. │ └─────────────────────────┴─────────────────────────────────────────────────────────────────────────────────────────────┘ Dataset Contents internet_outage_survey_it30w-20091223.README.txt      copy of this README outage.fsdb.bz2      outage information for each block outages.png graphical representation of outage information for a survey Data Format Data is in FSDB format: #fsdb -F t block start duration uncertainty status Where fields are: block block address of the /24 in hex (with trailing zeros) start when the status was takes effect (seconds since the Unix epoch) duration how long the status is in effect uncertainty our confidence in the precision of the start time. In non-raw data uncertainty is sometimes lowered when we merge observeations from multiple observers. status vantage point of the corresponding survey (each letter 'c','j','w' is one of the sites from our observers; corresponding capital letter 'W', 'C', 'J' means the vantage point saw an outage Legacy Format (if outages-legacy.fsdb.bz2 file is present) hexip ip no_data num_rounds density outages hexip: hex format of /24 IP block ip: decimal format of /24 IP block no_data: rounds where we have no useful data (usually when there is an local outage) num_rounds: number of 11-minute rounds in this survey, for this block density: average response rate of this block outages: the rounds that we detect outages, in the format of a-b;c-d. (a,b,c,d are all rounds) Collection Method Data collection involves pinging a fraction of allocated address blocks. Full description of this method is in: > Lin Quan, John Heidemann and Yuri Pradkin. Detecting Internet Outages with Precise Active Probing (extended). > ISI-TR-2012-678. February, 2012 http://www.isi.edu/~johnh/PAPERS/Quan12a.html. This specific work involved probing all addresses in each of about 20k /24 blocks for about 2 weeks. Using icmptrain, the tool described in: > John Heidemann, Yuri Pradkin, Ramesh Govindan, Christos Papadopoulos, Genevieve Bartlett, and Joseph Bannister. > Census and Survey of the Visible Internet. In Proceedings of the ACM Internet Measurement Conference, p.169-182. > Vouliagmeni, Greece, ACM. October, 2008 http://www.isi.edu/~johnh/PAPERS/Heidemann08c.html. Probing Location(s) The probing locations for outage surveys are indicated in their names. A "w" means west, which is from isi.edu in Marina del Rey, California; "c" means center, from colostate.edu, in Ft. Collins, Colorado; "e" means east which is from east.isi.edu, from Arlington, Virginia. See Dataset Contents for more information on the system who did the survey. Beginning/Ending Date and Time Zone Dates/Times specified in the metadata are in UTC. Results Using This Dataset Datasets of outages detected in ISI Internet survey data, similar to this one, have been used the following previously published work: • John Heidemann, Lin Quan, and Yuri Pradkin. A Preliminary Analysis of Network Outages During Hurricane Sandy. Technical Report ISI-TR-2008-685b, USC/Information Sciences Institute, November, 2012. (Updated Feb. 2013.) . • John Heidemann. Third-Party Measurement of Network Outages in Hurricane Sandy. In Proceedings of the FCC Workshop on Network Resiliency, Brooklyn, New York, USA, February, 2013. . • John Heidemann. Active Probing of Edge Networks: Hurricane Sandy and Beyond. Talk given at FCC Workshop on Network Resiliency. February, 2013. . • John Heidemann. Active Probing of Edge Networks: Outages During Hurricane Sandy. Talk given at NANOG57 as part of panel hosted by James Cowie. February, 2013. . Citation If you use this trace to conduct additional research, please cite it as: Internet Outages dataset, IMPACT ID: USC-LANDER/internet_outage_survey_it30w-20091223/rev3238 . Traces taken 2009-12-23 to 2010-01-06. Provided by the USC/LANDER project (http://www.isi.edu/ant/lander). User Annotations Suggestion: Edit the annotations at https://wiki.isi.edu/predict/index.php?title=LANDERNOTES:internet_outage_survey_it30w-20091223&action=edit Currently no annotations. Retrieved from "https://wiki.isi.edu/predict/index.php?title=LANDER:internet_outage_survey_it30w-20091223&oldid=3238" Categories: • Datasets • LANDER • LANDER:Datasets • LANDER:Datasets:AddressSpace:Production Outage • LANDER:Datasets:AddressSpace Navigation menu Personal tools • Wikiexport • Talk • Preferences • Watchlist • Contributions • Log out Namespaces • LANDER • Discussion [ ] English Views • Read • Edit • View history • Watch [ ] More • Move _____________________ [ Search ] [ Go ] Navigation • Main page • Providers • Datasets • Results • Categories • Recent changes • Random page • Help Tools • What links here • Related changes • Upload file • Special pages • Permanent link • Page information • This page was last edited on 21 December 2012, at 12:33. • Content is available under Attribution-Share Alike 3.0 Unported unless otherwise noted. • Privacy policy • About Predict • Disclaimers • Attribution-Share Alike 3.0 Unported • Powered by MediaWiki