LANDER:internet outage adaptive a35all-20190101 From Predict Jump to navigation Jump to search The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead. README version: 10393, last modified: 2019-04-24. This file describes the trace dataset "internet_outage_adaptive_a35all-20190101" provided by the LANDER project. The most recent version of this file can be found on-line at https://wiki.isi.edu/predict/index.php?title=LANDER:internet_outage_adaptive_a35all-20190101. [ ] Contents • 1 LANDER Metadata • 2 Dataset Contents • 2.1 Combined outage information • 2.2 Downup outage data • 2.3 Code Version Metadata • 3 Citation • 4 Results Using This Dataset • 5 User Annotations LANDER Metadata (https://wiki.isi.edu/predict/index.php?title=LANDER:internet_outage_adaptive_a35all-20190101/landermeta) ┌─────────────────────────┬────────────────────────────────────────────────────────────────────────────────────────────────┐ │dataSetName │internet_outage_adaptive_a35all-20190101 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │status │usc-web-and-predict │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │shortDesc │reachability of responsive of IPv4 /24s │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │longDesc │Combined reachability information for over 3.5M /24 subnets; this dataset is created by │ │ │post-processing data from datasets internet_outage_adaptive_a35c-20190101 │ │ │internet_outage_adaptive_a35e-20190101 internet_outage_adaptive_a35g-20190101 │ │ │internet_outage_adaptive_a35j-20190101 internet_outage_adaptive_a35n-20190101 │ │ │internet_outage_adaptive_a35w-20190101 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │datasetClass │Quasi-Restricted │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │commercialAllowed │true │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │requestReviewRequired │true │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │productReviewRequired │false │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │ongoingMeasurement │false │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │submissionMethod │Upload │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │collectionStartDate │2019-01-01 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │collectionStartTime │00:00:00 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │collectionEndDate │2019-04-01 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │collectionEndTime │00:00:00 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │availabilityStartDate │2018-10-29 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │availabilityStartTime │ │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │availabilityEndDate │2030-01-01 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │availabilityEndTime │00:00:00 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │anonymization │none │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │archivingAllowed │false │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │keywords │category:address-space-status-data, subcategory:network-outage, ip-address, sweep, ping, icmp │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │format │text │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │access │https │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │hostName │USC-LANDER │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │providerName │USC │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │groupingId │internet outages datasets │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │groupingSummaryFlag │false │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │retrievalInstructions │download │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │byteSize │4869586944 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │expirationDays │14 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │uncompressedSize │10957411428 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │impactDoi │10.23721/109/1503778 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │useAgreement │dua-ni-160816 │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │irbRequired │false │ ├─────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────┤ │privateAccessInstructions│See http://www.isi.edu/ant/traces/index.html#getting_datasets for information on obtaining this │ │ │dataset. │ │ │See https://wiki.isi.edu/predict/index.php?title=LANDER:internet_outage_adaptive_a35all-20190101│ │ │for details on this dataset. │ └─────────────────────────┴────────────────────────────────────────────────────────────────────────────────────────────────┘ Dataset Contents This dataset contains processed data from datasets: • LANDER:internet_outage_adaptive_a35c-20190101 • LANDER:internet_outage_adaptive_a35e-20190101 • LANDER:internet_outage_adaptive_a35g-20190101 • LANDER:internet_outage_adaptive_a35j-20190101 • LANDER:internet_outage_adaptive_a35n-20190101 • LANDER:internet_outage_adaptive_a35w-20190101 Each block outage is labeled by what vantage point saw it, thus making it easy to differentiate connection problems between two particular end-points (vantage point and the target) and connection problems between the target and the rest of the world. The more vantage points saw the target's outage, the more severe the outage is. Generally, we provide two types of datafiles: a35all.{version}.outages.fsdb.bz2 a35all.{version}.outagedownup.fsdb.bz2 where outages is outage information for each block, obtained by merging individual sites' data; while outagedownup is further processed to arrive to decision if block was up/down/unmeasurable/gone-dark at a particular time. Since our processing code has been evolving, we started labeling each file with the version of processing code used. This versioning is summarized here: https://ant.isi.edu/datasets/outage/format.html#versions Combined outage information a35all.outages.fsdb.bz2 (and a35all.outages.raw.fsdb.bz2, if present) format: #fsdb -F t block start duration uncertainty status Where fields are: block block address of the /24 in hex (with trailing zeros) start when the status was takes effect (seconds since the Unix epoch) duration how long the status is in effect uncertainty our confidence in the precision of the start time. In non-raw data uncertainty is sometimes lowered when we merge observations from multiple observers. precision_improvement is either unused ('-') or precision improvement of the onset of a state change resulting from merging data from multiple vantage points vantage point that saw the outage (each letter 'c','j','w', 'g' is one of the sites from our status observers; corresponding capital letter 'W', 'C', 'J', 'G' means the vantage point saw no outage; the order is fixed to [wW][cC][jJ][gG]) The .raw. file is the direct observations from the observers (this file is present only in early datasets). The file without .raw. has been post-processed with precision improvement to reduce ambiguity around status start times, as described in section 4.5 of [Quan13c]. (This ambiguity arises because we probe every 11 minutes, the non-.raw file represents our best estimate.) Downup outage data a35all.outagedownup.fsdb.xz (where available) contains post-processed data from a35all.outages.fsdb.bz2. It's format: #fsdb -F t block start duration uncertainty downup Where fields are: block block address of the /24 in hex (with trailing zeros) start when the status was takes effect, in seconds since the Unix epoch. duration how long the status is in effect, in seconds. our confidence in the precision of the start time. The true start time is sometime between start and uncertainty start-uncertainty. The true duration is between duration-NextEventUncertainty and duration+ThisEventUncertainty. In non-raw data uncertainty is sometimes lowered when we merge observations from multiple observers. downup up (1), down (0), unmeasurable (-1, typically due to insufficient active observers), or gone dark (-2, typically out for more than 10 days) Post processing includes the following steps:  1. insufficient VP detection  2. merging roles  3. unmeasurability detection  4. hole filling of periods with insufficient observers Code Version Metadata The file a35all.code_meta.yml, if present, contains versioning information for the code used in the generation of this dataset. It records the date and git commit hash of last modification of each file. This can be useful in comparing datasets processed at different times to see what, if anything, changed in the processing pipeline. Citation If you use this trace to conduct additional research, please cite it as: USC/LANDER Project. Internet Outage Dataset, PREDICT ID: USC-LANDER/internet_outage_adaptive_a35all-20190101. Provided at http://www.isi.edu/ant/lander. Results Using This Dataset Lin Quan, John Heidemann, and Yuri Pradkin. Trinocular: Understanding Internet Reliability Through Adaptive Probing. In Proceedings of the ACM SIGCOMM Conference , p. 255-266. Hong Kong, China, ACM. August, 2013. Lin Quan. LEARNING ABOUT THE INTERNET THROUGH EFFICIENT SAMPLING AND AGGREGATION. PhD Thesis, May 2014. User Annotations Suggestion: Edit the annotations at https://wiki.isi.edu/predict/index.php?title=LANDERNOTES:internet_outage_adaptive_a35all-20190101&action=edit Currently no annotations. Retrieved from "https://wiki.isi.edu/predict/index.php?title=LANDER:internet_outage_adaptive_a35all-20190101&oldid=10393" Categories: • LANDER • LANDER:Datasets • Datasets • LANDER:Datasets:AddressSpace • LANDER:Datasets:AddressSpace:Adaptive Probing • LANDER:Datasets:AddressSpace:Adaptive Probing ALL Navigation menu Personal tools • Wikiexport • Talk • Preferences • Watchlist • Contributions • Log out Namespaces • LANDER • Discussion [ ] English Views • Read • Edit • View history • Watch [ ] More • Move _____________________ [ Search ] [ Go ] Navigation • Main page • Providers • Datasets • Results • Categories • Recent changes • Random page • Help Tools • What links here • Related changes • Upload file • Special pages • Permanent link • Page information • This page was last edited on 24 April 2019, at 11:55. • Content is available under Attribution-Share Alike 3.0 Unported unless otherwise noted. • Privacy policy • About Predict • Disclaimers • Attribution-Share Alike 3.0 Unported • Powered by MediaWiki