LANDER:internet outage maintenance a42all-20201001

   From Predict

   README version: 14611, last modified: 2024-04-18.

   This file describes the trace dataset "internet_outage_maintenance_a42all-20201001" provided by the LANDER
   project.

Contents

     • 1 LANDER Metadata
     • 2 Dataset Contents
     • 3 Data Format
          • 3.1 extended outage downup data
          • 3.2 mstl data
     • 4 Collection Method
          • 4.1 Beginning/Ending Date and Time Zone
     • 5 See Also
     • 6 Citation
     • 7 User Annotations

LANDER Metadata

   ┌───────────────────────────┬────────────────────────────────────────────────────────────────────────────────────┐
   │ dataSetName               │ internet_outage_maintenance_a42all-20201001                                        │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ status                    │ usc-web-and-predict                                                                │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ shortDesc                 │ maintenance of responsive of IPv4 /24s                                             │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ longDesc                  │ Maintenance events for over 5M /24 subnets; this dataset is created by             │
   │                           │ post-processing data from datasets internet outage adaptive a42all-20201001        │
   │                           │ ip_accumulation_as_a42-20201001                                                    │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ datasetClass              │ Quasi-Restricted                                                                   │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ commercialAllowed         │ true                                                                               │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ requestReviewRequired     │ true                                                                               │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ productReviewRequired     │ false                                                                              │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ ongoingMeasurement        │ false                                                                              │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ submissionMethod          │ Upload                                                                             │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ collectionStartDate       │ 2020-10-01                                                                         │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ collectionStartTime       │ 00:00:00                                                                           │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ collectionEndDate         │ 2021-01-01                                                                         │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ collectionEndTime         │ 00:00:00                                                                           │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ availabilityStartDate     │ 2024-04-16                                                                         │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ availabilityStartTime     │                                                                                    │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ availabilityEndDate       │ 2030-01-01                                                                         │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ availabilityEndTime       │ 00:00:00                                                                           │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ anonymization             │ none                                                                               │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ archivingAllowed          │ false                                                                              │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ keywords                  │ category:address-space-status-data, subcategory:network-outage, ip-address, sweep, │
   │                           │ ping, icmp                                                                         │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ format                    │ text                                                                               │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ access                    │ https                                                                              │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ hostName                  │ USC-LANDER                                                                         │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ providerName              │ USC                                                                                │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ groupingId                │                                                                                    │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ groupingSummaryFlag       │ false                                                                              │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ retrievalInstructions     │ download                                                                           │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ byteSize                  │ 2788163584                                                                         │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ expirationDays            │ 14                                                                                 │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ uncompressedSize          │                                                                                    │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ impactDoi                 │                                                                                    │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ useAgreement              │ dua-ni-160816                                                                      │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ irbRequired               │ false                                                                              │
   ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤
   │ privateAccessInstructions │ See https://ant.isi.edu/datasets/#getting-datasets for information on obtaining    │
   │                           │ this dataset.                                                                      │
   │                           │ See                                                                                │
   └───────────────────────────┴────────────────────────────────────────────────────────────────────────────────────┘

Dataset Contents

   internet_outage_maintenance_a42all-20201001.README.txt     copy of this README
   data/
       ...
       a<NN>all_maintenance.outagedownup.fsdb.bz2         datafiles
       a<NN>.mstl.fsdb.bz2                                datafiles
       ...
       .sha*sum                                               SHA checksum

   In the above:

  <NN>        is the sequence number of the survey

Data Format

  extended outage downup data

   Outage-downup format is described at https://ant.isi.edu/datasets/outage/format.html with the addition of an asn
   field.

   Data is in FSDB format with the following schema:

  #fsdb -F t block start duration uncertainty downup asn

     • block: block address of the /24 in hex (with trailing zeros)
     • start: when the status was takes effect, in seconds since the Unix epoch.
     • duration: how long the status is in effect, in seconds.
     • uncertainty: our confidence in the precision of the start time. The true start time is sometime between start
       and start-uncertainty. The true duration is between duration-NextEventUncertainty and
       duration+ThisEventUncertainty. In non-raw data uncertainty is sometimes lowered when we merge observations
       from multiple observers.
     • downup: up (1), down (0), unmeasurable (-1, typically due to insufficient active observers), or gone dark (-2,
       typically out for more than 10 days)
     • asn: the Autonomous System Number responsible for this block

   We report only data for outagedownup events, not all events. Please combine this dataset with the non-maintenance
   dataset to see the complete status of all blocks.

  mstl data

   MSTL shows the Multiple Seasonal-Trend decomposition using LOESS decomposition of the each AS, number of blocks
   going down, blocks coming up, and a flag for is_maintenance.

    #fsdb -F t asn timebin trend residuals fraction blocks_down blocks_up is_maintenance num_probes probes

Collection Method

   Data collection involves pinging allocated and responsible address blocks. Full description of this method is in:

   > Guillermo Baltra, Xiao Song, and John Heidemann. Ebb and Flow: Implications of ISP Address Dynamics. In
   > Proceedings of the Passive and Active Measurement Conference, Virtual Location, Springer. March, 2024.
   > https://ant.isi.edu/%7ejohnh/PAPERS/Baltra24a.html

  Beginning/Ending Date and Time Zone

   Dates/Times specified in the metadata are in UTC.

See Also

   This dataset is related to:

     • LANDER:internet_outage_adaptive_a42all-20201001
     • LANDER:ip_accumulation_as_a42-20201001

Citation

   If you use this trace to conduct additional research, please cite it as:

   Internet Outages dataset, IMPACT ID: USC-LANDER/internet_outage_maintenance_a42all-20201001/rev14611 . Traces
   taken 2020-10-01 to 2021-01-01. Provided by the USC/ANT group (https://ant.isi.edu/).

User Annotations


   Currently no annotations.

   Categories:
     • LANDER:Templates
     • Datasets
     • LANDER
     • LANDER:Datasets
     • LANDER:Datasets:AddressSpace:Outage Maintenance
     • LANDER:Datasets:AddressSpace
     • LANDER:Datasets:AddressSpace:Maintenance