LANDER:FRGPContinuousFlowData-20090729 From Predict README version: 3998, last modified: 2014-05-29. This file describes the trace dataset "FRGPContinuousFlowData-20090729" provided by the LANDER project. Contents • 1 LANDER Metadata • 2 Dataset Contents • 3 Dataset Generation • 4 Requesting the Dataset • 5 Citation • 6 Results Using This Dataset • 7 User Annotations LANDER Metadata ┌───────────────────────────┬────────────────────────────────────────────────────────────────────────────────────┐ │ dataSetName │ FRGPContinuousFlowData-20090729 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ status │ private │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ shortDesc │ FRGP Continuous Flow Data │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ longDesc │ Daily Argus files with flows on a 1Gb/s link between FRGP.net and Century │ │ │ Link/Comcast. Has traffic from several academic institutions. Should be requested │ │ │ as continuous interval specified by start-date..end-date. │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ datasetClass │ Unclassified │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ commercialAllowed │ true │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ requestReviewRequired │ true │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ productReviewRequired │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ ongoingMeasurement │ true │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ submissionMethod │ Upload │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionStartDate │ 2009-07-29 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionStartTime │ 00:00:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionEndDate │ 2020-01-01 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionEndTime │ 00:00:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityStartDate │ 2011-08-05 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityStartTime │ 00:00:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityEndDate │ 2030-01-01 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityEndTime │ 00:00:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ anonymization │ cryptopan/host │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ archivingAllowed │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ keywords │ category:traffic-flow-data, subcategory:continuous-flow-data, flow-data, │ │ │ continuous-traffic, ISP-traffic │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ format │ argus │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ access │ https │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ hostName │ USC-LANDER │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ providerName │ MEMPHIS │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ groupingId │ │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ groupingSummaryFlag │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ retrievalInstructions │ on-site │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ byteSize │ NA │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ expirationDays │ 14 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ uncompressedSize │ │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ impactDoi │ │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ useAgreement │ frgp-continuous │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ irbRequired │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ privateAccessInstructions │ See https://ant.isi.edu/datasets/#getting-datasets for information on obtaining │ │ │ this dataset. │ │ │ See │ └───────────────────────────┴────────────────────────────────────────────────────────────────────────────────────┘ Dataset Contents FRGPContinuousFlowData-20090729.README.txt      copy of this README Data/     YYYY-MM-DD.HHMM.*full.argus.gz argus files (compressed with gzip); 24H traces gathered on date MM/DD/YYYY.     .sha1sum SHA-1 checksum The file ".sha1sum" contains SHA1 checksums of individual compressed files. The integrity of the distribution thus can be checked by independently calculating SHA1 sums of files and comparing them with those listed in the file. If you have the sha1sum utility installed on your system, you can do that by executing: sha1sum --check .sha1sum This has to be done before files are uncompressed. Dataset Generation This is flow data collected with Argus (http://www.qosient.com/argus/) at a 1Gb/s link between three ISPs, FRGP (www.frgp.net), Century Link and Comcast. The files contain flow traffic between FRGP's customers (mostly academic institutions) and the two commercial providers. FRGP has other commercial links, so this is only part of the total traffic at the ISP. This does not include traffic to/from academic networks (I2, NLR, etc.), which goes over non-monitored links. The data is anonymized by scrambling the last byte of each IP address in a prefix preserving manner. The anonymization is consistent for a calendar month. Every first of the month the anonymization key changes. The data is packaged as one Argus file per day, where a day starts at 00:00:00 and ends at 23:59:59 of the calendar day MMDDYY. Flows spanning multiple days are recorded as separate entries (no attempt is made to provide continuity between days). The flow timeout parameter in Argus ranges between 600s until Oct 6, 2011 and 60ss after that. The change was due to an increase in traffic that caused Argus to run out of memory when processing the trace. Requesting the Dataset This is a dataset collected on a continuous basis with one Argus file generated per day. Researchers should specify start/stop dates when they request these datasets. The daily Argus datasets range from 8-30GB depending on collection time - later datasets are larger. A sample of this data is pre-packaged in dataset FRGPContinuousFlowData_sample-20130923. Citation If you use this trace to conduct additional research, please cite it as: FRGP (www.frgp.net) Continuous Flow Dataset, IMPACT ID: USC-LANDER/FRGPContinuousFlowData-20090729/rev3998 . Traces taken to . Provided by the USC/LANDER project (http://www.isi.edu/ant/lander). Results Using This Dataset No results yet. User Annotations Currently no annotations. Categories: • Datasets • LANDER • LANDER:Datasets • LANDER:Datasets:AddressSpace:Adaptive Probing • LANDER:Datasets:AddressSpace • LANDER:Datasets:CSU • LANDER:Datasets:CSU:FRGP