LANDER:FRGPContinuousFlowData-20090729 From Predict Jump to navigation Jump to search The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead. README version: 3998, last modified: 2014-05-29. This file describes the trace dataset "FRGPContinuousFlowData-20090729" provided by the LANDER project. The most recent version of this file can be found on-line at https://wiki.isi.edu/predict/index.php?title=LANDER:FRGPContinuousFlowData-20090729. [ ] Contents • 1 LANDER Metadata • 2 Dataset Contents • 3 Dataset Generation • 4 Requesting the Dataset • 5 Citation • 6 Results Using This Dataset • 7 User Annotations LANDER Metadata (https://wiki.isi.edu/predict/index.php?title=LANDER:FRGPContinuousFlowData-20090729/landermeta) ┌─────────────────────────┬───────────────────────────────────────────────────────────────────────────────────────┐ │dataSetName │FRGPContinuousFlowData-20090729 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │status │usc-web-and-predict │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │shortDesc │FRGP Continuous Flow Data │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │longDesc │Daily Argus files with flows on a 1Gb/s link between FRGP.net and Century Link/Comcast.│ │ │Has traffic from several academic institutions. Should be requested as continuous │ │ │interval specified by start-date..end-date. │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │datasetClass │Unclassified │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │commercialAllowed │true │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │requestReviewRequired │true │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │productReviewRequired │false │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │ongoingMeasurement │true │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │submissionMethod │Upload │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │collectionStartDate │2009-07-29 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │collectionStartTime │00:00:00 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │collectionEndDate │2020-01-01 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │collectionEndTime │00:00:00 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │availabilityStartDate │2011-08-05 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │availabilityStartTime │00:00:00 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │availabilityEndDate │2030-01-01 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │availabilityEndTime │00:00:00 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │anonymization │cryptopan/host │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │archivingAllowed │false │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │keywords │category:traffic-flow-data, subcategory:continuous-flow-data, flow-data, │ │ │continuous-traffic, ISP-traffic │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │format │argus │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │access │https │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │hostName │USC-LANDER │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │providerName │MEMPHIS │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │groupingId │ │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │groupingSummaryFlag │false │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │retrievalInstructions │on-site │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │byteSize │NA │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │expirationDays │14 │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │uncompressedSize │ │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │impactDoi │ │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │useAgreement │frgp-continuous │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │irbRequired │false │ ├─────────────────────────┼───────────────────────────────────────────────────────────────────────────────────────┤ │privateAccessInstructions│See http://www.isi.edu/ant/traces/index.html#getting_datasets for information on │ │ │obtaining this dataset. │ │ │See https://wiki.isi.edu/predict/index.php?title=LANDER:FRGPContinuousFlowData-20090729│ │ │for details on this dataset. │ └─────────────────────────┴───────────────────────────────────────────────────────────────────────────────────────┘ Dataset Contents FRGPContinuousFlowData-20090729.README.txt      copy of this README Data/     YYYY-MM-DD.HHMM.*full.argus.gz argus files (compressed with gzip); 24H traces gathered on date MM/DD/YYYY.     .sha1sum SHA-1 checksum The file ".sha1sum" contains SHA1 checksums of individual compressed files. The integrity of the distribution thus can be checked by independently calculating SHA1 sums of files and comparing them with those listed in the file. If you have the sha1sum utility installed on your system, you can do that by executing: sha1sum --check .sha1sum This has to be done before files are uncompressed. Dataset Generation This is flow data collected with Argus (http://www.qosient.com/argus/) at a 1Gb/s link between three ISPs, FRGP (www.frgp.net), Century Link and Comcast. The files contain flow traffic between FRGP's customers (mostly academic institutions) and the two commercial providers. FRGP has other commercial links, so this is only part of the total traffic at the ISP. This does not include traffic to/from academic networks (I2, NLR, etc.), which goes over non-monitored links. The data is anonymized by scrambling the last byte of each IP address in a prefix preserving manner. The anonymization is consistent for a calendar month. Every first of the month the anonymization key changes. The data is packaged as one Argus file per day, where a day starts at 00:00:00 and ends at 23:59:59 of the calendar day MMDDYY. Flows spanning multiple days are recorded as separate entries (no attempt is made to provide continuity between days). The flow timeout parameter in Argus ranges between 600s until Oct 6, 2011 and 60ss after that. The change was due to an increase in traffic that caused Argus to run out of memory when processing the trace. Requesting the Dataset This is a dataset collected on a continuous basis with one Argus file generated per day. Researchers should specify start/stop dates when they request these datasets. The daily Argus datasets range from 8-30GB depending on collection time - later datasets are larger. A sample of this data is pre-packaged in dataset FRGPContinuousFlowData_sample-20130923. Citation If you use this trace to conduct additional research, please cite it as: FRGP (www.frgp.net) Continuous Flow Dataset, IMPACT ID: USC-LANDER/FRGPContinuousFlowData-20090729/rev3998 . Traces taken to . Provided by the USC/LANDER project (http://www.isi.edu/ant/lander). Results Using This Dataset No results yet. User Annotations Suggestion: Edit the annotations at https://wiki.isi.edu/predict/index.php?title=LANDERNOTES:FRGPContinuousFlowData-20090729&action=edit Currently no annotations. Retrieved from "https://wiki.isi.edu/predict/index.php?title=LANDER:FRGPContinuousFlowData-20090729&oldid=3998" Categories: • Datasets • LANDER • LANDER:Datasets • LANDER:Datasets:CSU • LANDER:Datasets:CSU:FRGP Navigation menu Personal tools • Wikiexport • Talk • Preferences • Watchlist • Contributions • Log out Namespaces • LANDER • Discussion [ ] English Views • Read • Edit • View history • Watch [ ] More • Move _____________________ [ Search ] [ Go ] Navigation • Main page • Providers • Datasets • Results • Categories • Recent changes • Random page • Help Tools • What links here • Related changes • Upload file • Special pages • Permanent link • Page information • This page was last edited on 29 May 2014, at 11:36. • Content is available under Attribution-Share Alike 3.0 Unported unless otherwise noted. • Privacy policy • About Predict • Disclaimers • Attribution-Share Alike 3.0 Unported • Powered by MediaWiki