LANDER:rdns ipv4-20151023 From Predict README version: 5070, last modified: 2015-11-13. This file describes the trace dataset "rdns_ipv4-20151023" provided by the LANDER project. This dataset contains reverse DNS hostnames for all public, unicast IPv4 addresses, with data collected late in 2015. This dataset was generated by Abdulla Alwabel. Contents • 1 LANDER Metadata • 2 Dataset Contents • 3 Collection Method • 4 Citation • 5 Results Using This Dataset • 6 User Annotations LANDER Metadata ┌───────────────────────────┬────────────────────────────────────────────────────────────────────────────────────┐ │ dataSetName │ rdns_ipv4-20151023 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ status │ usc-web-and-predict │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ shortDesc │ Reverse DNS IPv4 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ longDesc │ Reverse-DNS mapping information for all of the IPv4 address space. │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ datasetClass │ Quasi-Restricted │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ commercialAllowed │ true │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ requestReviewRequired │ true │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ productReviewRequired │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ ongoingMeasurement │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ submissionMethod │ Upload │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionStartDate │ 2015-10-23 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionStartTime │ 00:00:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionEndDate │ 2015-10-28 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionEndTime │ 00:00:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityStartDate │ 2017-01-18 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityStartTime │ 23:50:23 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityEndDate │ 2030-01-01 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityEndTime │ 00:00:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ anonymization │ none │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ archivingAllowed │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ keywords │ category:dns-data, subcategory:public-dns-data, DNS │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ format │ text │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ access │ https │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ hostName │ USC-LANDER │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ providerName │ USC │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ groupingId │ │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ groupingSummaryFlag │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ retrievalInstructions │ download │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ byteSize │ 13004439552 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ expirationDays │ 14 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ uncompressedSize │ 430592531453 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ impactDoi │ 10.23721/109/1354186 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ useAgreement │ dua-ni-160816 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ irbRequired │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ privateAccessInstructions │ See https://ant.isi.edu/datasets/#getting-datasets for information on obtaining │ │ │ this dataset. │ │ │ See │ └───────────────────────────┴────────────────────────────────────────────────────────────────────────────────────┘ Dataset Contents This dataset includes reverse-DNS mapping information for all of the allocated IPv4 address space, according to IANA assignment on 2015-08-10. We have gathered this data by crawling the reverse DNS space. The crawl took place from Oct 23 to Oct 28th 2015. We started by crawling IPs used by ever active IPs on Oct 23, then we crawled the reset IPv4 from 25th to 28th. This information is derived from public sources. This datasets consists 14 datasets, each containing the reverse DNS names for IP addresses that start with a given common first four bits: rdns.0.fsdb.bz2 rdns.1.fsdb.bz2 rdns.2.fsdb.bz2 rdns.3.fsdb.bz2 rdns.4.fsdb.bz2 rdns.5.fsdb.bz2 rdns.6.fsdb.bz2 rdns.7.fsdb.bz2 rdns.8.fsdb.bz2 rdns.9.fsdb.bz2 rdns.a.fsdb.bz2 rdns.b.fsdb.bz2 rdns.c.fsdb.bz2 rdns.d.fsdb.bz2 Each file is in Fsdb format, a tab-separated text format with # comments. The schema is: #fsdb -F t block hexip ip answer authority rrsig timestamp duration source 010007 010007f0 1.0.7.240 ip1.ip0.ip7.ip240.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007f1 1.0.7.241 ip1.ip0.ip7.ip241.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007f2 1.0.7.242 ip1.ip0.ip7.ip242.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007f3 1.0.7.243 ip1.ip0.ip7.ip243.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007f4 1.0.7.244 ip1.ip0.ip7.ip244.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007f5 1.0.7.245 ip1.ip0.ip7.ip245.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007f6 1.0.7.246 ip1.ip0.ip7.ip246.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007f7 1.0.7.247 ip1.ip0.ip7.ip247.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007f8 1.0.7.248 ip1.ip0.ip7.ip248.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007f9 1.0.7.249 ip1.ip0.ip7.ip249.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007fa 1.0.7.250 ip1.ip0.ip7.ip250.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007fb 1.0.7.251 ip1.ip0.ip7.ip251.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007fc 1.0.7.252 ip1.ip0.ip7.ip252.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007fd 1.0.7.253 ip1.ip0.ip7.ip253.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007fe 1.0.7.254 ip1.ip0.ip7.ip254.reverse.bigredgroup.net.au - - - - USC-ISI 010007 010007ff 1.0.7.255 ip1.ip0.ip7.ip255.reverse.bigredgroup.net.au - - - - USC-ISI 010008 01000800 1.0.8.0 - 1.in-addr.arpa. 60 IN SOA ns1.apnic.net. read-txt-record-of-zone-first-dns-admin.apnic.net. 5405 7200 1800 604800 172800 - - - USC-ISI • block: is each /24, in hex format, without trailing zeros. • hexip: is hexdecimal version of the probed IP. • ip: is the full IPv4 address in format. • answer: is the reverse-DNS name for the IP address, or - if none was returned. • authority: is the SOA record in the authority section, if there is no answer. (If there is an answer, it is -) • rrsig: The RRSIG of the IP encoded with Base64. (This is not available in this particular dataset) • timestamp: When the IP was last probed in Unix epoch time format. (This is not available in this particular dataset). • duration: How long the query took (This is not available in this particular dataset). • source: The ID of who is running the probe Each file is sorted by hexip. The file ".sha1sum" contains SHA1 checksums of individual compressed files. The integrity of the distribution thus can be checked by independently calculating SHA1 sums of files and comparing them with those listed in the file. If you have the sha1sum utility installed on your system, you can do that by executing: sha1sum --check .sha1sum Collection Method The data was collected with probing with a custom built script done in a random order over ~ a week. Citation If you use this trace to conduct additional research, please cite it as: PREDICT ID: USC-LANDER/rdns_ipv4-20151023/rev5070. Traces generated on 2015-10-00. Provided by the USC/LANDER project (http://www.isi.edu/ant/lander). Results Using This Dataset We have used this dataset for some internal work, but publications are not yet released as of 2015-11-08. User Annotations Currently no annotations. Categories: • Datasets • LANDER • LANDER:Datasets