Datasets About DNS

This web page documents our datasets that are about DNS but are not anycast-specific (see also our anycast datasets). Our datasets are available upon request.

We list general DNS datasets first, then a number of paper-specific datasets.

Day in the Life of the Internet

B-Root participates in the Day in the Life of the Internet (DITL) and distributes anonymized versions of that data here. These datasets are 48 hours of B-Root traffic with source IPs subject to host-only anonymization.

Relevant datasets:

A Week of Root DNS

Some experiments require a longer timeframe than the 48-hour DITL provides. To meet that need we provide a week of B-Root traffic, anonymized in the same way.

Relevant datasets:

Curated DNS Anomaly Events

Finally, we make note of DNS anomalies (like DDoS and other large-scale traffic increases) at B-Root and turn unique or intresting events into datasets.

These datasets are typically 24 hours in length and use host-only IP anonymziation.

Relevant datasets:

Recursives in the Wild

Our datasets about recursive resolvers pertain the following papers: [1] [2]

  • Moritz Müller, Giovane C. M. Moura, Ricardo de O. Schmidt and John Heidemann 2017. Recursives in the Wild: Engineering Authoritative DNS Servers. Proceedings of the ACM Internet Measurement Conference (London, UK, 2017), 489–495. [DOI] [PDF] [Dataset] Details
  • Moritz Müller, Giovane C. M. Moura, Ricardo de O. Schmidt and John Heidemann 2017. Recursives in the Wild: Engineering Authoritative DNS Servers. Technical Report ISI-TR-720. USC/Information Sciences Institute. [PDF] Details

The datasets for this work are all from RIPE Atlas:

  • RIPE NCC. RIPE Atlas measurement ids. https://atlas.ripe.net/measurements/ID ID is the experiment ID: 2A: 7951948, 2B: 7953390, 2C: 7967380, 3A: 7961003, 3B: 7954122, 4A: 7966930, 4B: 7960323, 2C-5min: 8321846, 2C-10min: 8323303, 2C-15min: 8324963, 2C-20min: 8329423, 2C-15min: 8335072.

When the Dike Breaks: Dissecting DNS Defenses During DDoS

Our datasets about caching and retries during DDoS pertain the following paper and technical report: [1] [2]

  • Giovane C. M. Moura, John Heidemann, Moritz Müller, Ricardo de O. Schmidt and Marco Davids 2018. When the Dike Breaks: Dissecting DNS Defenses During DDoS. Proceedings of the ACM Internet Measurement Conference (Oct. 2018). [DOI] [PDF] Details
  • Giovane C. M. Moura, John Heidemann, Moritz Müller, Ricardo de O. Schmidt and Marco Davids 2018. When the Dike Breaks: Dissecting DNS Defenses During DDoS (extended). Technical Report ISI-TR-725b. USC/Information Sciences Institute. [PDF] Details

This paper includes data from RIPE Atlas and data we collected at cachetest.nl:

  • RIPE NCC. RIPE Atlas measurement IDS. https://atlas.ripe.net/measurements/ID, Dec. 2017. ID is the experiment ID: TTL60: 10443671, TTL1800: 10507676, TTL3600: 10536725, TTL86400: 10579327, TTL3600-10min: 10581463, A: 10859822, B: 11102436, C: 11221270, D: 11804500, E: 11831403, F: 11831403, G: 12131707, H: 12177478 , I: 12209843.

  • data from cachetest.nl is currently being packaged (as of 2018-05-30; please contact us for details).

LDplayer: DNS Experimentation at Scale

We use B-Root DITL data, including DITL_B_Root-20170411 and DITL_B_Root-20160405, for the evaluation and experiments in the following paper and technical report: [1] [2] [3] [4]

  • Liang Zhu and John Heidemann 2018. LDplayer: DNS Experimentation at Scale. Proceedings of the ACM Internet Measurement Conference (Boston, Massachusetts, USA, Oct. 2018), to appear. [DOI] [PDF] Details
  • Liang Zhu and John Heidemann 2017. LDplayer: DNS Experimentation at Scale. Technical Report 722. USC/Information Sciences Institute. [PDF] Details
  • Liang Zhu and John Heidemann 2017. LDplayer: DNS Experimentation at Scale (abstract with poster). Technical Report ISI-TR-2017-721. USC/Information Sciences Institute. [PDF] Details
  • Liang Zhu and John Heidemann 2017. LDplayer: DNS Experimentation at Scale (poster abstract). Proceedings of the SIGCOMM Posters and Demos (Aug. 2017), 60–62. [DOI] [PDF] Details

Cache Me If You Can: Effects of DNS Time-to-Live

Our paper about DNS caching and TTLs was published at IMC and as a technical report: [1] [2]

  • Giovane C. M. Moura, John Heidemann, Ricardo de O. Schmidt and Wes Hardaker 2019. Cache Me If You Can: Effects of DNS Time-to-Live. Proceedings of the ACM Internet Measurement Conference (Amsterdam, the Netherlands, Oct. 2019), to appear. [DOI] [PDF] Details
  • Giovane C. M. Moura, John Heidemann, Ricardo de O. Schmidt and Wes Hardaker 2019. Cache Me If You Can: Effects of DNS Time-to-Live (extended). Technical Report ISI-TR-734b. USC/Information Sciences Institute. [PDF] Details

We will make the majority of datasets available from this paper no charge. RIPE Atlas datasets are public and listed below. Unfortunately data from .nl cannot be released. We are looking at releaseing our crawls of TLDs.

The datasets for this work are all from RIPE Atlas:

  • RIPE NCC. 2019. RIPE Atlas Measurement IDs. See https://atlas.ripe.net/measurements/ID where ID is the experiment ID: uy-NS: 19544918, a.nic.uy-A: 19581585, google.co-NS: 19927577, mapache-de-madrid.co-NS: 19584842, in-bailiwick: 20199814, out-of-bailiwick: 20181892, TTL60-u:19862830, TTL86400-u:19863763, TTL60-s:19871393, TTL86400-s:19871498, TTL60-s-anycast:19875360, uy-NS2: 19925152, zurrundeddu-offline: 22483308.