Collecting and Visualizing Outages Over the Long Haul

Collecting and Visualizing Outages Over the Long Haul

Heidemann, John
USC/Information Sciences Institute

John Heidemann 2017. Collecting and Visualizing Outages Over the Long Haul. Talk at Active Internet Measurement Workshop.

Abstract

We have been collecting data about outages in the Internet since Oct. 2014. Our outage detection system, Trinocular, uses active probing from four sites to study about 4 million /24 IPv4 address blocks. Long-duration measurements bring challenges that don’t occur in short observations. Most importantly, our target (“the Internet”) changes as we measure it, as new blocks come on-line, old blocks are reused in different ways, and ISPs observe and sometimes block our traffic. Our measurement platform also sees occasional hardware failures. Visualization can assist detection of these problems, allowing human perception to detect changes in data collection that have not previously been anticipated. This talk will discuss the challenges of long-term outage measurement and describe our new algorithm that scales to support clustering of 4M blocks and 3 months of observations for visualization. \newline\indent Our visualization is joint work with Yuri Pradkin, and analysis of our long-term outages includes work with Abdulla Alwabel.

Reference

@misc{Heidemann17b,
  author = {Heidemann, John},
  title = {Collecting and Visualizing Outages Over the Long Haul},
  howpublished = {Talk at  Active Internet Measurement Workshop},
  month = mar,
  year = {2017},
  sortdate = {2017-03-01},
  project = {ant, nocredit, lacrend, retrofuturebridge, duoi},
  jsubject = {dns},
  location = {johnh: pafile},
  keywords = {dns, outage detection, visualization},
  url = {http://www.isi.edu/%7ejohnh/PAPERS/Heidemann17b.html},
  pdfurl = {http://www.isi.edu/%7ejohnh/PAPERS/Heidemann17b.pdf},
  blogurl = {https://ant.isi.edu/blog/?p=969},
  myorganization = {USC/Information Sciences Institute},
  copyrightholder = {authors}
}