Perfsonar Deep Dive

perfSONAR Deep Dive

v4 – January 26 th 2015 Abstract perfSONAR1 is a networking monitoring framework that assists with the discovery of soft network failures across end to end paths. perfSONAR version 3.4, an advancement from previous versions with support for many community requested features, was released in October of 2014. perfSONAR is most useful when deployed on networks of interest: campus or laboratory networks that host scientific facilities or HPC resources, regional networks, backbone networks, and exchange points. Common barriers to adoption include:

 Complexity of deploying tools for common use cases  Disconnect between availability of the tools, and how to use them for problem solving  Questions regarding how well perfSONAR integrates into a modern IT environment (e.g. automation, security, impact on background traffic)

The perfSONAR Deep Dive was constructed to address these concerns with a mixture of education and hands-on deployment strategies. Audience The expected audience member is a network engineer that has previously deployed perfSONAR in a networking environment, but may never have dug into the underlying functionalities. The material is being designed to be intermediate in nature, and will touch on some advanced topics. Attendees will participate in the workshop actively: the end goal is to further perfSONAR deployment and use. Preliminary Work Participants are expected to complete some base tasks before arriving. Everyone must installing perfSONAR Toolkit version 3.4 in the span of time before the workshop on resources they control. Advanced configuration is not needed, and the instructors will only assume the node or nodes will be remotely accessible to the participant. Only perfSONAR Toolkit 3.4 will be discussed; older versions of the software, as well as hand-built systems, are discouraged for this event.

1 http://www.perfsonar.net

Designating a regional champion will be discussed beforehand, and that person will help to coordinate the installation of the perfSONAR dashboard software on a virtual machine in a public location. This can be sponsored by one of the participating campuses, or a regional network. The goal of this machine will be to collected data from campus perfSONAR nodes that are initiating tests to each other, and display them for all interested parties in a public location. Topics The following topics are being discussed for this event. The goal will be to discuss, and then implement, each of these on the nodes that are located at each campus.

 Configuration of perfSONAR 3.4  Mesh configuration strategies and the perfSONAR dashboard  Integration with enterprise IT (NAGIOS, configuration management, log aggregation/analysis)  Securing the perfSONAR Node  Diagnostic use of perfSONAR  Debugging end-to-end problems Expected Outcomes Every participate will leave with:

 A better understanding of how to configure and manage perfSONAR in an IT environment  A completely functional perfSONAR node, participating in measurements to points of interest.  A usable regional perfSONAR mesh that shows the results of tests between campuses, and to other points of interest  Knowledge of the process needed to initiate multi-domain network debugging using perfSONAR  An understanding of common network problems, and their respective signatures, as seen through perfSONAR tools Agenda

 Day 1 Schedule – perfSONAR Tutorial (Wednesday, Jan 28th) o Breakfast (around 8am – 9:00am) o Morning 1 (9:00am – 10:15am = 1hr 15 min)  5 Min: Welcome & Introductions o Welcome and purpose of workshop. Round-the- room introductions.  45 Min: Science DMZ Story o Eli  25 Min: What is perfSONAR in < 30 minutes o Overview of project history, and tool purpose. o Jason o Break (15 min) o Morning 2 (10:30am -12:30pm = 2 hrs)  30 Min: perfSONAR Basic Configuration o Everyone should have a node at his or her home institution. We are going to configure it for basic use. o Jason  45 Min: Maddash Installation and Configuration o CENIC will have a regional VM ready with the mesh software. We are going to integrate all the hosts and start the regular testing process. o Jason  45 Min: Maintaining a perfSONAR Node (Security & Operations) o Overview of security posture for perfSONAR, and effective strategies for maintenance. o Overview of the care and feeding of a perfSONAR node, and ways it can be integrated into the operational culture. o Jason o Lunch (12:30pm – 1:30pm) o Afternoon 1 (1:30pm – 3pm = 1.5hrs)  45 Min: perfSONAR Use Cases & Success Stories o How perfSONAR has helped others. o Jason  45 Min: Debugging with perfSONAR o Introduction to command line use of tools and interpreting data in graphs. o Strategies for debugging harder problems. o Eli o Break (30 min) o Afternoon 2 (3:30pm – 5:00pm = 1.5 hrs)  30 Min: Pulling it All Together: perfSONAR as a Regional Asset o Why does it all matter? An overview of how the region can use perfSONAR for performance assurance. o Jason  30 Min: Review of Regional Mesh o Revisit the mesh from the morning, see that it is working and identify some issues to follow up on overnight, and tomorrow.  30 Min: Spill, Questions, Discussion, & Plans for Thurs

 Day 2 Schedule – perfSONAR Regional Debugging (Thursday, Jan 29th) o Breakfast (8am – 8:30am = .5hr) o Morning 1 (8:30am – 10:00am = 1.5hrs) . Review data from Regional Mesh . 1:1 Debugging – getting the data to show up between all parties that are participating o Break (30 min) o Morning 2 (10:30am -12:30pm = 2 hrs) . Regional Debugging – pick some problems to highlight. Time will vary depending on access levels to devices and things in the path. o Lunch (12:30pm – 1:30pm) o Afternoon 1 (1:30pm – 3pm = 1.5hrs) . Regional Debugging – pick some problems to highlight. Time will vary depending on access levels to devices and things in the path. o Break (30 min) o Afternoon 2 (3:30pm – 5:00pm = 1.5 hrs) . Regional Debugging – pick some problems to highlight. Time will vary depending on access levels to devices and things in the path. . Spill, Questions, Discussion, & Plans for Fri

 Day 3 Schedule – perfSONAR Office Hours (Friday, Jan 30th) o Breakfast (8am – 8:30am = .5hr) o Morning 1 (8:30am – 10:00am = 1.5hrs) . Office Hours – bring your questions and instructors will answer/assist 1:1 o Break (30 min) o Morning 2 (10:30am -12:30pm = 2 hrs) . Office Hours – bring your questions and instructors will answer/assist 1:1 o Lunch (12:30pm – 1:30pm)