Junos Troubleshooting in the NOC 12.b Lab Guide Worldwide Education Services 1133 Innovation Way Sunnyvale, CA 94089 USA 408-745-2000 www.juniper.net Course Number: EDU-JUN-JTNOC This document is produced by Juniper Networks, Inc. This document or any part thereof may not be reproduced or transmitted in any form under penalty of law, without the prior written permission of Juniper Networks Education Services. Juniper Networks, theJuniper Networks logo. Junos. NetScreen, and ScreenOS are registered trademarks of Juniper Networks, Jnc. in the United States and other countries. All other trademarks, service marks, registered trademarks. or registered service marks are the propertyof their respective owners. Junos Troubleshooting in the NOC Lab Guide, Revision 12.b Copyright© 2014Juniper Networks, Inc. All rights reserved. Printed in USA. Revision History: Revision 10.a-December 2010 Revision 11.a-June 2011 Revision 12.a-March 2013 Revision 12.b-January 2014 The information in this document is current as of the date listed above. The information in this document has been carefully verified and is believed to be accurate for software Release 12.2R2.5. Juniper Networks assumes no responsibilities for any inaccuracies that may appear in this document. In no event willJuniper Networks be liable for direct. indirect, special, exemplary, incidental, or consequential damages resulting from any defect or omission in this document, even if advised of the possibility of such damages. Juniper Networks reserves the right to change, modify, transfer, or otherwise revise this publication without notice. YEAR 2000 NOTICE Juniper Networks hardware and software products do not suffer from Year 2000 problems and hence are Year 2000 compliant. The Junos operating system has no known time-related limitations through the year 2038. However. the NTP application is known to have some difficulty in the year 2036. SOFTWARELICENSE The terms and conditions for using Juniper Networks software are described in the software license provided with the software. or to the extent applicable, in an agreement executed between you andJuniper Networks, orJuniper Networks agent. By usingJuniper Networks software, you indicate that you understand and agree to be bound by its license terms and conditions. Generally speaking, the software license restricts the manner in which you are permitted to use theJuniper Networks software, may contain prohibitions against certain uses, and may state conditions under which the license is automatically terminated. You should consult the software license for further details. Contents Lab 1: The Troubleshooting Process ..................................... 1-1 Part 1: Troubleshooting Scenario 1 .......................................................... 1·2 Part 2: Troubleshooting Scenario 2 .......................................................... 1-4 Part 3: Troubleshooting Scenario 3 .......................................................... 1-6 Lab 2: Identifying Hardware Components ................................. 2-1 Part 1: Logging In Using the CU ............................................................. 2-2 Part 2: Verifying Initial Device Configuration ................................................... 2-3 Part3: Identifying Hardware and Key Components ............................................. 2-7 Part 4: Utilizing Online Resources............ ................................................ 2-9 Lab 3: Using Monitoring Tools and Establishing a Baseline .................. 3-1 Part 1: Viewing Alarms, Environmental Conditions, and Hardware Inventory ......................... 3-2 Part 2: Establishing a Baseline .............................................................. 3-9 Part 3: Locating Online Resources .......................................................... 3-17 Lab 4: Monitoring Hardware and Environmental Conditions .................. 4-1 Part 1: Monitoring Memory and Storage ...................................................... 4-2 Part 2: Viewing Boot and System Logs ........................................................ 4-7 Part 3: Monitoring the Chassis and Environment .............................................. 4-13 Lab 5: Control Plane Monitoring and Troubleshooting ....................... 5-1 Part 1: Examining User Processes and Daemons ............................................... 5-2 Part 2: Generating Core Files .............................................................. 5-10 Part 3: Configuring Routing Protocols and Routing Tables ....................................... 5-13 Part 4: Configuring Bridging ............................................................... 5-27 Lab 6: Monitoring and Troubleshooting Ethernet Interfaces .................. 6-1 Part 1: Performing Interface Troubleshooting .................................................. 6-2 Part 2: Performing Loopback Testing ........................................................ 6-13 Part 3: Configuring Ethernet OAM ...........................................................6-19 Lab 7: Isolating and Troubleshooting PFE Issues ........................... 7-1 Part 1: Examining the Forwarding Table ...................................................... 7-2 Part 2: Configuring Load Balancing .......................................................... 7-7 Part 3: Troubleshooting Firewall Filters ...................................................... 7-11 Lab 8: Troubleshooting Routing Protocols ................................ 8-1 Part 1: Modifying the Existing Configurations .................................................. 8-2 Part 2: Troubleshooting OSPF Adjacencies ......................•••••......................... 8-3 Part 3: Troubleshooting BGP Sessions ....................................................... 8-19 Part 4: Troubleshooting Routing Loops ..........................•........................... 8-34 Lab 9: Monitoring the Network .......................................... 9-1 Part 1: Modifying the Existing Configurations .................................................. 9-2 Part 2: Configuring and Monitoring SNMP .......................•.........••.....•............ · 9-3 Part 3: Configuring and Monitoring RMON .................................................... 9·11 Part 4: Configuring and Monitoring In line JFlow ............................................... 9-19 Part 5: Configuring and Monitoring Inline Port Mirroring .............•.......................... 9-23 www.juniper.net Contents • iii iv • Contents www.juniper.net Course Overview This three-day course is designed to provide introductory troubleshooting skills for engineers in a network operations center (NOC) environment. Key topics within this course include troubleshooting methodology, troubleshooting tools, hardware monitoring and troubleshooting, interface monitoring and troubleshooting, troubleshooting the data plane and control plane on devices running the Junos operating system, staging and acceptance methodology, troubleshooting routing protocols, monitoring the network, and working with JTAC. This course is based on Ju nos operating system Release 12.2R2.5. Objectives After successfully completing this course, you should be able to: Reduce the time it takes to identify and isolate the root cause of an issue impacting your network. Gain familiarity with Ju nos products as they pertain to troubleshooting. Become familiar with online resources valuable to Junos troubleshooting. Gain familiarity with Junos tools used in troubleshooting. Identify and isolate hardware issues. Troubleshoot problems with the control plane. Troubleshoot problems with interfaces and other data plane components. Describe the staging and acceptance methodology. Troubleshoot routing protocols. Describe how to monitor your network with SNMP, RMON, JFlow, and port mirroring. Become familiar with JTAC procedures. Intended Audience The course content is aimed at operators of devices running the Junos OS in a NOC environment. These operators include network engineers, administrators, support personnel, and reseller support personnel. Course Level Junos Troubleshooting in the NOC is an introductory-level course. Prerequisites Students should have basic networking knowledge and an understanding of the Open Systems Interconnection (OSI) reference model and the TCP/IP protocol suite. Students should also attend the Introduction to the Junos Operating System (IJOS) course and the Junos Routing Essentials (JRE) course, or have equivalent experience prior to attending this class. www.juniper.net Course Overview • v Course Agenda Day1 Chapter 1: Course Introduction Chapter 2: Troubleshooting as a Process The Troubleshooting Process Lab Chapter 3: Junos Product Families Identifying Hardware Components Lab Chapter 4: Troubleshooting Toolkit Monitoring Tools and Establishing a Baseline Lab Day2 Chapter 5: Hardware and Environmental Conditions Monitoring Hardware and Environmental Conditions Lab Chapter 6: Control Plane Control Plane Monitoring and Troubleshooting Lab Chapter 7: Data Plane: Interfaces Monitoring and Troubleshooting Ethernet Interfaces Lab Chapter 8: Data Plane: Other Components Isolating and Troubleshooting PFE Issues Lab Day3 Chapter 9: Staging and Acceptance Testing Chapter 10: Troubleshooting Routing Protocols Troubleshooting Routing Protocols Lab Chapter 11: High Availability Chapter 12: Network Monitoring Monitoring the Network Lab Chapter 13: JTAC Procedures Appendix A: Interface Troubleshooting vi • Course Agenda www.juniper.net Document Conventions CLI