Troubleshooting Riverbed® Steelhead® WAN Optimizers Edwin Groothuis Public Document Public Document Troubleshooting Riverbed® Steelhead® WAN Optimizers Edwin Groothuis Publication date Mon 19 May 2014 10:59:17 Copyright © 2011, 2012, 2013, 2014 Riverbed Technology, Inc Abstract General: All rights reserved. This book may be distributed outside Riverbed to Riverbed customers via the Riverbed Support website. Except for the foregoing, no part of this book may be further redistributed, reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system, without written permission from Riverbed Technology, Inc.. Warning and disclaimer: This book provides foundational information about the troubleshooting of the Riverbed WAN optimization im- plementation and appliances. Every effort has been made to make this book as complete and accurate as possible, but no warranty or fitness is implied. The information is provided on as "as is" basis. The author and Riverbed Technology shall have neither liability nor responsibility to any person or entity with respect to any loss or damages arising from the information contained in this book. The opinions expressed in this book belong to the author and are not necessarily those of Riverbed Technology. Riverbed and any Riverbed product or service name or logo used herein are trademarks of Riverbed Technology, Inc. All other trademarks used herein belong to their respetive owners. Feedback Information: If you have any comments regarding how the quality of this book could be improved, please contact the author. He can be reached via email at [email protected] or at [email protected], his personal website can be found at http://www.mavetju.org/. Public Document Public Document Table of Contents Preface ........................................................................................................................................ vi 1. Introduction to WAN Optimization ............................................................................................... 1 1.1. Index ............................................................................................................................. 1 1.2. Why WAN optimization? ................................................................................................. 1 1.3. Three different optimization methods .................................................................................. 2 1.4. Effects of WAN optimization on other equipment ................................................................. 6 2. The Riverbed Approach to WAN Optimization ............................................................................... 9 2.1. Index ............................................................................................................................. 9 2.2. Appliance Setup .............................................................................................................. 9 2.3. Basic configuration of a Steelhead appliance ...................................................................... 13 2.4. The layout of an optimized TCP session ............................................................................ 15 2.5. The setup of an optimized TCP session. ............................................................................ 17 2.6. WAN Visibility ............................................................................................................. 22 2.7. The optimization protocol ............................................................................................... 22 2.8. Hardware models ........................................................................................................... 23 3. The Command Line and Tools ................................................................................................... 34 3.1. Index ........................................................................................................................... 34 3.2. Dealing with the Command Line Interface ......................................................................... 35 3.3. Tcpdump, the network packet capture tool ......................................................................... 38 3.4. Tcpdump-x ................................................................................................................... 48 3.5. Ping ............................................................................................................................. 49 3.6. Traceroute .................................................................................................................... 52 3.7. Telnet .......................................................................................................................... 55 3.8. Tproxytrace .................................................................................................................. 56 3.9. Nettest ......................................................................................................................... 57 3.10. SSL connect ................................................................................................................ 60 4. Installation Related Issues .......................................................................................................... 64 4.1. Index ........................................................................................................................... 64 4.2. Installation steps for fail-to-wire scenarios .......................................................................... 64 4.3. Fail-to-Wire .................................................................................................................. 65 4.4. Cables .......................................................................................................................... 66 4.5. Network Interface Card speed issues ................................................................................. 68 4.6. IP Subnet configuration related issues ............................................................................... 70 4.7. Wrong location .............................................................................................................. 73 4.8. In-path support on interface not enabled ............................................................................ 74 4.9. Port security ................................................................................................................. 75 4.10. Link State Propagation (LSP) ......................................................................................... 76 4.11. VPN Concentrators ....................................................................................................... 77 4.12. Licenses ..................................................................................................................... 78 4.13. LAN and WAN cable switched ...................................................................................... 81 4.14. After an RMA ............................................................................................................. 82 4.15. Best cabling for remote management ............................................................................... 83 5. Operation Related Issues ........................................................................................................... 84 5.1. Index ........................................................................................................................... 84 5.2. Hardware related issues .................................................................................................. 85 5.3. Admission Control ......................................................................................................... 89 5.4. Auto-negotiation and duplex issues ................................................................................... 95 5.5. LAN speed maxed out .................................................................................................... 96 5.6. Watchdogs .................................................................................................................... 97 5.7. Unexpected restarts of the optimization service ................................................................... 97 5.8. Unexpected reboots ...................................................................................................... 100 5.9. Downgrade and upgrade issues ....................................................................................... 102 5.10. Time related issues - The NTP service. .......................................................................... 105 5.11. Firewalls in the path ................................................................................................... 108 5.12. Data Store Synchronization .......................................................................................... 109 iii Public Document Troubleshooting Riverbed® Public Document Steelhead® WAN Optimizers 5.13. Data store related errors .............................................................................................. 111 5.14. WCCP issues ............................................................................................................. 113 5.15. Asymmetric Routing ................................................................................................... 116 5.16.