TR-143 Enabling Network Throughput Performance Tests and Statistical Monitoring
Total Page:16
File Type:pdf, Size:1020Kb
TECHNICAL REPORT TR-143 Enabling Network Throughput Performance Tests and Statistical Monitoring Issue: 1 Amendment 1 Corrigendum 1 Issue Date: August 2015 © The Broadband Forum. All rights reserved. Enabling Network Throughput Performance Tests and Statistical Monitoring TR-143 Issue 1 Amendment 1 Corrigendum 1 Notice The Broadband Forum is a non-profit corporation organized to create guidelines for broadband network system development and deployment. This Broadband Forum Technical Report has been approved by members of the Forum. This Broadband Forum Technical Report is not binding on the Broadband Forum, any of its members, or any developer or service provider. This Broadband Forum Technical Report is subject to change, but only with approval of members of the Forum. This Technical Report is copyrighted by the Broadband Forum, and all rights are reserved. Portions of this Technical Report may be copyrighted by Broadband Forum members. THIS SPECIFICATION IS BEING OFFERED WITHOUT ANY WARRANTY WHATSOEVER, AND IN PARTICULAR, ANY WARRANTY OF NONINFRINGEMENT IS EXPRESSLY DISCLAIMED. ANY USE OF THIS SPECIFICATION SHALL BE MADE ENTIRELY AT THE IMPLEMENTER'S OWN RISK, AND NEITHER the Forum, NOR ANY OF ITS MEMBERS OR SUBMITTERS, SHALL HAVE ANY LIABILITY WHATSOEVER TO ANY IMPLEMENTER OR THIRD PARTY FOR ANY DAMAGES OF ANY NATURE WHATSOEVER, DIRECTLY OR INDIRECTLY, ARISING FROM THE USE OF THIS SPECIFICATION. Broadband Forum Technical Reports may be copied, downloaded, stored on a server or otherwise re-distributed in their entirety only, and may not be modified without the advance written permission of the Broadband Forum. The text of this notice must be included in all copies of this Broadband Forum Technical Report. August 2015 © The Broadband Forum. All rights reserved. 2 Enabling Network Throughput Performance Tests and Statistical Monitoring TR-143 Issue 1 Amendment 1 Corrigendum 1 TR Issue History Issue Number Approval Publication Issue Editor Changes Date Date 1 May 2008 Tim Spets, Westell Original Larry Jones, Verizon Richard Jia, Verizon Greg Bathrick, PMC- Sierra Corrigendum 1 December Tim Spets, Westell Remove 2008 TCPOpenRequestTime and TCPOpenResponseTime from Download and Upload profiles to fix editorial mistake. Also 2 typos fixed. Replaces TR-143 Issue 1 (May 2008) Amendment 1 1 December 4 February Sharam Hakimi, Added: 2014 2015 EXFO UDPEchoPlus client Steve Nicolai, Arris initiated testing. Time base in addition to file size, Multi Threading/Connections. Server Diagnostics. IPv4/IPv6 protocol selection. Amendment 1 24 August 18 September Steve Nicolai, Arris Remove IGD:1.14 and Corrigendum 1 2015 2015 Device:1.13. TestRespReplyFailureCou nt -> TestRespRecvTimeStamp and TestRespReplyTimeStamp. in A1.4 note. Fixed typos. Comments or questions about this Broadband Forum Technical Report should be directed to [email protected]. August 2015 © The Broadband Forum. All rights reserved. 3 Enabling Network Throughput Performance Tests and Statistical Monitoring TR-143 Issue 1 Amendment 1 Corrigendum 1 Editors Steven Nicolai Arris BroadbandHome Jason Walls QA Cafe WG Chairs John Blackford Pace August 2015 © The Broadband Forum. All rights reserved. 4 Enabling Network Throughput Performance Tests and Statistical Monitoring TR-143 Issue 1 Amendment 1 Corrigendum 1 TABLE OF CONTENTS EXECUTIVE SUMMARY .......................................................................................................... 7 1 PURPOSE AND SCOPE ...................................................................................................... 8 1.1 PURPOSE .......................................................................................................................... 8 1.2 SCOPE .............................................................................................................................. 8 2 REFERENCES AND TERMINOLOGY ............................................................................ 9 2.1 CONVENTIONS ................................................................................................................. 9 2.2 REFERENCES .................................................................................................................. 10 2.3 DEFINITIONS .................................................................................................................. 10 2.4 ABBREVIATIONS ............................................................................................................ 11 3 TECHNICAL REPORT IMPACT ................................................................................... 12 3.1 ENERGY EFFICIENCY ...................................................................................................... 12 3.2 IPV6 ............................................................................................................................... 12 3.3 SECURITY ....................................................................................................................... 12 3.4 PRIVACY ........................................................................................................................ 12 4 ACTIVE MONITORING .................................................................................................. 13 4.1 CPE INITIATED DIAGNOSTICS ......................................................................................... 14 4.2 NETWORK INITIATED DIAGNOSTICS ................................................................................ 15 4.3 TIME-BASED THROUGHPUT TESTING .............................................................................. 16 4.4 MULTI-THREADING/CONNECTIONS ............................................................................... 17 5 PARAMETER DEFINITIONS ......................................................................................... 18 APPENDIX A: THEORY OF OPERATIONS ........................................................................ 19 A.1 CLIENT AND NETWORK INITIATED UDPECHODIAGNOSTICS ......................................... 19 A.1.1 Introduction........................................................................................................... 19 A.1.2 Motivation ............................................................................................................. 19 A.1.3 Security Considerations – Network initiated tests ................................................ 20 A.1.4 UDPEchoPlus Packet format ............................................................................... 20 A.1.5 UDPEcho and UDPEchoPlus server setup. ......................................................... 21 A.1.6 UDPEchoPlus Client ............................................................................................ 21 A.1.7 UDPEchoPlus server ............................................................................................ 21 A.1.8 Performance Metrics examples with UDPEchoPlus ............................................ 22 A.2 DOWNLOADDIAGNOSTICS UTILIZING FTP TRANSPORT ................................................. 26 A.3 UPLOADDIAGNOSTICS UTILIZING FTP TRANSPORT ....................................................... 30 A.4 DOWNLOADDIAGNOSTICS UTILIZING HTTP TRANSPORT ............................................... 34 A.5 UPLOADDIAGNOSTICS UTILIZING HTTP TRANSPORT ..................................................... 36 A.6 TIME-BASED FILE TRANSFER (HTTP/FTP) ................................................................... 38 A.7 USE OF MULTI THREADING/CONNECTIONS .................................................................... 40 A.7.1 File Transfer Mode ............................................................................................... 40 A.7.2 Time-Based Transfer Mode................................................................................... 41 August 2015 © The Broadband Forum. All rights reserved. 5 Enabling Network Throughput Performance Tests and Statistical Monitoring TR-143 Issue 1 Amendment 1 Corrigendum 1 A.7.3 Period of Full Loading.......................................................................................... 42 A.8 SERVERSELECTIONDIAGNOSTICS .................................................................................. 42 APPENDIX B: TEST RESULTS .............................................................................................. 43 B.1 UPLOADDIAGNOSTICS AND DOWNLOADDIAGNOSTICS TEST RESULTS .......................... 43 B.2 ASYMMETRICAL CONSIDERATIONS ................................................................................ 44 List of Figures Figure 1 Performance Testing Components ................................................................................. 13 Figure 2 CPE DownloadDiagnostics using HTTP transport. ....................................................... 15 Figure 3 UDPEchoPlus Event Sequence ...................................................................................... 25 Figure 4 DownloadDiagnostics using FTP transport .................................................................... 29 Figure 5 UploadDiagnostics utilizing FTP transport .................................................................... 33 Figure 6 DownloadDiagnostics utilizing HTTP transport ............................................................ 36 Figure 7 UploadDiagnostics utilizing HTTP transport ................................................................. 38 Figure 8 CPE Time-based throughput diagnostics using HTTP/FTP transport. .......................... 39 Figure 9 Time-Based