Emulex® Drivers for Linux User Guide Release 12.6 Broadcom DRVLin-UG126-100 February 4, 2020 Broadcom, the pulse logo, Connecting everything, Avago Technologies, Avago, the A logo, Emulex, ExpressLane, and OneCommand are among the trademarks of Broadcom and/or its affiliates in the United States, certain other countries, and/ or the EU. Copyright © 2003–2020 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. For more information, please visit www.broadcom.com. Broadcom reserves the right to make changes without further notice to any products or data herein to improve reliability, function, or design. Information furnished by Broadcom is believed to be accurate and reliable. However, Broadcom does not assume any liability arising out of the application or use of this information, nor the application or use of any product or circuit described herein, neither does it convey any license under its patent rights nor the rights of others. Emulex Drivers for Linux User Guide Table of Contents Chapter 1: Introduction ...................................................................................................................... 5 1.1 Overview ....................................................................................................................................................................5 1.2 Abbreviations ............................................................................................................................................................5 Chapter 2: Installing and Uninstalling .............................................................................................. 7 2.1 General Installation Requirements..........................................................................................................................7 2.2 Emulex FC Driver Kit ................................................................................................................................................8 2.2.1 Installing the Emulex FC Driver Kit ...................................................................................................................8 2.2.2 Uninstalling the Emulex FC Driver Kit...............................................................................................................9 2.3 Booting from a Nonzero LUN Attached to an Emulex FC Adapter.......................................................................9 2.4 Emulex HBA Manager Application ..........................................................................................................................9 2.5 Updating the Firmware .............................................................................................................................................9 2.6 Installing the NVMe over FC Driver .......................................................................................................................11 2.6.1 Installing the NVMe over FC Driver on SLES Operating Systems..................................................................11 2.6.2 Installing the NVMe over FC Driver on RHEL Operating Systems .................................................................11 Chapter 3: Configuration ................................................................................................................. 12 3.1 FC Driver Configuration .........................................................................................................................................12 3.1.1 FC Driver Parameters .....................................................................................................................................12 3.1.1.1 Static FC Driver Parameters.................................................................................................................12 3.1.1.2 Dynamic FC Driver Parameters............................................................................................................16 3.1.2 Configuring FC Driver Parameters..................................................................................................................21 3.1.2.1 Temporary Configuration with the modprobe Command......................................................................21 3.1.2.2 Persistent Configuration with the elx-lpfc.conf File ...............................................................................21 3.1.2.3 Configuring Parameters with a Read/Write to sysfs .............................................................................22 3.1.3 Creating a New Ramdisk Image .....................................................................................................................23 3.1.4 Dynamically Recognizing LUNs and Targets (Using Scan)............................................................................23 3.1.5 Persistent Naming...........................................................................................................................................23 3.1.5.1 Using udev to Discover Logical-to-Physical Mappings for sd Devices .................................................23 3.1.5.2 Configuring the System to Boot Using Persistent Names ....................................................................24 3.1.5.3 Using udev with st Devices...................................................................................................................25 3.1.5.4 Persistent Naming References .............................................................................................................27 3.1.6 ExpressLane Support .....................................................................................................................................27 3.2 vPort Configuration ................................................................................................................................................27 3.2.1 vPort Configuration Prerequisites ...................................................................................................................27 3.2.2 Creating, Deleting, and Displaying vPorts ......................................................................................................28 3.2.2.1 Creating vPorts Using the mkvport.sh Script ........................................................................................28 3.2.2.2 Deleting vPorts Using the rmvport.sh Script .........................................................................................28 3.2.2.3 Displaying vPorts Using the lsvport.sh Script .......................................................................................29 Broadcom DRVLin-UG126-100 3 Emulex Drivers for Linux User Guide 3.2.3 vPort sysfs ......................................................................................................................................................29 3.2.3.1 vPort sysfs Tree....................................................................................................................................29 3.2.3.2 vPort sysfs Entries ................................................................................................................................30 3.2.4 Monitoring vPorts with fc_vport.......................................................................................................................32 3.2.5 vPort Configuration Limits...............................................................................................................................33 3.3 FC Driver Performance Tuning ..............................................................................................................................34 3.3.1 Overview .........................................................................................................................................................34 3.3.1.1 lpfc_fcp_io_sched .................................................................................................................................34 3.3.1.2 lpfc_fcp_imax........................................................................................................................................34 3.3.1.3 lpfc_hdw_queue....................................................................................................................................35 3.3.1.4 lpfc_irq_chann ......................................................................................................................................35 Chapter 4: Configuring NVMe over FC ........................................................................................... 36 4.1 Configuring an NVMe over FC Initiator Using Native CLI Commands...............................................................36 4.2 Emulex Support for NVMe CLI Commands ..........................................................................................................39 Chapter 5: Troubleshooting ............................................................................................................. 40 5.1 Hardware Situations and Resolutions ..................................................................................................................40 5.2 FC Driver Situations and Resolutions...................................................................................................................40 5.3 Dynamic Firmware Logging ...................................................................................................................................42 5.4 FC Driver Log Messages ........................................................................................................................................43