Network with Linux on System Z
Total Page:16
File Type:pdf, Size:1020Kb
Networking with Linux on System z Einar Lück IBM Germany Linux on System z Development © 2009 IBM Corporation Linux on System z – Networking with Linux on System z Trademarks The following are trademarks of the International Business Machines Corporation in the United States and/or other countries. AIX* IBM* PowerVM System z10 z/OS* BladeCenter* IBM eServer PR/SM WebSphere* zSeries* DataPower* IBM (logo)* Smarter Planet z9* z/VM* DB2* InfiniBand* System x* z10 BC z/VSE FICON* Parallel Sysplex* System z* z10 EC GDPS* POWER* System z9* zEnterprise HiperSockets POWER7* * Registered trademarks of IBM Corporation The following are trademarks or registered trademarks of other ompanies.c Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license there from. Java and all Java -based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Windows Server and the Windows logo are trademarks of the Microsoft group of countries. InfiniBand is a trademark and service mark of the InfiniBand Tra de Association. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvaldsin the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce. * All other products may be trademarks or registered trademarks of their respective companies. Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations suc h as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivale nt to the performance ratios stated here. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. All customer examples cited or described in this presentation ar e presented as illustrations of the manner in which some custom ers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteri stics will vary depending on individual customer configurations and conditions. This publication was produced in the United States. IBM may not offer the products, services or features discussed in this docu ment in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area. All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non -IBM products should be addressed to the suppliers of those products. Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography. 2 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z Agenda ■ Linux on System z Device Drivers ■ Configuration of network devices – Generic (manual) – Novell/SUSE SLES10 and SLES11 – RedHat RHEL5 and RHEL6 ■ Further networking driver aspects ■ System z related networking commands and tools ■ Advanced topics – Channel Bonding – VLAN ■ Performance aspects ■ Troubleshooting 3 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z Linux for System z Network Device Drivers ■ QETH ■ LCS ■ CTC(M) (stabilized) ■ NETIUCV (stabilized) 4 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z Network Example System z LPAR with z/VM LPAR with LINUX 5 LINUX 1 LINUX 2 LINUX 3 LINUX 4 10.6.0.1 10.6.0.2 IUCV IUCV iucv0 iucv0 10.7.0.1 CTC CTC 10.7.0.2 ctc0 F000-F001 F000-F001 ctc0 10.4.0.1 10.4.0.2 10.5.0.1 10.5.0.2 10.1.0.1 10.1.0.2 10.3.0.1 10.3.0.2 10.1.0.3 10.2.0.1 eth0 eth0 eth1 eth0 eth1 eth0 hsi0 hsi0 eth0 eth1 NIC NIC NIC NIC OSA OSA IQD IQD OSA LCS B000-B002 B003-B005 E000-E002 E003-E005 A000-A002 A003-A005 C000-C002 C003-C005 A006-A008 D000-D001 GuestLAN (QDIO) VSwitch 10.5.0.0/24 HiperSockets 10.3.0.0/24 OSA OSA LCS LAN LAN 10.4.0.0/24 10.1.0.0/24 LAN 10.2.0.0/24 5 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z Linux 2.6 Device Model – System z /sys |--block ■ Block subsystem (view): | |--dasda Block devices and partitions | |... (dasda, sda, ram0) |--bus ■ | |--ccw Bus subsystem (view): Device drivers and devices sorted | |--ccwgroup by bus (ccw) | | |--devices CCW Group Devices: | | |--0.0.a000 QETH, LCS | | |--drivers Example: a QETH device | | |--lcs | | |--qeth ■ | | |--0.0.a000 Class subsystem (view): | |--css Logical devices sorted by type, i.e. to which class they belong; |--class Logical devices have link to | |--net hardware device | |--eth0 ■ | |--device Devices subsystem (view): All the devices of a system |--devices |--qeth |--0.0.a000 6 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z LAN Channel Station (LCS) Device Driver ■ Supports: – OSA Express (in non-QDIO mode) • (HighSpeed TokenRing) • (ATM (running Ethernet LAN Emulation) ) ■ May be preferred instead of QETH for security reasons – Administrator defines OSA Address Table → restricted access, whereas with QETH each Linux registers its own IP address ■ But: performance is inferior to QETH's performance! 7 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z Message to CTC and IUCV users ■ CTC = Channel-to-Channel connection ■ IUCV = Inter User Communication Vehicle ■ CTC(M) and NETIUCV device drivers are deprecated (Linux 2.6+) ■ Device drivers are still available for backward compatibility ■ Please consider migration – Virtual CTC and IUCV (under z/VM) ==> guest LAN HiperSocket or guest LAN type QDIO – CTC inside a CEC ==> Hipersockets – CTC ==> OSA-Express (QDIO) 8 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z QETH Device Driver ■ Supports – OSA Express / OSA Express2 / OSA Express3 – OSD type (=QDIO) • Fast/Giga/10GBit Ethernet (fiber infrastructure) • 1000Base-T Ethernet (copper infrastructure) – System z HiperSockets – z/VM • GuestLAN Type QDIO (layer2 / layer3), Type Hiper • z/VM VSWITCH (layer2 / layer3) – IPv4, IPv6, VLAN, VIPA, Proxy ARP, IP Address Takeover, Channel Bonding ■ Primary network driver for Linux on System z ■ Main focus in current and future development 9 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z HiperSockets and OSA-Express features 10 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z QETH Layer 3 vs Layer 2 mode 11 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z Primary Network Device: OSA Express ■ 'Integrated Power computer' with network daughter card ■ Shared between up to 640 OSA devices ■ Three devices numbers (ccw devices) per OSA device: – Read device (control data ← OSA) – Write device (control data → OSA) – Data device (network traffic) ■ OSA Address Table: – Maps addresses to OS images – Layer 2: MAC addresses – Layer 3: IP addresses ■ Network traffic Linux ↔ OSA, either – IP (layer3 mode) • One MAC address for all stacks • OSA handles ARP – (Address Resolution Protocol) – Ethernet / data link layer level (layer2 mode) 12 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z System z Hipersockets ■ Connectivity within a central processor complex without physical cabling ■ Internal Queued Input/Output (IQDIO) at memory speed ■ Licensed Internal Code (LIC) function emulating DataLink Layer of an OSA-device (internal LAN) ■ 4 different MTU sizes supported: – 8KB, 16KB, 32KB, 56KB ■ Support of – Broadcast, VLAN, Ipv6, Layer2 (starting with z10) Linux Linux Linux Linux Linux router LAN LPAR A LPAR B Hardware Layer HiperSockets OSA 13 © 2011 IBM Corporation Linux on System z – Networking with Linux on System z Virtual Switch ■ Create simulated Layer 2 switch device ■ VM access control and VLAN authorization ■ Create ports ■ Connect NIC to Virtual Switch (LAN Segment) ■ Full MAC address management (generation and assignment) ■ 1-n VSWITCHs per z/VM Image DTC TCPIP Linux0 Linux1 Linux2 Linux3 VSW1