Batch Virtualization coordination CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it Agenda Status overview General news Development SLC6 first impressions and news VMIC news Discussion session CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it General news Lxcloud infrastructure changes Several ongoing updates to packaging of tools Serial consoles are up and running PXE on golden nodes works (after initial install) Remote-power-control works for golden nodes Remote power control on non-quattor managed boxes results in “permission denied” On the road map to fix this. Requires patch to server bit of remote-power-control Security enhancements Remote power control via restricted shell user Could be applied for ONE management as well New sindes module for vmmaster secrets for HyperV Monitoring for libvirtd added and activated CERN IT Department Started to move and update documentation in twiki CH-1211 Genève 23 Switzerland www.cern.ch/it Development: SLC6 First impressions on SLC6 as hypervisor architecture Still a lot missing on Quattor Lemon Several components Consoles Interactive access. We do not need it in fact ! KSM active by default Significantly newer version of qemu and libvirt Support for more CPU models (next slide) Support for native CPU (-cpu host option) Solves dynamic host CPU factor issue Unfortunately not understood by libvirt it seems. LVM paths have changed. Need softlinks CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it Development: SLC6 # /usr/libexec/qemu-kvm -cpu ? x86 Opteron_G3 x86 Opteron_G2 x86 Opteron_G1 x86 Nehalem SLC5: x86 Penryn x86 Conroe # /usr/libexec/qemu-kvm -cpu ? x86 cpu64-rhel5 x86 qemu64 x86 cpu64-rhel6 x86 qemu32 x86 [n270] x86 pentium3 SLC6 x86 [athlon] x86 [pentium3] x86 [pentium2] x86 [pentium] x86 [486] x86 [coreduo] x86 [qemu32] x86 [kvm64] x86 [core2duo] CERN IT Department CH-1211 Genève 23 x86 [phenom] Switzerland www.cern.ch/it x86 [qemu64] Development: SLC6 HS06 benchmark: 8 VMs a 1 cpu default setup • KSM on • Ksmtuned on with default configuration • ~20% CPU usage • Qemu emulated cpu 64bit • No CPU affinity define 9% penatly Hypervisor: 96 +- 1, 8 cores CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it Development: SLC6 HS06 benchmark: 8 VMs a 1 cpu tuning setup • KSM off • Ksmtuned off • Native CPU • CPU affinity defined 2.5% penatly Hypervisor: 96 +- 1, 8 cores CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it Development: SLC6 Issues found on lxbsq0910 SLC6 Issues with kerberos authentication Reported issues with ncm-modprobe. Update expected from Luis Found issues with disk ordering Contextualization disk ends up as last disk now Bug or feature of libvirt ? Reported to ONE, waiting for answer CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it Brain Storming Summary of feedback received after last meeting • Proposal: review setup of batch infrastructure • More instances = more work • Rather setup new service in parallel (cloud based?) • Ramp up public batch VMs ? • Proposal: cloud infrastructure • General agreement • Sebastien volunteered to setup a pilot • Check with management • Proposal other services to be cloudified • Lxplus, not only SLC6 • Bdii, ActiveMQ, parts of dev ?, ... • Steve for software setup, Ulrich for Golden Node • Evaluation of OpenStack • ONE works, ISF also. Deliver services based on these • Test machine is available: OSADMIN01 • Strategy: Mainly US from PES and JvE from OIS CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it.