FOSDEM 2013 [email protected] INTRODUCING THE SYNNEFO OPEN SOURCE IAAS PLATFORM . VANGELIS KOUKIS TECHNICAL LEAD, ~OKEANOS 1 FOSDEM 2013 Motivation: ~okeanos [email protected] Goals -Everything open source - Production-quality IaaS - Persistent VMs - Commodity hardware – No SAN - Large-scale Installations - Super-simple UI How? 2 FOSDEM 2013 Cluster vs Cloud [email protected] OPENSTACK SYNNEFO UI OPENSTACK OPENSTACK API SYNNEFO CLOUD OPENSTACK CLUSTER GANETI LIBVIRT NODE KVM KVM HYPERVISOR 3 FOSDEM 2013 Google Ganeti [email protected] Mature, production-ready VM cluster management - used in Google’s corporate infrastructure Multiple storage backends out of the box - DRBD, LVM, Files on local or shared directory, RBD (Ceph/RADOS) External Storage Interface for SAN/NAS support Ganeti cluster = masterd on master, noded on nodes Easy to integrate into existing infrastructure - Remote API over HTTP, pre/post hooks for every action! 4 FOSDEM 2013 Compute – Network: Cyclades [email protected] Thin Compute layer over Ganeti - Python/Django - Supports multiple Ganeti clusters, for scaling - OpenStack Compute API Networking - No restrictions on deployment – it’s the Ganeti side - IPv4/IPv6 public networks, complete isolation among VMs - Thousands of private networks, private L2 segments over single VLAN 5 FOSDEM 2013 Cyclades [email protected] 6 FOSDEM 2013 Storage: Pithos [email protected] Every file is a collection of blocks Content-based addressing for blocks Partial file transfers, deduplication, efficient syncing Independent of storage backend (NFS, RADOS, …) OpenStack Object Storage API plus extensions An integral part of Synnefo - Single store for Files, VM Images - Uses common backend with Archipelago 7 FOSDEM 2013 Pithos [email protected] 8 FOSDEM 2013 [email protected] Spawn my own Ubuntu Freeze 9 FOSDEM 2013 [email protected] Clone Ubuntu + user data Snapshot 10 FOSDEM 2013 [email protected] 11 FOSDEM 2013 [email protected] 12 FOSDEM 2013 [email protected] RADOS block I/O Monitor nodes Volume Composer Storage Mapper and object I/O Blocker Archipelago Object Storage nodes 13 FOSDEM 2013 Volumes: Archippgelago [email protected] Unified storage for Files, Images Volumes Thin layer over the actual storage cluster Storage backend agnostic -NFS, RADOS, … Efficient syncing / sharing of Images as files on Pithos Zero-copy cloning of volumes from Images 14 FOSDEM 2013 Archippgelago [email protected] 15 FOSDEM 2013 Current production ~okeanos [email protected] Rolling hardware and software upgrades - Node evacuations with live VM migrations - Cross-datacenter move, Intel AMD, no VM downtime - IP renumbering of all VMs > 2600 VMs, > 1800 users Ready to scale in beta - 7 Ganeti clusters currently, move to > 10. 000 VMs 16 FOSDEM 2013 Try it out! [email protected] http://www.synnefo.org http://www.okeanos.io 17.