FOSDEM 2013 [email protected]

INTRODUCING THE SYNNEFO OPEN SOURCE IAAS PLATFORM . VANGELIS KOUKIS TECHNICAL LEAD, ~OKEANOS

1 FOSDEM 2013 Motivation: ~okeanos [email protected]

Goals -Everything open source - Production-quality IaaS - Persistent VMs - Commodity hardware – No SAN - Large-scale Installations - Super-simple UI

How?

2 FOSDEM 2013 Cluster vs Cloud [email protected]

OPENSTACK SYNNEFO UI

OPENSTACK OPENSTACK API

SYNNEFO CLOUD

OPENSTACK

CLUSTER

GANETI

LIBVIRT NODE

KVM KVM HYPERVISOR

3 FOSDEM 2013 [email protected]

Mature, production-ready VM cluster management - used in Google’s corporate infrastructure Multiple storage backends out of the - DRBD, LVM, Files on local or shared directory, RBD (Ceph/RADOS) External Storage Interface for SAN/NAS support Ganeti cluster = masterd on master, noded on nodes Easy to integrate into existing infrastructure - Remote API over HTTP, pre/post hooks for every action!

4 FOSDEM 2013 Compute – Network: Cyclades [email protected]

Thin Compute layer over Ganeti - Python/Django - Supports multiple Ganeti clusters, for scaling - OpenStack Compute API Networking - No restrictions on deployment – it’s the Ganeti side - IPv4/IPv6 public networks, complete isolation among VMs - Thousands of private networks, private L2 segments over single VLAN

5 FOSDEM 2013 Cyclades [email protected]

6 FOSDEM 2013 Storage: Pithos [email protected]

Every file is a collection of blocks Content-based addressing for blocks Partial file transfers, deduplication, efficient syncing Independent of storage backend (NFS, RADOS, …) OpenStack Object Storage API plus extensions An integral part of Synnefo - Single store for Files, VM Images - Uses common backend with Archipelago

7 FOSDEM 2013 Pithos [email protected]

8 FOSDEM 2013 [email protected]

Spawn

my own Ubuntu Freeze

9 FOSDEM 2013 [email protected]

Clone

Ubuntu + user data Snapshot

10 FOSDEM 2013 [email protected]

11 FOSDEM 2013 [email protected]

12 FOSDEM 2013 [email protected]

RADOS block I/O Monitor nodes Volume Composer Storage

Mapper and object I/O Blocker

Archipelago Object Storage nodes

13 FOSDEM 2013 Volumes: Archippgelago [email protected]

Unified storage for Files, Images  Volumes Thin layer over the actual storage cluster Storage backend agnostic -NFS, RADOS, … Efficient syncing / sharing of Images as files on Pithos Zero-copy cloning of volumes from Images

14 FOSDEM 2013 Archippgelago [email protected]

15 FOSDEM 2013 Current production ~okeanos [email protected]

Rolling hardware and software upgrades - Node evacuations with live VM migrations - Cross-datacenter move, Intel  AMD, no VM downtime - IP renumbering of all VMs

> 2600 VMs, > 1800 users Ready to scale in beta - 7 Ganeti clusters currently, move to > 10. 000 VMs

16 FOSDEM 2013 Try it out! [email protected] http://www.synnefo.org http://www.okeanos.io

17