Azure Service Fabric How to Accelerate Engineering Happiness Mark Fussell 7th September 2018 Lead Program Manager © Microsoft Corporation Culture Individualist Predictive Iterative Collaborative Experimental Decade 60s – 70s 80s – 00s 00s – 10s 10s – 20s 20s – ? Prod/Service Arbitrary Feature driven Functional Market driven Data driven What drives design? Team No organization Hierarchy Cross functional DevOps & SRE Multi-disciplinary How is the team Single person Teams (dev/test) & decentralized organized? Process Random Waterfall Scrum Adapt and Distributed & What is the collaboration evolve self-organized process like? Architecture Spaghetti Tightly coupled Client/Server Microservices Functions with What is the application Monolith SOA Microservices architecture? Maintenance Users calling to Manual patches Alerting Comprehensive Self healing How is the app monitored complain periodically monitoring & and maintained? telemetry Delivery Manual Monthly releases Continuous Continuous Continuous How are the software and integration delivery deployment updates delivered? Infrastructure Single machine Scripts Automation of Orchestration of Serverless What is the infrastructure that the app is running on? infrastructure processes/ tasks (Chef) containers Cloud application (service) happiness challenge Continue to deliver Balancing the needs of your business …and ensuring happy customers Developer Reliable and cost productivity optimal Developer productivity is essential for business agility applications Keeping data and applications reliable and cost optimal is critical While you continue to rapidly deliver value to your customers Digitally And digitally transform your business to innovate and achieve happiness transform Cloud application happiness journey Gartner Identifies Five Ways to Migrate Applications to the Cloud https://www.gartner.com/newsroom/id/1684114 Cloud application happiness journey Cloud Native Application AI based apps Modernized microservices serverless modernize to PaaS Why microservices? • Continually evolving applications • Faster delivery of features and capabilities to respond to customer expectations • Build and operate a service at scale 1 Plan 4 Monitor + Learn Development Production 2 Develop + Test 3 Release Microservices: a modern approach for fast delivery and scale Comparing the traditional monolithic application to microservices Traditional Microservices Large, all-inclusive, monolithic app Small, independent services APP APP APP What happens in microservice projects Scale and demand takes off Project becomes overwhelming. Operational unhappiness Large number of microservice deployed into production Complexity Challenges managing the service, deployments and upgrade. Deploy small app with couple of microservices Project funding approved App with one based on prototype microservice Time Challenges/needs in building microservice applications Focusing on business logic Optimizing </> instead of microservice for microservice .NET platform maintenance development Monitoring and governance at overarching and granular levels Running highly secure applications Dealing with the complexity at scale of interactions and network Achieving reliable state communications and data consistency without latency issues </> Tracking multiple deployment pipelines while maintaining agile updates Azure Service Fabric A microservices platform for business critical applications Build Deploy Operate always-on, highly scalable microservice apps </> .NET </> Microservice Flexible Lifecycle 24/7 availability Elastic Security & Health & and container infrastructure management & performance scalability compliance monitoring orchestration Challenges Dealing with the complexity Optimizing Tracking multiple Monitoring and Achieving reliable state Focusing on business logic Running highly of interactions and network for microservice deployment pipelines while governance at overarching and data consistency instead of microservice secure applications communications development maintaining agile updates and granular levels without latency issues platform maintenance at scale Powering Azure and Microsoft services Azure Service Fabric is designed for mission-critical services Azure Database SQL Database for MySQL Azure Database Power BI Cosmos DB Azure for PostgreSQL Monitor Azure Core Azure Dynamics IoT Hub Container Services Registry Archive Intune Event Hub Storage Event Grid Cortana Skype Visual Studio Stream Analytics Team Services Create a Platform yourself Rolling Upgrades Mesos Availability Guarantees Kubernetes Scale Out Architecture Zookeeper Resource Governance Redis Density Raven Packaging & Deployment MongoDB Policy Enforcement Yarn Granular Versioning Fleet Stateful Workloads Hadoop Leader Election Containers Use a hardened platform Rolling Upgrades Availability Guarantees Scale Out Architecture Resource Governance Density Azure Service Fabric Packaging & Deployment Policy Enforcement Granular Versioning Stateful Workloads Leader Election Build once, deploy and manage anywhere Dev machine Any cloud On-premises Service Fabric Service Fabric Service Fabric Mesh Dedicated Cluster Standalone Fully managed by Azure Dedicated Azure clusters Bring your own infrastructure Fully managed Full Control Service Fabric customers The journey application modernization with microservices 1 2 3 4 5 6 Traditional Existing app hosted Existing application + Parts of existing New or transformed Fully-managed app as container or new microservices application microservices microservices executable rearchitected application application Service Fabric supports any stage you choose… What you can build with Service Fabric? Meet your needs… Lift & shift to Mission-critical IoT data Low-latency data New cloud-native containers business SaaS processing processing apps apps Migrate existing B2B solutions in Efficient data Data-centric Apps conceived applications as-is the cloud processing on applications requiring and built with the to the cloud millions of devices fast response times cloud in mind Example: Application Modernization – Refactor .NET applications Website Services WCF Web Services Containers with legacy Legacy Application stack apps on Service fabric © Microsoft Corporation International carrier Alaska Airlines improved performance and reliability, and future-proofed its Shopping Cart service via Azure Service Fabric and custom Windows Server Containers. Evolve their reservation system to support 40 million customers with minimal recoding We love the pristine and predictable environments provided by Windows Server Containers. Service Fabric brings us a safe and consistent deployment strategy that maximizes uptime. The marriage of the two in Microsoft Azure Ralph Feltis Senior Software Engineer gives us unlimited potential. Alaska Airlines TalkTalk TV, the UK’s third largest cable TV provider, embraced Azure Service Fabric to ensure quick delivery of features and content to its customers. Rearchitected In a short span of time, Azure Service Fabric and the extended suite of Azure services has boosted agility, allowing the engineering team to implement outstanding Ilario Corna, quality microservices with Head of Infrastructure, Content & a small number of Operations for TalkTalk TV developers.. Citrix is building the workspace of the future by operationalizing the technology that businesses need. Their solutions are in use by more than 400,000 customers When we started the Citrix Identity Platform, we wanted to try something different and thought a pure microservice model may keep us more honest. The goal was to make the platform truly CI/CD, and that’s exactly what we were Tomas Hrebicek able to do because of Senior Software Developer Honeywell Service Fabric BMW Technology Corporation, a technology development company specializing in connected car services, leveraged Azure Service Fabric to create a set of microservices services they can easily scale to millions of drivers. Build driver intelligence Connected services that would scale up to millions of drivers and continually update learned behaviors on mobile client that has limitation on battery and background processing. With Service Fabric, we Azure Service Fabric is a can perform a rolling sophisticated toolbox for upgrade of our system creating a mix of stateless with no downtime. It will and stateful services that roll back to the previous can be scaled and extended version if there is an as our user base grows and error. we add new functionality. Sean Patterson Senior Software Architect BMW Technology Corporation Next Games powers its global augmented reality game in Microsoft Azure Challenge: Next Games required a lot of back-end processing power—processing power that was sited close to players, wherever they wanted to play in the world. The company also needed database and compute services that could handle massive amounts of geo-distributed data. Solution: Next Games adopted a microservices-based development and hosting environment that relies on Azure Service Fabric, Azure Functions, and Azure Cosmos DB to provide very fast, very low-overhead support of geo- distributed data services. Outcome: Azure Service Fabric handles the passage of messages between players, and Azure Cosmos DB provides a geo-distributed database that locates player data geographically close to the player and coordinates player matchups. In addition to all the new services, Microsoft is constantly improving existing Azure services … This continual improvement enhances our games and makes our lives easier.