Performance Engineering a Sogeti and Neotys Report the State of Performance Engineering — Contents
Total Page：16
File Type：pdf, Size：1020Kb
The State of Performance Engineering A Sogeti and Neotys report The state of performance engineering — contents Introduction to performance engineering 3 Chapter 1: Culture 6 Enterprise spotlight: IMA 15 Chapter 2: Organisation 18 Chapter 3: Practices 27 Enterprise spotlight: MAIF 42 Chapter 4: Building in performance engineering 44 Chapter 5: Outlook 57 Closing thoughts: the practitioners’ corner 68 Acknowledgements, About the study, Respondents, Footnotes and references, About Neotys, About Sogeti 74 2 THE STATE OF PERFORMANCE ENGINEERING 2020 PRESENTED BY SOGETI AND NEOTYS Introduction In the first half of 2020, application performance became Welcome to the State of Performance highly visible and imperative. At the time of writing this Engineering report report, video conferencing, teleconsultation, online shopping, and many online transactions were all in the The discipline of performance engineering is often midst of extraordinary surges of use. Companies guided reserved for specialists. There is little data available by a strong proactive vision in digital business have to enterprises to help them understand the current managed to navigate successfully in these uncertain practices and how other organisations are managing it. external circumstances. For instance, UK home furnishing This research fills the void by combining the opinions retailer Dunelm reported a 100%+ increase in sales of 515 senior decision makers and the perspective during the lockdown weeks of Spring 2020. of subject matter experts from Sogeti, Neotys and Organisations are changing the way they operate — outside practitioners to explore the landscape of with a surge in remote work — and they increasingly performance engineering. This report reveals the place serve their customers through digital engagement. of application performance in an organisation’s business, More resilient and faster digital services are a major the organisational structure around it, and the various success factor for enterprises in the new normal. This is activities and trends shaping the practice. Derived even more prevalent for some companies with digital from our collective pool of experience from helping platforms acting as the only channel of customer companies in a wide variety of industries, we aim to interaction. Almost all applications are likely to be deeply provide pragmatic recommendations for organisations embedded within organisation core systems and as willing to improve and enhance the business value their such, they profoundly impact the overall ecosystem — performance engineering delivers. positively or negatively. What matters is the ability of an This report is designed to benefit all stakeholders within organisation to anticipate, learn and innovate to protect an organisation that deal with application performance their brand, reputation and revenue. including: executives, business and product owners, architects, developers, quality assurance engineers, tool coordinators, infrastructure engineers, and system administrators. 3 THE STATE OF PERFORMANCE ENGINEERING 2020 PRESENTED BY SOGETI AND NEOTYS What is performance engineering all about? and disrupter of change. It involves multidisciplinary professionals with complementary backgrounds and Performance engineering is a collaborative discipline skills working together to achieve a common mission. focused on achieving high levels of application Application performance is the overarching principle for performance to benefit the business. Performance which we bear equal responsibility and accountability. engineering contributes to making IT an enabler usiness esigning eeoping Testing onitoring for for for for Performance Performance Performance Performance eedac uture Figure 1: Performance Engineering 4 THE STATE OF PERFORMANCE ENGINEERING 2020 PRESENTED BY SOGETI AND NEOTYS As such, performance engineering is much more than just Chapter 1 is for executive leadership responsible for running test scripts and analysing production metrics. If setting the direction and culture of the company. They performance testing entails certain processes and steps need compelling reasons to drive transformative change. to determine faults, performance engineering assesses We examine how application performance is valued and the entire system to identify where and how different what is its impact is on the business. pieces can be optimised and: Chapter 2 lifts the veil on some of the key organisational • Ensures business continuity under changing components in building a performance-first culture. usage patterns Chapter 3 covers some of the building blocks and • Introduces new services faster and improves the fundamental capabilities of performance engineering. quality of experience for end users Through a variety of use cases, we review why they play a • Controls costs and more specifically, significant role in achieving the mission. infrastructure expenditure. Chapter 4 dives deeper into the underlying technical foundation and necessary integration as we start to incorporate performance engineering in the lifecycle. Chapter 5 investigates the likely evolution of performance engineering. We wish you an excellent read. 5 “Corporate culture is important because it shapes the work environment in which performance occurs. Ultimately, not paying attention to culture undermines an organisation’s profitability and sustainability” ― Torben Rick1 6 THE STATE OF PERFORMANCE ENGINEERING 2020 PRESENTED BY SOGETI AND NEOTYS on the performance of their applications, few are willing Chapter 1: to invest in improving and supporting it. Staggeringly, Culture of performance engineering only 21% of respondents claim application performance is an integral part of the brand equity. The disconnection As leading business change guru Torben Rick observes, may stem from operational issues — for example time the corporate culture shapes many aspects of a business pressures and budget constraints, and strategic issues including the way application performance is regarded, — namely the lack of C-level understanding that causes managed and implemented. It can also affect how people repercussion beyond the financial impact. The real cost of approach performance engineering and the effectiveness poor performance is a combination of money, time and of the work they do. At the same time, performance reputational damage. engineering can affect the success of the business and the culture and strategy in terms of the way both the The importance of good performance engineering has people and the business work. been known for many years. This is evident in examples like the 2006 interview with an ex-Amazon employee who In this chapter, we examine how application performance explained that during various tests Amazon discovered is valued and how this translates at the various levels of even small sub-second delays in the website would result the organisational levels. In turn, we review the business in substantial and costly drops in revenue. More recently, impact of your culture of performance and provide in 2018 Google research claimed that “as page load time recommendations on how to perfect your approach to goes from one second to 10 seconds, the probability of performance engineering. a mobile site visitor bouncing increases by 123%”. End Where does application performance fit in users have limited empathy for the effort in making a business priorities? service perform. They just want things to work. A company publicly announcing a software glitch can In 2020, the key expectation is fast, reliable and lose much more than shareholder value. In 2018, the BBC trustworthy software. reported that 10% of users would leave a website for In 2020, faith in application performance means faith in every additional second a page takes to load. We should the business as a whole. all be aware that poor application performance hinders employee productivity, degrades customer experience, Application performance is key, yet reduces process efficiency, diverts resources and impedes addressed tactically rather than strategically many aspects of overall business performance. Most organisations restrict the measurement of With so many recent failures of software putting business application performance to traditional load and stress and careers in jeopardy, the results of this survey are testing. One way to remove the restriction is to connect deceiving. They indicate that while many companies rely business outcomes to the performance of the computer 7 THE STATE OF PERFORMANCE ENGINEERING 2020 PRESENTED BY SOGETI AND NEOTYS systems. Inherently, business stakeholders need to who represent performance engineering are likely to actively collaborate to identify the key business metrics in improve it most by ensuring both the business and the enough detail to be measurable, practical and useful. CTO understand how performance engineering can help them achieve their objectives, and how they can A challenge for technical staff in these organisations is help to maximise the effectiveness of the performance in getting the attention of the business stakeholders. engineering to make this happen. Often, a more practical approach is for the business to lead the initial discussion and the Chief Technical 25% of the respondents connect system performance Officer (CTO) to drive subsequent discussions and the directly to their business outcomes. This connection necessary changes throughout the organisation. This provides a common bond and helps companies gives them the authority, scope, and