Mobile App Testing ISSN 1866-5705
Total Page:16
File Type:pdf, Size:1020Kb
19 September 2012 The Magazine for Professional Testers Pantone 202 Pantone 173 printed in Germany printed 100% 80% 60% 40% 20% 100% 80% 60% 40% 20% cmyk cmyk c:0 c:0 c:0 c:0 c:0 c:0 c:0 c:0 c:0 c:0 m:100 m:80 m:60 m:40 m:20 m:69 m:55 m:41 m:28 m:14 y:65 y:52 € 8,00 version print y:39 y:26 y:13 y:100 y:80 y:60 y:40 y:20 k:47 k:37 k:28 k:19 k:10 k:6 k:5 k:4 k:3 k:0 free digital version free digital www.testingexperience.com Mobile App Testing ISSN 1866-5705 We all did make the experience that some mobile apps did not work according to our expectations. It is not only that the app just crashes and you have to start it again. It is that can be used in your daily work. Don’t miss it. For more information more than that. I had some funny situations when I uploaded pictures please go to www.agiletestingdays.com. via an app, and they were doubly displayed, or now seemed to belong to Based on the great success of the Agile Testing Days, we decided to set up my friends. More interesting is when you do online banking via the app, the Agile Dev Practices as the conference that also allows agile developers that’s where the fun stops. Mobile app testing has a lot of different facets. and those who want to a career in agile developing to meet and discuss it. We have a lot of very good articles discussing many different aspects of We have set up a great line-up of keynote speakers, tutorials, workshops, it. I want to thank all the authors for the great articles, and of course all etc. Don’t miss the conference. Have a look at www.agiledevpractices.com. the sponsors that make the magazine possible. Last but not least, I want to thank Katrin Schülke for the great job she I think that “mobile” app development and testing will become more and did over the past years to develop Testing Experience. It was a pleasure to more important. Microsoft is now bringing “Surface” to the tablet market, work with her, and I wish her the best for her new career path. Our door and after seeing the promotion videos – looking very promising – I guess is always open for her. that this will provide the impetus for the whole world to move in a new direction. I wish this for Microsoft, but I also wish it for us, the users. We Enjoy reading and have a pleasant time. are moving forward, and this is always positive. Take a second to think back 10 years. How was your mobile and what could you do with it? Stop now for a second and try to imagine what could be possible in 10 years. José Knowledge and imagination will take the teams to a new level. Most of the companies that I know develop mobile apps using agile tech- niques. The Agile Testing Days in November will cover interesting aspects From the editor 1 contents 19/2012 Context-Dependent Testing of Apps Applications propel the versatility of smartphones and tablet PCs. How- ever, testing apps is a cumbersome task. It is particularly complicated since apps have to cope with frequent changes of the context they run in. Mobile devices move, which leads to changes in the available network connection and varying environmental parameters, such as coordinates derived from a geolocation service. Moreover, patterns of usage change. We propose a novel concept to deal with context changes when testing apps. It is based on basic blocks of code between which context changes are possible and helps testers to manage com- plexity. Moreover, it supports the maintenance of a suite of test cases that would become much larger if test cases were simply duplicated to deal with different contexts. In addition to the introduction of our concept, we highlight its application and benefits. What Makes a Good Tester? Mobile Business Application Testing This article discusses the common personality traits Automation: A Novel Approach displayed by experienced, successful professional In this document, we will present the approach of testers to help you understand what makes a good automating mobile business applications testing tester, to help you structure your testing team, and using emulators and real time devices. for evaluating new possible recruits. From the editor .............................................................................................................................1 There’s a test for that! ...........................................................................................................40 What Makes a Good Tester? ...................................................................................................2 Testing on a Real Handset vs. Testing on a Simulator – the big battle ............ 42 Context-Dependent Testing of Apps ..................................................................................2 What Makes a Good Tester? .................................................................................................52 Mobile App Performance – How to Ensure High-Quality Experiences.............. 6 4E Framework for Mobile Network Variability Testing ...........................................56 Roadblocks and their workaround while testing Mobile Applications ..............8 Enterprise Mobile Testing for Success ........................................................................... 60 Main issues in mobile app testing ...................................................................................18 Mobile App Testing .................................................................................................................64 Beyond the Smartphone – Testing for the Developing World ..............................22 Context-Dependent Testing of Apps ...............................................................................66 Best Practices in Mobile App Testing ..............................................................................26 Column: Testing Maturity – Where Are We Today? ......................................... 72 Mobile Test Strategy ...............................................................................................................30 Mobile Business Application Testing Automation: A Novel Approach............76 Driven Development for the Android platform ......................................................... 34 Masthead ....................................................................................................................................80 2 Testing Experience – 19 2012 Testing Experience – 19 2012 3 Graham Bath Graham’s experience in testing spans more than 30 years and has covered a wide range of domains and technologies. As a test manager he has been responsible for the testing of mission-critical sys- tems in spaceflight, telecommunications and police incident-control. Graham has designed tests to the highest levels of rigour within real-time aerospace systems. As a principal consultant for T-Systems, the systems division of Germany’s leading telecommunications company Deutsche Telekom, he has mastered the Quality Improvement Programs of major companies, primarily in the financial and government sectors. In his current position Graham is responsible for the test consulting group. He has built up a training program to include all levels of the ISTQB certification scheme, including the new Expert Level, for the company‘s large staff of testing professionals. Graham is the chairman of the ISTQB Expert Level Working Party and co-author of both Advanced Level and Expert Level syllabi. Gualtiero Bazzana Gualtiero has been working in the IT and testing domain for the last 20 years; he is author of more than 50 publications on the topics of sw quality and testing; he currently holds the following positions: Managing Director of Alten Italia, Chairman of ITA- STQB, the Italian Board of ISTQB® of ISTQB® Marketing Working Group, Chairman of STF – Software Testing Forum, the most important event on testing held annually in Italy. Andreas Ebbert-Karroum Andreas leads the Agile Software Factory (ASF) at codecentric. For more than four years, he is a certified Scrum Master. Since then he could contribute his competencies in small and large (> 300 persons), internal and external, or local and global projects as developer, scrum master or product owner. Me- anwhile, he’s also a Professional Developer Scrum Trainer, conducting a hands-on training for Scrum team members, which codecentric has developed together with scrum. org and in which he shares with joy the knowledge gained in the ASF. More than 15 years ago, his interest in JavaSE/EE awakened, and it never vanished since then. His focus at codecentric is the continuous improve- ment of the development process in the Agile Software Factory, where technical, organizational and social possibilities are the challenging, external determining factors. 4 Testing Experience – 19 2012 Paul Gerrard Yaron Tsubery Yaron has been working in software since 1990, and Paul is a consultant, teacher, author, webmaster, pro- has more than 20 years in testing field as a Test En- grammer, tester, conference speaker, rowing coach gineer, Testing TL, and Testing Manager. His original and most recently a publisher. He has conducted con- profession was Systems Analyst. sulting assignments in all aspects of software testing and quality assurance, specialising in test assurance. Yaron Tsubery is the current CEO and founder of He has presented keynote talks and tutorials at tes- Smartest Technologies Ltd and has been a Director of ting conferences across Europe, the USA, Australia, QA & Testing Manager at Comverse since 2000 until South Africa and occasionally won awards for them. 2010. Yaron was in charge