Download the PDF Version

2 TABLE OF CONTENTS & FEATURED ARTICLES CHICAGO

What’s INSIDE Hexaware Welcomes You to QUEST 2016! Enterprises are looking to increase agility and performance in the IT organizations to maintain their competitive edge through adoption of devops, agile delivery models, shift left focus and are 5 Manager’s Workshop embracing digital technologies for their business process transformation. With this, traditional Quality Assurance methodologies are also undergoing a rapid disruption. The existing themes 6 Networking Events of independent testing, sequential testing life cycle and Testing COEs are evolving now into 12 Full-Day Classes collaborative testing services, business assurance and on-demand “Testing as-a-service” themes with innovative commercial models linked to business outcomes. 14 Half-Day Tutorials The focus on extreme automation, omni-channel support, consistent user experience and speed 18 Keynote Presentations with quality is driving QA organizations to create new service offerings, partner with multiple 25 Hotel Map product/ solution providers to provide an integrated QA platform and leverage the digital platform to enable significantly faster time to market at a lower cost of ownership with the expectations of 27 Quest at a Glance zero-defect delivery. 28 Training & Certification There has never been a more dire need to redefine the role of QA and to re-skill QA consultants Prep with multi-functional skills, to provide the requisite “Digital Assurance” to our clients. 29 EXPO Talks QUEST 2016 provides an excellent opportunity to participate in this phase of QA revolution and to 32 Early Bird Sessions & share and discuss different perspectives on the way organizations and practitioners are painting Panel Discussion the canvas of testing services, while trying to re-define the QA horizons as they see it. 34 Presentations/Workshops Welcome to QUEST 2016, a must-attend conference that provides a unique platform for IT professionals, SMEs, service providers, and product vendors to discuss the ‘shift left’ within the 47 Sponsors & Exhibitors software development process to build in quality. Continue being a thought leader in the testing and QA domain and know how your teams can stay relevant for the future, by participating in the discussions on diverse breath-taking strategies for steering QA into the new frontiers of the Digital world to ensure customer delight and maximize the business outcomes.

Tony Mohanty Global Head, Digital Assurance Services Hexaware Technologies Limited Featured Articles

ZAP, You’re QA Team Leader! How to Build a High Performance Team By Rebecca Staton-Reinstein, PhD, Advantage Leadership, Inc...... 8

Distributed Agile Stand-Up Meetings By Tom Cagley, DCG Software Value ...... 10

Regression Test Management Using a User Interface – CARTTS Tool By Mani Rajappa, Quality Assurance, GSI Health ...... 17

7 Steps to Pragmatic Mobile Testing By Tom Chavez, SOASTA ...... 21

Test Automation Rant By Lee Barnes, Utopia Solutions ...... 23

Choosing What to Automate By Brian Le Suer, Zeenyx Software ...... 33

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016 HOTEL & CONFERENCE OVERVIEW 3

The Renaissance Chicago Downtown 1 West Wacker Drive - Chicago, Illinois 60601 - Phone: (312) 372-7200

About the Hotel QUEST 2016 will be held at The Renaissance Chicago Downtown. Located in the heart of the downtown Chicago’s theater and shopping corridor, the Renaissance provides the best in downtown Chicago style, sophistication, and full-service. Each of the luxurious guest rooms and suites features all the comfort and amenities for which Renaissance has become known. To accommodate all your travel needs, the hotel will offer a fully-equipped business center, Club Lounge, and the new WestinWORKOUT® Gym. In addition to their expansive fitness center, you can unwind with a relaxing swim in the indoor pool. The Renaissance is one of the premier hotel and conference facilities in downtown Chicago. For more information visit: www.renaissancechicagodowntown.com

Why QUEST?

The QAI Global Institute’s Quality Engineered Software and Testing Conference (QUEST) is a week of classes, tutorials, educational sessions, hands-on workshops, discussion groups, and networking events for IT professionals from around the world. QUEST’s unique learning opportunities address high interest topics and aids IT professionals in increasing their knowledge and skills in this dynamically changing industry.

Why attend QUEST? »» LEARN from industry thought leaders through attending sessions, participating in workshops and discussion groups, and coaching sessions. »» ASSESS your practices against those of other companies and organizations as presented by peer managers and practitioners. »» APPLY your experience and knowledge to produce solutions during classes, tutorials, and interactive work groups. »» CONNECT with fellow practitioners, contribute to the industry, and explore career possibilities. Enjoy four outstanding networking events.

Manager’s Solutions Workshop (2 Days) Conference (3 Days) Networking 2-day Manager’s Solutions Workshop with 3 keynote presentations by industry leaders Hundreds of quality professionals to network experts leading solutions discussions with 48 sessions by leading industry experts Classes & Tutorials (2 Days) and corporate practitioners in concurrent Manager’s Solutions Workshop Connection conference tracks Dinner 5 full-day skills based classes 10 extended workshop sessions Welcome reception 10 half-day skills based tutorials 2 bonus sessions Attendee Appreciation Evening Event Certification Opportunities Collaboration panel and 4 roundtables Evening reception with exhibitors

Prep class for Certified Software Tester Tools panel and 4 tools roundtables (CSTE) Exhibitor EXPO and Talks (2 Days) Prep class for Certified Software Quality Analyst (CSQA) Exhibitors to browse

Full practice tests for CSTE and CSQA 16 EXPO Talk products/services demonstrations

Leadership Built-in Software Quality Automation & Tools Testing Innovations Collaboration Agile ATDD CI Culture of Quality Deliverables Cucumber Cloud Global Teams Estimation Frameworks Dev/Ops High Performance Teams Lean Jmeter Exploratory Problem Solving Planning & Design Open Source Mobile Quality Indicators Process Selenium Performance Risk Management Requirements SpecFlow Test Data Selling Quality Test Strategy Security Transformation

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016 4 PARTICIPATING COMPANIES/ORGANIZATIONS

Sponsored by

This reception is open to all conference attendees and is included in the registration fee. This event provides an opportunity to meet fellow conference attendees in an informal setting with appetizers, drinks, and raffles. Information will be provided to help out-of-town guests become familiar with the Chicago area.

Attendee Appreciation Night in Chicago – House of Blues

Wednesday, April 20th ~ 5:30 - 9:30 PM

Sponsored by Join tap|QA and your fellow attendees for a spectacular private event at the Chicago House of Blues. This notoriously “cool” venue is located in historic Marina City Complex, downtown along the Chicago River. You can let loose after a day of education at Quest in one of the windy city’s premier music venues. Attendees will enjoy dinner and live music. The event’s live entertainment will be provided by the Gina Glocksen Band. Gina Glocksen is best known as a top finalist of the 6th season of American Idol. Gina’s musical influences and styles range from rock, performing pop, country and hip-hop favorites in her live show.

EXPO Reception Thursday, April 21st ~ 5:00 - 6:30 PM Sponsored by EXPO Exhibitors

The closing event of the Exhibitors EXPO is a reception open to all conference attendees. This is a great opportunity to meet with the exhibitors in a social setting and to network with fellow conference attendees. The main event at this reception will be the raffle of exhibitors’ prizes. There is also surprise entertainment planned for this reception!

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE We test software. Find out how our nearshore model, tap | Lakeshore is replacing offshore at similar costs and delivering higher value with the growing demand of quality and mobile readiness.

Meet Jennifer Bonine at her sessions, “Leading Change When You’re Not In Charge” and “What’s Your Leadership IQ?” • Tuesday, April 19th 8:30am8:30am -and 12:00pm 1pm.

At our booth and tapQA.com, we will be discussing: Strategic and tactical mobile quality Continuous integration Mobile device automation and emulation Nearshore solutions for automation and manual 8 FEATURED ARTICLE

ZAP, You’re QA Team Leader! How to Build a High Performance Team By Rebecca Staton-Reinstein, PhD, Advantage Leadership, Inc.

Average leaders focus on results...Good leaders focus on... Ten Do’s and Don’ts of Engaging and Motivating People behaviors that will get the results...great leaders focus on...emotions “People are coin operated!” Barry Gibbons, former CEO, Burger that will drive these behaviors. – Hitendra Wadhwa King QA managers often start with no experience. One day you’re a highly People need to be rewarded with money - a powerful symbol of the competent technical person; the next you’re in charge of people and at a value exchange between company and employee. You can’t just hand loss. You’re told to continue technical work while “managing” your team. out pounds, dollars, rubles, rupees, or Euros every day. Every QA team Poor IT results from this “tradition” are well documented. leader has an infinite supply of highly effective, nonmonetary motivators that can be quite powerful day-to-day. Break the pattern. Learn great management skills. Forget titles. Use practical, proven solutions to get results your management requires. These are survival – and “thrival” – skills in today’s global, do-more-with- DELEGATION DO’S DELEGATION DON’TS less business culture. DO place motivation in context of your strategic, DON”T expect the random “atta boy” to have an effect operational, or project plan on performance Start with a solid plan and Delegate, Motivate, and Coach for results.

DO describe positive and corrective feedback DON”T say, “Nice report.” Person doesn’t know what specifically. to repeat. Ten Do’s and Don’ts to Assure Successful Delegation DO give feedback as soon as possible to reinforce DON’T wait until yearly evaluation; it’s too late for “Don’t tell people how to do things, tell them what to do and let them effectively. learning. surprise you with their results.” - General George S. Patton DO learn what motivates person. Target rewards DON’T expect “one-size-fits-all” rewards to work for Heed General Patton’s admonition; get more work done, improve team are authentic. everyone. morale and engagement, and let team members focus on what they do best. Avoid being a team leader who only delegates when it’s crunch time. DO involve people to plan details and foster DON’T hand person the work plan and expect To get great results, plan well and delegate well. Delegated tasks, projects ownership. enthusiasm or assignments should be based on your strategic project plans. Have team members develop their detailed work plans based on the nature of DO “catch ‘em doing something right.” DON’T deny praise because person “just doing the job.” the work.

Delegation prepares you to motivate and coach as the person carries out DO select specific rewards based on person. DON’T assume everyone wants the same things. work, reviews progress, and takes ownership, and you give feedback for continued results. DO set up situations where person will be self- motivated. DON’T assume you have power to “motivate.” Delegation is THE critical way to get work done through others. Here are

keys to successful delegation, no matter how big or small the assignment. DO understand people need a sense of purpose, Get results while team members are more engaged and productive. mission, and WHY. DON’T keep people in the dark about the big picture

People expect raises, bonuses or other monetary rewards eventually. Discover what helps each individual become more engaged. Some people DELEGATION DO’S DELEGATION DON’TS thrive on titles, others on relationship building, and others on solving

DO review what you are asking him or her to do - DON’T DUMP tasks on people, especially if you didn’t interesting problems. Study psychology AND individuals. Chat informally. simple task or complex project. finish on time. Observe what people gravitate towards or are involved in outside of work. Start slowly with one person. Develop a simple motivation plan based on DO set concrete objectives for delegated work; DON’T expect the person to read your mind or know your observations. Advance to the next team member. Motivating is a self- due dates, targets, quality of output. everything. motivating process for you too. Remember, people coin operated AND “thank-you” operated. DO share constraints person must deal with to DON’T leave person with impression there are no plan. constraints. Ten Do’s and Don’ts of Employee Coaching DO ask for plan and provide guidelines: simple DON’T TELL team member HOW to complete work. Let tasks, a few actions; projects, extensive. person develop a plan for review. “Success seems to be connected with action. Successful people keep moving. They make mistakes, but they don’t quit.” -- Conrad Hilton DO review plan. Ask questions; stimulate thinking, DON’T TELL person what’s wrong, missing or weak. engagement, and ownership. Guide discovery. Coaching combines Delegation and Motivation. When you delegate work and provide feedback regularly to your team members, you stay focused on helping people get great results, improve, and make progress against DO help person develop a reasonable plan for full DON’T insist person do things exactly as you do. They ownership by team member. may have a better way. the plan. “Coaching” is not just an activity where you deal with problems. Coaching is a process to prevent problems. Don’t avoid coaching until a crisis or the annual review. Planning is the basis for good coaching. DO regular, formal reviews of results at logical Delegate well and motivate well to coach well. time points. DON’T TELL people, “See me if you have problems.” Good coaching takes time – time to delegate, time to prepare, time to deliver, time to motivate…and time to develop an effective coaching style. DO use reviews to examine Lessons Learned to DON’T ignore slippage or Lessons Learned. Help adjust plan. person learn and grow. As a QA team leader, invest in your team’s success. Results are greater employee engagement, growth, and productivity so you achieve your DO encourage person to look for ways to improve DON’T ignore need to develop a new plan when results objectives when you act on results and don’t quit. results even if they are good. are off track. © Rebecca Staton-Reinstein, Ph.D., CSQA, and President of Advantage DO give feedback immediately; take corrective DON’T let poor results continue or delay discussion until Leadership, Inc., works with companies and IT departments that want action or praise good performance specifically. performance evaluation. greater results through engaged employees to transform the organization. She is the author of several books based on successful work with her clients in all economic sectors spanning the globe. Visit our website http:// www.AdvantageLeadership.com/ [email protected] Your return on time invested is a high performing, engaged team. You are free to be an effective QA team leader. As you improve your delegation skills, you and your team improve results. “Let them surprise you with their (great) results.”

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE YOUR WILLIS TOWER TESTING TEAM

SPR’s suite of testing services Automated Exploratory Functionality Accessibility Data Manual Usability Compatibility Security Performance

SPR.COM

Quest Advertisement.Finalai.pdf 1 1/8/2016 9:47:02 AM

Hard

C things

Y CM made MY

CY CMY easy with K AscentialTest www.zeenyx.com

Automated testing, manual testing and test management for Windows. Web. DotNet. Java. PowerBuilder. Terminal. 10 FEATURED ARTICLE

Distributed Agile Stand-Up Meetings By Tom Cagley, DCG Software Value

The daily stand-up meeting is the easiest Agile practice to 6. Make sure the meeting stays “crisp.” Stand-up meetings by adopt and the easiest to get wrong. Distributed teams, teams definition are short and to the point. The team needs to ensure where one or more team members are in a different location, that the meeting stays as disciplined as possible. All team present several challenges, including time zones, accents, members should show up on time and be prepared to discuss organization affiliation and sometimes language. Distributed their role in the project. Discussion includes the willingness to ask Agile teams require a different level of care and feeding than a for help and to provide help to team members. co-located team in order to ensure that they are as effective as 7. Use a physical status wall. While the term “distributed” possible. This is even truer for a team that is working through screams tool usage, using a physical wall helps to focus the their forming-storming-norming process. Core to making Agile- team. The simplicity of a physical wall takes the complexity of tool as-framework work effectively are the concepts of team and usage off the table so the focus can be on communication. Use communication. Daily stand-up meetings are one the most of a physical wall in a distributed environment will mean using important communication tools used in Scrum or other Agile/Lean videoconferencing to show moving tasks on the wall (a picture frameworks. Techniques that are effective in making daily stand- can be provided to the team after). If videoconferencing is not ups work for distributed teams include: available, use a tool that EVERYONE has access to. Keep tools 1. Deal with the time zone issue. There are two primary options as simple as possible. to deal with time zones. The first is to keep the team members 8. Don’t stop doing stand-ups. Stand-up meetings are a critical within three or four time zones of each other. Given typical communication and planning event, not doing stand-ups for a sourcing options, this tends to be difficult. A second option is to distributed team is an indicator that the organization should go rotate the time for the stand-up meeting from sprint to sprint so back to project manager/plan-based methods. that everyone loses a similar amount of sleep (share the pain option). One usable solution that can be tried when distributed Like any other distributed team meeting, having good teams can’t overlap is to have one team member (rotate) staying telecommunication/video tools is not only important, it is a late or coming in early to overlap work times. prerequisite. If team members can’t hear each other, they CAN’T communicate. 2. Identify and attack blockers between stand-ups. Typically, on distributed teams, all parties will not work at the same time. The practice of stand-up meetings is one of the first techniques Team members should be counseled to communicate blockers most organizations adopt when they begin to implement Agile to the team as soon as they are discovered so that something regardless of whether the team is co-located or distributed. discovered late in the day in a one-time zone does not affect Because of the simplicity of the technique, organizations forgo the team in a different time zone that might just be starting to coaching or training on how to do stand-up meetings. They work. One group, I worked with had stand-ups twice each day rely instead on the best efforts of everyone involved. Without (at the beginning of the day and at the end of the day) to ensure coaching, stand-up meetings can be implemented poorly, robbing continuous communication. the organization of the benefits of the technique. 3. Push status outside the stand-up. A solution suggested by Matt The daily stand-up meeting IS the easiest Agile practice to adopt Hauser is to have the team answer the classic three questions and the easiest to get wrong. The stand-up meeting provides (What did you do yesterday? What will you do today? Is there teams with a lightweight tool to re-plan and coordinates activities anything blocking your progress?) on a WIKI for everyone on the on a daily basis. Doing a daily stand-up well helps to ensure that team to read before the stand-up meeting. This helps focus the a team can’t get dramatically off course without notice. While meeting on planning or dealing with issues. the process is easy to understand and to deploy, a good stand- up requires care and feeding so that bad habits don’t develop. 4. Vary the question set being asked. The process of varying the Organizations should have a coach participate on a regular basis question set keeps the team focused on communication rather so that specific problems are exposed. The coach can provide than giving a memorized speech. For example ask: feedback and constructive criticism to help teams continually 1. Is anyone stuck? improve. Investing in good stand-ups helps teams deliver value effectively. 2. Does anyone need help? Stand-ups are nearly ubiquitous in Agile. I would do stand-ups 3. What did not get completed yesterday? even if I were not doing Agile. However, despite their simplicity, 4. Is there anything everyone should know? the added complexity of distributed teams can cause problems. This technique can be used for non-distributed teams as The whole team is responsible for making the stand-up meetings well as distributed teams. work. While the Scrum master may take the lead in ensuring the logistics are right or to facilitate the session when needed, 5. Ensure that everyone is standing. This is code for making sure everyone needs to play a role. that everyone is paying attention and staying focused. Standing is just one technique for helping team members stay focused. Other tips include banning cell phones and side conversations.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE INTERNATIONAL SOFTWARE CERTIFICATIONS BOARD CERTIFICATIONS 11

Software Certification Programs CERTIFICATIONS www.softwarecertifications.org

Software Testing Business Analysis

Aligned to the Software Testing Body of Knowledge, these certifications The need for improved and more reliable information transfer requires evaluate awareness of the testing principles, knowledge of the testing Software Business Analyst professionals who can effectively bridge the function, the different types of testing and the techniques and tools which knowledge and language gap between the business and IT communities. can be used to carry out and manage the Testing process. Certified Associate Business Analyst (CABA) Certified Associate in Software Testing (CAST) A Foundation Level Certification for Software Business Analysts, System Ana- A Foundation Level Certification for Software Testers, Software Developers, lysts, and recent college graduates. System Analysts and recent engineering graduates. • Demonstrates an understanding of software business analysis principles • Demonstrates an understanding of testing principles and practices. and practices. • Suitable for entry-level individuals who are interested in making a career • Suitable for entry-level software engineers interested in making a career in in testing. software business analysis.

Certified Software Tester (CSTE) Certified Software Business Analyst (CSBA) A Practitioner Level Certification for Test Engineers, Test Architects, Design A Practitioner Level Certification for Business Analysts, Project Leads and Analysts and Test Leads. Architects. • Demonstrates a professional competency for practice of quality control • Demonstrates proficiency to manage the link between the business and and testing. information technology communities.

Certified Manager of Software Testing (CMST) A Managerial Level Certification for Test Managers, Test Leads, Test Architects and Project Managers. • Demonstrates capabilities to practice and manage the software testing On Demand Training Courses function. • Suitable for existing and to-be managers in the software testing function. On Demand Virtual Courses provide 24/7 access to the best exam prep courseware available. The courses include a downloadable copy of the Body of Knowledge book, course workbook, recordings of each session, and the course specific items listed below. Software Quality Assurance Certified Associate in Software Testing (CAST) • Overview of the Software Testing Body of Knowledge for CAST with Aligned to the Software Quality Assurance Body of Knowledge, these certi- expert instructors (totaling over 40 lessons). fications check the proficiency in the principles and practices of the quality • Over 200 multiple choice questions that simulate the types of objective assurance function. questions that will be experienced on the CAST exam. • 70 essay questions with sample answers to reinforce the material. Certified Associate in Software Quality (CASQ) • A final sample exam to test your exam readiness is provided. A Foundation Level Certification for Software Engineers and recent graduates. • Demonstrates foundation level understanding of quality assurance prin- Certified Software Tester (CSTE) ciples and practices. • Overview of Software Testing Body of Knowledge for CSTE with • Demonstrates the understanding of quality principles, concepts, and expert instructors (totaling over 50 lessons). practices. • Over 250 multiple choice questions that simulate the types of objective questions that will be experienced on the CSTE exam. Certified Software Quality Analyst (CSQA) • 90 essay questions with sample answers which simulate constructive A Practitioner Level Certification for experienced Quality Analyst, SQA Team response questions that will be experienced on the CSTE exam. Leaders and Members. • A final sample exam to test your exam readiness is provided. • Demonstrates professional competence in the practices of QA in the IT profession. • Provides a complete overview of the quality function. Certified Software Quality Analyst (CSQA) • Overview of CSQA Common Body of Knowledge with expert Certified Manager of Software Quality (CMSQ) instructors (totaling over 40 lessons). A Managerial Level Certification for SQA Managers, Architects and Project • Over 200 multiple choice questions that simulate the types of objective Managers. questions that will be experienced on the CSQA exam. • Demonstrates capabilities to practice and manage the software quality • 40 essay questions with sample answers which simulate constructive function. response questions that will be experienced on the CSQA exam. • Suitable for existing and to-be managers in the software quality function. • A final sample exam to test your exam readiness is provided. • Provides a tool to predict the likelihood of success of individuals consider- ing managerial roles.

Certified Manger of Software Testing (CMST) and Certified Manager of Software Quality (CMSQ) On Demand Courses will be available in second quarter of 2016.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 12 FULL-DAY CLASSES Monday, April 18, 8:30 AM - 4:30 PM

LEADERSHIP Test Leadership – Problem Solving Lynn McKee, Quality Perspectives This one day course focuses on developing problem solving skills given the ongoing challenges facing testing leaders. Challenges including unrealistic project mandates, delivering bad news, doing more with less, team morale and inspiration, the perceptions and misconceptions of testing, leading change, and more. Real world examples and specific techniques for tackling these challenges will be explored. A combination of lecture, facilitated discussion, and experiential techniques will provide attendees opportunity to share their experiences and add to what they’ve learned. Learning Objectives: • See beyond the obvious and find opportunities within every problem • Apply the 4 Most Effective Ways Leaders Solve Problems as defined by Glenn Llopis, to testing specific challenges: - Transparent Communication - Breaking Down Silos - Partnering with Open-minded People - Solid Foundational Strategy • Developing the positive perspective to tackle problem solving on a daily basis • Recognize your current leadership strengths and weaknesses for problem solving • Apply lessons learned in the workshop to a current organizational challenge

AGILE Agile Estimation Tom Cagley, DCG Software Value

Estimates and customer satisfaction are intertwined because they set expectations. Estimates set the development team’s expectations about resources that will be available to deliver the project, including effort, people, and calendar time. From the customer’s point of view, an estimate will generate expectations about what will be delivered, when it will be delivered and what the project will cost. The dark side of estimation is that once an estimate is even whispered, it quickly become set in stone and gains the power to dissatisfy. Learning to estimate better yields better relations whether you are estimating value, coding or testing! This one-day course focuses on providing QA managers, test analysts, and test automation engineers with an in-depth understanding of the principles and methods of estimating leveraged in an Agile development environments through a combination of lectures with hands on technique practice. Learning Objectives: • Managing Agile projects • Impact of size, speed and behaviors in an Agile environment • Agile and Lean estimation practices • Release Planning • Why cycle time is more important than capacity utilization • Visibility both to and from the team

LEAN Trimming Down Your QA Effort While Maintaining Quality Clyneice Chaney, MITRE

Are you struggling meeting demands for quality and effective testing in your organization? Do you feel that there has to be a better, quicker way to get things done? Is your quality organization delivering effective and precise work? Are the processes that comprise your organization fine-tuned for excellence? Do you know the value that you are bringing to your organization? If you don’t know or aren’t sure, this course is for you. Those of us in quality face many challenges in today’s software development world. Quality Assurance and even testing is often perceived as an extra, as overhead and generally, a cost center. To some extent, this is true. It is an investment in the long term and quality of your product or service in where the value can come back to you in any number of ways and most are not immediate or instant. Quality organizations that know the effectiveness of their organization and can demonstrate value are much more successful. This course takes a look at applying Lean principles to Quality Assurance and testing processes to see if we can eliminate waste and improve. Learning Objectives: • Been introduced to basic lean concepts and their applicability to testing and quality assurance • Looked at the quality assurance and testing process from a lean perspective • Explored potential areas of waste in quality assurance and testing • Been introduced to techniques to implement improvements for potential waste areas • Practiced using lean techniques for identifying and resolving potential testing and quality assurance “waste”

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE FULL-DAY CLASSES 13 Monday, April 18, 8:30 AM - 4:30 PM

MOBILE Mobile Testing: Manual and Automated Michael Yudanin, Conflair The course is designed to provide software quality assurance and testing professionals with the background and tools necessary to organize manual and automated testing for mobile applications. It surveys the state of mobile technology, focuses on the software quality challenges it poses, and offers ways to increase the efficiency and effectiveness of mobile testing. The course discusses how to integrate mobile testing effort into the overall testing process. It also offers a focused look on the automation of mobile testing: the need, the options, and the tools. The course will end with a live demonstration of a mobile test automation approach. Learning Objectives: • What is the state of the art of mobile world • What are the challenges mobile technologies pose to software QA and testing • How to integrate mobile testing in the overall testing process • How is it possible to automate mobile application testing • What are the criteria for choosing mobile automation approach • What are the main types of tools, their advantages and disadvantages

AUTOMATION Getting Started with Selenium Test Automation Chris Lawson, Zenergy Technologies Have you ever wanted to dive into an open source test automation tool but didn’t know where to begin? This one-day course focuses on getting started with developing automated web tests using Selenium. This class is for anyone who would like to learn more about core Selenium capabilities or even those new to automation. A combination of lecture with concrete examples, classroom discussions, and proven techniques provide attendees with a good understanding of what it takes to successfully write Selenium automated tests. This includes basic object oriented programming concepts with JAVA through implementing effective Selenium WebDriver methods. Learning Objectives: • What Selenium is and how it can be used in real world scenarios • Essential object oriented programming constructs necessary for developing basic automated tests • Core Selenium methods and syntax for programmatically controlling browsers • Challenges of automated Web testing and approaches for overcoming them • Key development strategies for creating maintainable automated tests • Integrating additional open-source tools to enhance automated testing process • Basic automation framework concepts and design considerations

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 14 HALF-DAY TUTORIALS Tuesday, April 19, 8:30 AM - 12:00 PM

LEADERSHIP Leading Change When You’re Not in Charge Jennifer Bonine, tap|QA You try to implement a change in your organization and it doesn’t get the support that you thought it would and you can’t figure out why. You have a great idea but can’t get the resources required for successful implementation. Determine which ideas will and will-not work within your organization using Jennifer’s shared toolkit. Learn five rules for change management. Use a checklist to determine the type of change process needed in your organization. Master techniques for communicating your ideas to your target audience and a set of questions you can ask to better understand your executives’ goals, and methods for overcoming resistance to change from teams you don’t lead. These tools, together with an awareness of your organization’s core culture, will help you identify which changes you can successfully implement and which you should leave until another day. Learning Objectives: • Learn your organizational culture and align that to the changes you are looking to make • Anticipate reactions to changes and target your communication strategy • Apply personality type differences to your communication strategy and overcome resistance

MEASUREMENT Agile Metrics - It’s Not About Velocity Philip Lew and Steve Gohres, XBOSoft When implementing software quality metrics, we need to first understand the purpose of the metric and who will be using it. Will the metric be used for measuring people, the process, illustrate the level of quality in software products, or drive towards a specific objective? QA managers typically want to deliver productivity metrics while management may want to see metrics that support customer or user satisfaction or cost related (ROI) initiatives. With agile development methods, we often lose sight that our primary objective is the same, quality. Many organizations are myopic on the primary objective of velocity. However, velocity means little without quality. Define quality for your organization with an agile looking glass with intermediate metrics that lead to both quality and velocity. Learn to develop and implement software quality metrics with actions toward improving on these two primary objectives. Learning Objectives: • How to connect your metrics with agile related objectives, to ensure your agile process is on track • How to develop a measurement framework that measures not only typical test results such as defects, but processes and functions and their alignment with your agile objectives. • How to include measurements, metrics, objectives, questions and answers (for your stakeholders) to see if they really want to be agile or are just talking • How to use metrics to not only evaluate, but also predict what could go wrong in your agile process

REQUIRMENTS Making Requirements and User Stories Testable David DeWitt, NueVista Regardless of the format, requirements are often written without adequate attention to how they can be tested and accepted by the business stakeholders. During this interactive session the participants will be given a practical framework for understanding how to strengthen the testability of use cases, user stories, and requirements specifications. Learning Objectives: • Review the frameworks for typical requirements statements, including use cases, user stories, and traditional requirements specifications • Identify typical verification and acceptance shortcomings of use cases, user stories, and traditional requirements specifications • Review a requirements quality checklist that can help predict the testability of the requirement regardless of format

PROCESS Maintaining Testing Integrity Under Pressure Carolyn Swadron, CIBC Effective quality assurance / testing adds critical value to a project providing that project managers, stakeholders and test leads understand its purpose and plans, and carry out execution effectively. This session describes different types of testing that need to occur and what they need to accomplish. It addresses options and respective pros and cons of testers with different skills and backgrounds participating at different times during a project. It reviews common challenges that test leads face when planning and executing testing and suggests approaches for handling these effectively. This session provides the opportunity for attendees to participate in realistic testing scenario exercises, share their testing challenges, and benefit from others’ experiences in similar situations. Learning Objectives: • Learn about different types and purposes of testing that occur under the label “Quality Assurance” • Learn how different types of testers can affect the value that testing provides • Learn common major challenges that increasingly affect testing today and options for addressing them.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE HALF-DAY TUTORIALS 15 Tuesday, April 19, 8:30 AM - 12:00 PM

AUTOMATION The Development and Implementation of an Automation Framework Dean Carvin, Checkpoint Technologies “Shift left testing” has created a strong push in the market to apply new tools and techniques to support faster, leaner test automation earlier in the SDLC. While this is an important and logical step in the evolution of test automation, it causes many organizations to lose sight of the still critical regression phase of testing. Regression testing remains the phase of testing where you are most likely to realize the greatest ROI utilizing test automation. With the ever-growing speed with which software must go to market and the number of platforms it must support, it’s imperative to have a regression test automation strategy allowing fast script development, solid data management, and minimal maintenance. Dean provides an automation strategy that supports your organization’s culture, resources and budget by determining the type of framework to implement along with a plan to accomplish it. Keep your regression testing effective and maintainable by using this framework. Learning Objectives: • Learn the benefits of a well-planned and designed test automation solution • Understand your organization and what automation solution (tools & methodology) would best fit • Be introduced to a strategic process to implement your test automation solution

Tuesday, April 19, 1:00 PM - 4:30 PM

LEADERSHIP What’s Your Leadership IQ? Jennifer Bonine, tap|QA Need a way to measure your leadership IQ or improve as a leader? Find out your core leadership competencies and how to build on and improve them. Jennifer shares a toolkit to help you with all of the above including personal assessment of your leadership competencies. Use the toolkit to explore a set of eight dimensions of successful leaders and improve competencies that are not in your core set of strengths. Use these tools to become a more effective and valued leader in your organization. This interactive session will involve team activities and case studies on leadership situations. Exercises help you gain an understanding of yourself and strive for balanced leadership through recognition of both your strengths and your “development opportunities.” Learning Objectives: • Explore your personal leadership style and see how others lead • Adapt your style to work well with other leaders and contributors in your organization for success • Sell your ideas and suggestions in the organization and influence for impact

PROCESS Value Stream Mapping and Kaizen in Agile Retrospectives Angela Dugan, Polaris Solutions Continuous self-improvement in agile teams is traditionally done through agile retrospectives, a form of post-mortem after the completion of an iteration. More often than not, retrospectives begin to fade and the list of action items keeps growing until teams simply succumb to business-as-usual practices. Learning Objectives: • Determining if your current agile retrospectives are being effective • Learn Value Stream Mapping and Kaizen Burst lean techniques • Using VSM and Kaizen in agile retrospectives

RISK (Almost) Everything I know about testing I learned playing poker Matthew Eakin, Centric Consulting What do software testing and Texas Hold ‘Em poker have in common? More than you might think. Risk assessments, planning (but not writing a plan), bluffing, reading a bluff, resource allocation and many more software testing techniques are found in playing poker. In this highly interactive session Mr. Eakin will walk some “volunteers” through one (or many) hands of Texas Hold ‘Em. With each turn of the cards we will apply testing techniques familiar to us to (hopefully) win the hand. Don’t worry, unlike real life poker we’re not going to take your money! At least not all of it. Learning Objectives: • Learn how to effectively do and apply a risk assessment • Understand how to plan and the importance of planning • Understand why creating a plan can be a bad idea

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 16 HALF-DAY TUTORIALS Tuesday, April 19, 1:00 PM - 4:30 PM

MOBILE Usability Goes Mobile Susan Brockley, ExxonMobil The introduction of mobile devices and applications presents new challenges to traditional usability testing practices. Identifying the differences between usability testing techniques for mobile applications and traditional desktop applications is critical to ensuring the acceptance and use of mobile applications. New equipment requirements for the mobile platforms testing add to the transition issues. Experience a short mobility usability test and identify the process changes that need to be considered for your change to the mobile platform. Create a plan that will help you transition your traditional usability testing program into a mobile environment. Learn a series of tips that will smooth the path of starting to test in the mobile area. Join Susan to make your transition into the mobile testing field successful. Join Susan to expand your skills in Mobile Usability Testing Learning Objectives: • Learn what makes mobile usability different from traditional usability and why that matters • Modify traditional usability techniques to make them applicable to mobile devices • Tailor usability these techniques to get traction in your organization

AUTOMATION Introduction to ATDD using Ruby, Cucumber, Watir-WebDriver Joseph Ours, Centric Consulting There are multiple challenges with automating in an agile context however, there are some tools that can make this easier. Using Behavior Driven Development (BDD) and Acceptance Test Driven Development (ATDD) with Cucumber and WATiR-WebDriver, we will show how it is possible to automate within a sprint. This class introduces students to agile automation using Open Source tools Ruby, Cucumber, and WATiR. By the end of the class, students will have a functioning project and basic test script. Join Joseph to see how easy this technology is and start on a path of continued automation and ATDD learning. This will be a hands on workshop where everyone will learn, through doing, how to automate running a browser, how to tie tests into living specifications, and basic ATDD principles, all guided by one of our senior subject matter experts. Learning Objectives: • Create your own project and test script • Learn Acceptance Test Driven Development • Wire scenarios to test steps

ROUNDTABLES & COACHING

Special Interests Roundtables

Wednesday & Thursday during Lunch Conference attendees have a wealth of knowledge and experience to share. That is why we are turning some of our circular tables at lunch into special interest group roundtable discussions. Look for the topic signs at these special designated tables and join in the group discussion over lunch. This is also an excellent opportunity to connect with others who share your topic of interest and add them to your network of professional contacts. All you need to bring to the table are your questions and your experience.

No prior sign-up is required, but seating will be based on a first come – first serve basis.

Coaching Sessions

Wednesday, Thursday and Friday based on availability Have you ever heard an interesting idea or solution in a conference presentation and would have liked to discuss it further with the speaker? But, when you tried to talk to the speaker immediately at the end of the presentation, you found that the conference schedule just didn’t allow enough time?

Included with the QUEST conference experience is the opportunity for you to meet one-on-one with conference speakers or the professional QAI instructors in an informal setting to discuss how to turn ideas into solutions that address your specific needs.

Speakers will be available for free coaching sessions on the day of their conference presentation. Sign-up sheets with available speakers and times will be posted at the conference on Wednesday, Thursday & Friday based on availability. Sign-up at the conference is required to reserve your coaching session.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE FEATURED ARTICLE 17 Regression Test Management Using a User Interface – CARTTS Tool By Mani Rajappa Rajappa, Quality Assurance, GSI Health

Introduction Implementation Every Regression test is a means for testers to identify new CARTTS Tool uses Selenium scripts created previously for defects in their software product’s current functional areas when testing the GSIHealthCoordinator application. Users can execute updates or changes have been made to the product. Regression regression tests and verify the test results by following simple testing by itself becomes challenging when you are in a fast- steps using Google Chrome or the Microsoft IE browser. paced organization dealing with changes on a continual basis. The CARTTS Tool client-side web application is built on To add to the complexity, if the changes are made by several AngularJS technology. After successfully logging in to the groups within the organization, the sheer effort to coordinate CARTTS, the user will select a client, a browser and the test test the changes becomes even more challenging. Given the scripts to execute. The user will then submit the request by important role played by regression testing in the software clicking the “Run Test” button. This request is submitted to the development life cycle, the focus needs to be to execute all server in a JSON format. If the user selected multiple tests to be the regression test cases since the impact of the changes can executed then they are split and each is submitted as a single http be substantial and ripple effects can occur. To handle this request so the user can receive a result as soon as one test is ever-growing problem, GSIH Health’s QA team designed and complete. developed a responsive design based User interface to execute The server-side application is built with Spring framework which regression test cases for all changes requested to the software receives the client request and converts the JSON formatted product. The key benefits of this solution are: request to a plain Java Object. Based on the request, the application dynamically generates a test suite for TestNG which is Easy to navigate user interface to execute regression tests a framework to support automated software testing. Based on the Can be executed independently of QA team’s involvement and time user selection in the CARTTS Tool UI, Java classes which contain commitment the requested Selenium scripts are added to this test suite. For each regression test, a Selenium WebDriver which manages and Provides a tracking mechanism for further analysis and course correction controls a browser is instantiated, and launches a web browser Provides additional client reporting capabilities of the requested type with a new session in the server machine. Each WebDriver interacts with the GSIHealthCoordinator web application for the targeted client to examine its behavior. Both Background the error logs and report logs during the test are recorded by Regression testing for every change implemented on the product TestNG’s Reporter. If any test step fails during the test, the platform was becoming a challenge based on the sheer amount Selenium WebDriver exits the test. Regardless of the test result, of changes implemented and also based on the timing of Selenium WebDriver always quits the launched browser at the deployment of the changes. Some of the key questions to which end of the test. the QA team was trying to get answers were: When a regression test execution is completed, the test result is How can we execute our regression test cases on a timely basis submitted to SpiraTest which is a Test Management Tool. This based on the change implemented? How can we create a solution to is automatically done by Spira’s TestNG Listener which retrieves reuse our existing library of automated regression tests? SpiraTest authentication and a test case number from Spira Test Configuration & Spira Test Case which are annotated on the Can we create a solution for us to maintain and execute regression tested classes and methods in advance. The test result is then tests for all the changes implemented for our Coordinator product? sent back to the browser of the requested user. A Java object Can we identify and define a solution for other departments to easily which contains test result data is converted to JSON format and adopt and execute regression tests? sent back to the client-side application as an http response. The test result including execution time and log reports is viewable on Can we create this solution in such a manner that other departments the user’s browser as soon as client-side receives the response. can execute the regression tests based on their availability and not being The client-side application also updates progression status of test dependent entirely on the QA team? run. When all the tests are completed, the user may submit the The solution we defined was a user interface called CARTTS“ next test run request Tool” (Coordinator Application Regression Testing Test Suite) which can be accessed over the web. The regression test cases Conclusion can be executed from this tool. The test cases are available The CARTTS Tool has helped the QA team to execute in a drop down to be selected based on the client and those regression test cases on an as needed basis and also extended test cases will be executed on a server hosted on our network. the availability of these test cases to other departments in a Once successfully executed, the CARTTS Tool provides a test convenient and user-friendly manner. The capability for other execution status along with useful auditing information. It also departments to execute regression tests cases based on their provides linkage to our test management system where the users access to the CARTTS is a big win for the QA team wherein can track the tests for better reporting capabilities. we not only stand for quality in QA but also created a value- add solution for the company. The CARTTS Tool helps several departments within GSI Health to execute regression test cases.In Objective the future we may extend the use of the tool to other departments. Some of the key objectives are: Reuse our existing library of automated regression tests

Define a solution which can be used by any our internal departments with minimal intervention from the QA Team

Ensure there are sufficient tracking and reporting capabilitiesso that any failed test cases can be easily identified for further resolution

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 18 KEYNOTES

Keeping Pace with Digital Transformation: Trends and Recommendations from the 2015-2016 World Quality Report Matt Chessler, Capgemini 8:30 AM – 9:30 AM Digital transformation is rapidly shaking up business operations and organizations are placing more focus on QA and Testing, with the aim to develop a true business assurance capability and ensure a smoother customer experience. The seventh edition of the World Quality Report provides findings on application quality and testing trends as well as recommendations for organizations to build strong testing practices focused on business assurance. The report is based on a global market research study conducted with 1,560 senior IT executives and testing leaders from 32 countries. Testing and QA SMEs, along with business and sector leaders, have studied the research data and provided their valuable insights on the contemporary global Testing landscape. The themes covered in this report are: W • Digital Transformation E • QA and testing Budgets Outperform D • Security testing is the Top IT Strategy Priority N • Agile testing Maturing to the Enterprise E • Industrialization Becoming More Advanced S D • Test environments and Test Data Management A Learning Objectives Y • Understand how digital transformation is impacting QA and testing • Be aware of the current trends in QA and testing as reported by the 2015-2016 World Quality Report • Discover the key recommendations of the report and how they can affect your organization

Matt Chessler is a Principal in Capgemini’s Financial Services Testing practice. He has over 20 years consulting experience successfully delivering business and technical solutions for clients in a variety of industries. For the past 14 years, Matt has focused exclusively on QA consulting and has successfully managed testing strategy, functional validation and performance optimization projects for clients in the financial services, technology and healthcare industries. During this time, he has advised clients in all facets of testing strategy, from transformation and process improvements to the design and implementation of large-scale Testing CoE’s.

Agility and Reliability Need Not Be Mutually Exclusive John Chang, CAST Software 8:30 AM – 9:30 AM System-level defects kill apps and are essentially invisible to developers and testers alike. However, these defects cause news-breaking catastrophes for organizations, such as United Airlines, the U.S Office of Personnel Management and NASDAQ (to name a few). In this keynote presentation, John Chang will discuss the causes of system-level defects and why they create chaos in all applications regardless of technology, platform, and development methodology. Explore the impacts caused by the lack of right solutions and processes to intercept system-level defects before software is released into production. T John will also share successful models that companies have established in order to efficiently identify, prioritize H and remove system-level defects from their software. Attendees are invited to discover insights sure to change U the perception of non-functional defects and leave with ideas that can be put into action immediately. R S Learning Objectives: D • Discover the of causes system-level defects A • Explore the types of issues caused as a result of system-level defects Y • Leverage actionable ideas for non-functional testing

John Chang is the Head of Solution Design for CAST in North America, helping Fortune 2000 companies leverage CAST’s solutions to reduce system-level defects and improve application development outcome success. John began his career in 2003, leading the development of various business intelligence applications for large companies such as CSX and Maersk Line. After completing his MBA at Rutgers University, he joined INTTRA in 2011 as the Director of Product Marketing, in charge of writing requirements and working with development leads to enhance their cloud-based flagship product used by tens of thousands of clients. John Chang joined CAST in 2014.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE KEYNOTES 19

Shift Left and Steer Right Joe Colavito, Corevu 8:30 AM – 9:30 AM You play a vital role in the software development cycle. Your ability to shift left directly increases software quality, drives competitive advantage, and decreases cycle time. In fact, deep down inside, you know that unless you steer right the final product will not arrive in optimal condition or reach its desired destination on time. Imagine yourself having more fun at work, while drawing out the best in the rest of your co-workers. Now envision yourself collaborating with, contributing to, and steering your team to make the right decisions, for the right reasons, at the F right time. R I Learning Objectives: D • Earn a seat at the table, engage and connect with key decision makers A • Ask more effective questions, so you can gain more influence Y • Manage self-talk (yours and others) and remove inter-FEAR-ence to maximize overall performance Joe Colavito is a student of people, performance and success. Since he can’t stand the thought of talented motivated individuals underperforming, he has dedicated his life to helping others increase their focus, influence and performance in business and life. Joe began his career as a financial auditor, before working as an executive headhunter. Therefore, he relates to software testers who may have their work under-appreciated by others. Joe has delivered dynamic interactive keynote presentations to over 12,000 professionals, leaving them feeling encouraged, empowered and highly valued. Joe and his wife, Debbie, have five children, and he claims to have learned his most valuable life lessons from them. 20 TRAINING AND CERTIFICATION PREPARATION

Certified Software Tester (CSTE) Prep Course Monday & Tuesday, April 18 - 19

The Certified Software Test Engineer Prep Course is designed specifically to prepare the quality testing professional for the CSTE examination. This is a 2-day course taught by a certified QAI instructor. The course aids the quality testing professional in focusing in on the topics that are important for understanding, thus helping toward the successful completion of the exam. This course is not intended to supplant the need for proper examination preparation. However, it will serve as an excellent review of the Software Testing Body of Knowledge for CSTE (STBOK) which consists of the ten skill categories listed below. Sample exam questions are provided throughout the course.

1. Software Testing Principles and Concepts 6. Walkthroughs, Checkpoint Reviews, and Inspections 2. Building the Software Testing Ecosystem 7. Designing Test Cases 3. Managing the Test Project 8. Executing the Test Process CSTE 4. Risk in the Software Development Life Cycle 9. Measurement, Test Status, and Reporting Certified Software Tester 5. Test Planning 10. Testing Specialized Technologies

Certified Software Quality Analyst (CSQA) Prep Course Monday & Tuesday, April 18 - 19

The Certified Software Quality Analyst Prep Course is designed specifically to prepare the quality assurance professional for the CSQA examination. This is a 2-day course taught by a certified QAI instructor. The course assists the quality assurance professional in focusing on the topics that are important for understanding, thus helping toward the successful completion of the exam. This course is not intended to supplant the need for proper examination preparation. However, it will serve as an excellent review of the CSQA Common Body of Knowledge (CBOK) which consists of the ten skill categories listed below. Sample exam questions are provided throughout the course.

1. Quality Principles and Concepts 6. Define, Build, Implement, and Improve Work Processes 2. Quality Leadership 7. Quality Control Practices 3. Quality Baselines (Assessments and Models) 8. Metrics and Measurement 4. Quality Assurance 9. Internal Control and Security 5. Quality Planning 10. Outsourcing, COTS, and Contracting Quality

CSTE and CSQA Practice Examinations Friday, April 22

Have you thought about becoming certified but wondered how your current knowledge and skills compare to the Common Bodies of Knowledge for CSTE and CSQA? With your registration to the 3-day conference, you can take a complimentary full practice examination for the Certified Software Test Engineer (CSTE) or the Certified Software Quality Analyst (CSQA). The practice examinations will be held on Friday and will begin immediately after the Keynote Speaker presentation. The multiple choice section of the examinations will be graded on-site when you turn in your completed exam, so that you will receive an immediate assessment of your skills. The essay section will be evaluated after the conference by Software Certifications and feedback will be provided to you.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBALGLOBAL INSTITUTE FEATURED ARTICLE 21 7 Steps to Pragmatic Mobile Testing By Tom Chavez, SOASTA

INTRODUCTION constant upgrades to multiple operating systems, and an expanding The software-testing discipline continues to undergo seismic shifts set of features. from a variety of perspectives. What has traditionally been viewed as a tactical exercise has evolved into a strategic process. Previously, The marketing information from the manufacturer is a good first test engineers have executed suites of tests and produced pass/fail indicator of what devices and what functions you should test as results that merely evaluated the performance of the software. But part of your core functions. More challenging is: what edge cases numerous factors are dramatically reshaping the testing process will you cover. How far down the long tail will you go? One helpful including: Expanding Test Plans, Shorter Product Cycles, More strategy to prioritize testing initiatives is to compare a device and its Device Platforms, A Changing Focus, and An Emphasis on OS vs. correlated revenue and use that analysis to assess the risk of Analysis. eliminating testing for any given device. The impact of these changes is particularly acute in mobile testing, 5. KNOW HOW TO AUTOMATE which often presents large user volumes, device proliferation, and Earlier in this article, we discussed the importance of analyzing fast cycles. This article discusses seven key strategies for mobile and understanding the testing matrix. This helps you prioritize core testing that can result in faster, yet more comprehensive, testing functions vs. edge functions. That analysis also plays a crucial role cycles that are more aligned with product strategies and market in helping us determine which tests are best suited for automated goals. These are the things you should know! testing approaches. There are a few tricks to determining how to automate (the first four strategies in this paper prepare you for this assessment). One of the keys may not be intuitive: timing. 1. KNOW YOUR USER A good test plan starts with a thorough, comprehensive Ideally, we want to automate the test cases that are repetitive. Key understanding of the user. Testers should take the time to immerse experiences that are in your regression suite are the best targets. themselves into the user’s world to fully understand the use cases These are the tests that you want to repeat every time a build is for the application. For instance, before you test, it can be helpful to complete to ensure nothing has been inadvertently broken in/by the consider some of the following factors: new build.

What time of day does a user typically access the app? The next factor is evaluate how long your tests take. Save the How long is the typical session? hard tests for your people, and use those tests to challenge your Is the user in a hurry-up mode looking for quick answers and engineering/testing teams. Build your regression suite of tests with information – or is he browsing in “couch potato” mode? the simple and most repeatable tests, and your team productivity will increase significantly and consistently with every iteration. To gain the most complete understanding of the intended user, talk to your product manager or read the marketing requirements 6. KNOW YOUR PERFORMANCE document. For high-profile apps, you may even consider investing in We can think of an application’s true quality as the intersection of market research or focus-group testing to identify preferences and real-user data, mobile performance, and functional testing – all behavior patterns that can inform your testing plans further. of which are critical to the user’s entire experience. Companies use this data to create realistic user test cases and to correlate 2. KNOW YOUR APP performance to business metrics. To properly perform user testing, you must know how the user prefers to use the app and where those preferences deviate from Unquestionably, performance testing with real-user data is a game- how the app was intended to be used. Engineers will build beautiful changer. Does your testing strategy encompass these five industry things but users have the final say and they will frequently use best practices? another path that we never thought about. Develop an in-depth mobile performance strategy that Your ability to know your customer and know your app is critical to encompasses real-world scenarios and real-world data devising, executing, and analyzing tests. This “user intimacy” helps Analyze your app back-end metrics to get a fuller picture of you determine what are core functions and what are edge cases. the factors that affect performance Without this differentiation, the test matrix is merely a list of features. Analyze your front-end performance metrics to get a truer But customers don’t care about the features. They only care about understanding of your end user’s experience the experience. Tie your app’s performance with revenue- or cost- generating transactions 3. KNOW YOUR MATRIX Identify the “hot zones” where you can have a fast impact In many companies, the testing organization’s budget and value are to most effectively improve your app performance highly correlated simply with the size and scale of the testing matrix – the entire set of use cases and tests that have been identified 7. KNOW YOUR EDGE and defined for evaluating the software’s performance. The criteria Every tester knows that the “edge cases” – the scenarios that occur often revolves around how effectively and thoroughly the matrix is less frequently – are the greatest sources of crashes or obstacles completed; it is the core to your success. Unfortunately, with the that cripple app performance. But with so much of your time increasing complexity of software and mobile devices, the testing consumed simply by testing core functionality, it’s often impossible matrix is vastly larger than it was even five years ago. to complete a test plan “all the way to edge” and evaluate all of the scenarios that users seldom encounter. However, all tests are not created equal because not all functions are created equal. Different tests shouldn’t carry the same priority Depending on your overall product strategy, you can allocate testing because they don’t all equally affect the user experience to the same resources in order to get the app to market faster. You may target degree. Some tests are non-negotiable “must-do’s.” But others competitive feature sets or you may aim for deeper functional and are “nice to haves.” That’s because tests take time – sometimes a user-experience testing to pursue the highest level of product lot of time. Some tests can take so long that they are not worth the quality. It’s essential to make these strategic priorities explicit. effort, and, conversely, some of the most important tests can be the shortest to complete. A PASSION FOR TESTING Headquartered in Mountain View, California, SOASTA is the 4. KNOW YOUR DEVICES leader in performance analytics. The SOASTA platform enables The first three strategies have prepared us to identifywhat to test. digital business owners to gain unprecedented and continuous Now, we want to explore how we should be testing. Whether your performance insights into their real user experience on mobile and company is a mobile pioneer or your organization is just launching Web devices – in real time, and at scale. To help you get started its mobile testing initiatives, chances are you’re now all too familiar with performance tools, SOASTA offers a rapid assessment and with the need for access to a broadening portfolio of devices. And implementation service that can quickly jumpstart your testing the rate of change in that portfolio can be daunting: new hardware, initiatives. For more information, please visit www.soasta.com.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2015

QAI GLOBAL INSTITUTE

FEATURED ARTICLE 23

Test Automation Rant By Lee Barnes, Utopia Solutions

I need to blow off a little steam about this circus that is test Oh, a web based application with QTP? I have the perfect automation. There’s big, important life-impacting problems being framework for you... and a nice bridge for sale in Brooklyn. I solved every day, and yet test automation seems to bring out the understand these posts are coming from individuals with limited worst in everyone! experience. But how about asking questions from a learning From the absurd expectations by those wanting to implement perspective? We all need to learn – I’ve been involved in test automation in their shop, to the so-called test automation expert automation for over 20 years and I learn something new every that thinks the world’s problems will be solved if someone hands day. Asking for someone to give you an answer to a ridiculously them the right framework to copy – test automation is becoming broad and ambiguous question will not result in learning. Before an IT cesspool. you worry about a framework, you need to be thinking about why you’re automating in the first place. What are the organizational, I’ve got a litany of test automation pet peeves that I need to get processes, environmental and technical factors with which you’re off my chest. Hopefully, somewhere between the lines of the dealing? If you know the answer to those questions, then why forthcoming acidic rant there will be some educational tidbits. If it not include them in your post and start a discussion around the saves me even one explanation to an IT manager why they can’t appropriate approach to automation? This won’t result a cut-and- automate 100% of their SAP regression testing in threeweeks (or dried solution, but it likely will result in a conversation that will get ever), or the time to read one resume with the same BS copied you thinking in the right direction and enable all parties to share across 10 pages, it will be worth it... ideas (and maybe learn something!)

Managing Expectations Percentage of Test Cases Automated I suggest you read “Test Automation Snake Oil” by James Bach “So... what’s the industry standard for percentage of test cases immediately. No, really, read it NOW! It’s only six pages, I’ll wait... automated?” is usually one of the first questions I hear when You’re back? Good. Yes, I know it was written in 1999. It could introduced to new organizations. It’s soooo tempting to respond have been written yesterday. Learn it, love it, live it. The paper is with some ridiculously precise number and then wait to see how about principles, not practices. The principles are the same today long it takes them to realize I’m mocking them. as 15+ years ago. If you’re fundamentally against what James I wasn’t kidding about the importance developing a strategy! is saying then you should not invite me to help you with test Take the time to understand the activities associated with your automation, and certainly don’t ask me for a job!There’s probably software development and testing efforts. It helps to think not much reason for you to continue reading either. about test automation in a more general sense. You can get Now, back to the rant! One of my biggest pet peeves is some ideas by reading a great presentation titled “Agile Test unrealistic expectations. I’m all about helping people learn about Automation” by James Bach (I swear he’s not paying me for this) an area that I’m passionate about, but c’mon, can’t you meet me at least a little bit of the way. I’ve lost count of the organizations Automation ROI that I’ve seen that think they have implemented test automation Why do so many automation implementations seemingly have just because they’ve installed a tool. very little value from a testing perspective? In my experience it’s because there’s no overarching strategy driving the While we’re on the subject of unrealistic expectations, let’s talk implementation. You wouldn’t build a business system by sitting about test automation resources. Just because you have the a bunch of developers in a room and tell them to start coding. most skilled testers, business analysts, etc. does not mean you Yet, so many teams take this approach with automation. If have a group of budding automation engineers. Yes, I know, automation isn’t supporting your testing objectives, it’s completely the tool vendor told you that their tool has a “scriptless”mode worthless and will never deliver a ROI! and everything can be done via point-and-click by anyone that can operate a DVR. The reality is that the skills required to be So let’s talk about ROI. ROI is a calculation, and, by definition, successful with automation are fairly technical. calculations require inputs. If you’re not measuring your automation effort, you don’t know your ROI. Period. End of story. On a similar note, having the appropriate technical skills does not guarantee success. I’ve seen just as many messes created While we’re on the topic of ROI, let’s discuss the business cases by rogue developers who have gotten their hands on a test that are put together to get approval to implement test automation automation tool. Being able to sling code and address technical solutions in the first place (I should have told you not to get me challenges like dealing with custom UI objects is important, but started). I saw one earlier this year as part of a recovery project so is an understanding of software testing and what should (and that compared the cost of the tool and training to the labor cost should not) be automated. associated with manually executing a large regression test suite. Nothing else! Consultants and the Perfect Framework I think I’ve gone on long enough...If you’re thinking a little more This rant wouldn’t be complete without addressing “consultants” critically about test automation then I’ve accomplished my who purport to be automation experts. I have limited patience objective.If I’ve offended you in the process maybe you should go for people who proclaim to possess a level of expertise and back re-read that Bach article. then wear out Google trying to find the magical one-size-fits-all automation framework that they can plop in and take credit for. The testing forums are filled with posts like the one below: Watch the Videos Want to see the Test Automation Rant Videos? Scan the QR Code: Automation framework Hi, I was wondering if anyone has tried to come up with an Automation framework for QTP to work with web based application. If so, could you please share it?

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE Your users care about performance.

Do you?

PROVE IT. Continuous Performance Validation A process achieved by testing, monitoring and improving performance at every stage of the application development lifecycle, from development to production, leveraging automated and collaborative tooling.

• Produce Faster Applications • Deliver New Features & Enhancements in Less Time • Simplify Interactions Across Dev, QA, Ops and Business Stakeholders Around Application Performance

Visit neotys.com to get started!

Visit our booth at the QUEST 2016 Conference!

Don’t miss out on a special presentation from Senior Performance Engineer Steve Weisfeldt where you’ll learn:w How to Fit Performance Testing into Agile Dev Cycles April 21, 2016 | 11:15 am – 12:15 pm CONFERENCE AT A GLANCE 25

MONDAY, APRIL 18: Pre-Conference Classes & Workshop 7:30 AM – 8:30 AM Registration (Level 2 Foyer) & Breakfast (Cloud Gate Foyer)

8:30 AM – 4:30 PM Two-Day Workshop and Classes Full Day Classes MANAGERS LEADERSHIP Test Leadership – Problem Solving SOLUTIONS Manager's Solutions Workshop Cloud Gate 1 Lynn McKee, Quality Perspectives Discover CERTIFICATION Break CSTE Certification Prep AGILE Agile Estimation Morningstar 10:00 AM Hosted by Morningstar Cloud Gate 2 Tom Cagley, DCG Software Value Training Center Lunch CERTIFICATION [Looking Glass] CSQA Certification Prep LEAN Trimming Down Your QA Effort While Maintaining Quality Morningstar 12:00 PM – 1:00 PM Hosted by Morningstar Cloud Gate 3 Clyneice Chaney, MITRE Training Center Break 2:30 PM MOBILE Mobile Testing: Manual and Automated Cloud Gate 4 Michael Yudanin, Conflair AUTOMATION Getting Started with Selenium Test Automation Cloud Gate 5 Chris Lawson, Zenergy Technologies

5:30 PM – 8:30 PM Manager’s Connection Dinner - Hosted by Tom Ticknor and Nancy Kastl, Quest Conferences TUESDAY, APRIL 19: Pre-Conference Tutorials, Classes & Workshop ]7:30 AM – 8:30 AM Registration [Level 2 Foyer] & Breakfast [Cloud Gate Foyer]

Two-Day Workshop and Certification Prep Classes – 8:30 AM – 4:30 PM Continued from Monday

Half Day Tutorials: 8:30 AM – 12:00 PM Half Day Tutorials: 1:00 PM – 4:30 PM LEADERSHIP Leading Change When You’re Not in Charge LEADERSHIP What’s Your Leadership IQ? Cloud Gate 1 Jennifer Bonine, tap|QA Cloud Gate 1 Jennifer Bonine, tap|QA

Break PROCESS Agile Metrics - It’s Not About Velocity PROCESS Value Stream Mapping and Kaizen in Agile Retrospectives 10:00 AM Cloud Gate 2 Philip Lew and Steve Gohres, XBOSoft Cloud Gate 2 Angela Dugan, Polaris Solutions

Lunch REQUIREMENTS Making Requirements and User Stories Testable RISK (Almost) Everything I know about testing I learned playing poker [Looking Glass] Cloud Gate 3 David DeWitt, NueVista Cloud Gate 3 Matthew Eakin, Centric Consulting 12:00 PM – 1:00 PM MEASUREMENTS Maintaining Testing Integrity Under Pressure MOBILE Usability Goes Mobile Break Cloud Gate 4 Carolyn Swadron, CIBC Cloud Gate 4 Susan Brockley, ExxonMobil 2:30 PM The Development and Implementation of an Automation AUTOMATION AUTOMATION Introduction to ATDD using Ruby, Cucumber, Watir-WebDriver Framework Cloud Gate 5 Cloud Gate 5 Joseph Ours, Centric Consulting Dean Carvin, Checkpoint Technologies

4:30 PM – 6:00 PM [Looking Glass] Welcome Reception - Sponsored by QAI Global Institute

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 26 CONFERENCE AT A GLANCE

WEDNESDAY, APRIL 20: Conference & EXPO

7:30 AM – 8:15 AM [Level 2] Registration & Breakfast - Sponsored by Accenture

8:15 AM – 8:30 AM [Grand Ballroom 1-3] Opening Remarks & Announcements - Nancy Kastl, QUEST Conference Chairperson

[Grand Ballroom 1-3] Keynote Presentation: Keeping Pace with Digital Transformation: Trends and Recommendations from the 2015-2016 World Quality 8:30 AM – 9:30 AM Report - Matt Chessler, Capgemini

9:30 AM – 10:00 AM [Grand Ballroom Foyer] Morning Refreshment Break - Sponsored by Microexcel

9:25 AM – 4:00 PM [Grand Ballroom 4-6] Exhibitor EXPO - Browse and learn from the industry’s leading service and technology providers!

[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]

10:00 AM – 11:00 AM LEADERSHIP AGILE MOBILE RISK OPEN SOURCE

Pursuing World Class Quality: Simplicity: The Path to Mobile App Testing: What and The Tester’s Story: Painting the Leveraging Free, Open Source, Transforming Your Organization Achieving Agile Testing How to Test? Picture of Risk and Low-Cost Tools for Back Presentations Clyneice Chaney, Quality Squared Efficiency Nikhil Kaul, SmartBear Software Shaun Bradshaw, Zenergy End Testing Paul Herzog, SPR Consulting Technologies Elysia Lock, Emmi

11:15 AM – 12:15 PM LEADERSHIP AGILE MOBILE RISK OPEN SOURCE

What Time is It Over There? Budgeting, Estimation, Faster and Better Mobile Testing Risk Based Testing at the How to Tackle Open Source Maximizing the Effectiveness of Planning, #NoEstimates and the in the Cloud Enterprise Level Test Automation in Incredible Presentations Your Global QA Team Agile Planning Onion” Jamie Moore, Mobile Labs Bernd Bornhausen, Banque Ways Elizabeth Wisdom, Ulta Beauty Tom Cagley, David Consulting Nationale du Canada Harpreat Singh and Piyush Group Sachar, Microexcel

11:15 AM – 11:45 AM [Discover] EXPO TALK: Test Workbench for Holistic Test Management - Chaithanya Rajanna, Deloitte Consulting

11:45 AM – 12:15 AM [Discover] EXPO TALK: Automated Tests without Recording or Scripting with AscentialTest - Brian LeSuer, Zeenyx Software

12:15 PM - 1:30 PM [Grand Ballroom 1-3] Special Interests Roundtables & Lunch

1:30 PM – 3:00 PM LEADERSHIP AGILE MOBILE PLAN/DESIGN OPEN SOURCE

ZAP, You’re QA Team Deconstructing SAFe – the Mobile Testing: To Automate or Making the Case for Getting Started with Jmeter! Leader! How to Build a High Scaled Agile Framework Not to Automate? Collaborative Test Case Daniel Schiff, edo Interactive Workshops Performance Team Angela Dugan, Polaris Solutions David Dang, Zenergy Development Rebecca Staton-Reinstein, Technologies Todd Peak, Seapine Software Advantage Leadership

1:30 PM - 2:00 PM [Discover] EXPO TALK: Sizing, Estimating and Testing: Can You Answer the 3 questions? - Tony Timbol, DCG Software Value

2:00 PM – 2:30 PM [Discover] EXPO TALK: Right Data, Right Place, Right Time - Mike Cartina, Orasi Software

2:30 PM – 3:00 PM [Discover] EXPO TALK: Moving to an Onshore team and Managing Technical Millennials - Michael Faulise, tap|QA

3:00 PM – 3:30 PM [Grand Ballroom Foyer and Cloud Gate Foyer] Afternoon Refreshment Break - Sponsored by Zeenyx Software, Inc.

3:30 PM – 4:00 PM [Discover] EXPO TALK: Automation for Devs and Testers with TestComplete - Gregory Hanson, SmartBear Software

4:00 PM – 4:30 PM [Discover] EXPO TALK: QA Best Practices for Agile Environment - Piyush Sachar, Microexcel

3:30 PM – 4:30 PM LEADERSHIP AGILE MOBILE PLAN/DESIGN OPEN SOURCE

Culture of Quality: Integrating Using BDD and Specifications Mobile Test Automation and the The Testing Pyramid: It’s Not Acceptance Test Driven QA in the SDLC by Example in Increase Software Need for Continuous Quality about Testing Development (ATDD) with Presentations Helene Simmons, Lincoln Value Eran Kinsbruner, Perfecto Gary Pedretti, Sodoto Solutions SpecFlow Financial Group; Jackie Wilson, Diane Walker and Nick Hussey, Chris Taylor, Polaris Solutions Lincoln Financial Group Equifax

5:30 PM – 9:30 PM [House of Blues] Attendee Appreciation Night in Chicago, sponsored by tap|QA

THURSDAY, APRIL 21: Conference & EXPO

7:30 AM – 8:15 AM Registration & Breakfast

7:45 AM – 8:15 AM [Discover] Early Bird Session: Successful Networking: Making the Right Connection - Charlene Wooley, Equifax

8:15 AM – 8:30 AM [Grand Ballroom 1-3] Announcements - Nancy Kastl, QUEST Conference Chairperson

8:30 AM – 9:30 AM [Grand Ballroom 1-3] Keynote Presentation: Agility and Reliability Need Not Be Mutually Exclusive - John Chang, CAST North America

9:30 AM – 10:00 AM [Grand Ballroom Foyer] Morning Refreshment Break - Sponsored by Mobile Labs

9:25 AM – 6:30 PM [Grand Ballroom 4-6] Exhibitor EXPO - Browse and learn from the industry’s leading service and technology providers!

[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]

10:00 AM – 11:00 AM LEADERSHIP MEASUREMENT AUTOMATION PERFORMANCE EXPLORATORY TESTING

The Art of Testing Metrics: The Force Awakens How to make Test Automation Load It UP: Effectively Agilify Your Manual Testing Transformation: Blending Joseph Ours, Centric Consulting SMARTER Combining Functional and Through an Exploratory Technology with Cutting-Edge Jim Trentadue, Original Software Performance Testing Approach Presentations Processes Chris Lawson, Zenergy Ryan Yackel, QASymphony Jennifer Bonine, tap|QA Technologies

10:00 AM – 10:30 AM [Discover] EXPO TALK: Selenium: The Core of Automation - Manju Naglapur, CompuGain Solutions

10:30 AM – 11:00 AM [Discover] EXPO TALK: Mobile SLA Monitoring & Validation Automated Framework - Vinayak Gaur, Hexaware

11:15 AM – 11:45 PM [Discover] EXPO TALK: Cross-Platform Mobile Apps Testing Using a Mobile Device Cloud - Jamie Moore, Mobile Labs

11:45 AM – 12:15 PM [Discover] EXPO TALK: Beyond Resizing a Browser: Useful Responsive Web Testing Tips - Eran Kinsbruner, Perfecto

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE CONFERENCE AT A GLANCE 27

THURSDAY, APRIL 21 CONTINUED: Conference & EXPO [Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]

11:15 AM – 12:15 PM LEADERSHIP MEASUREMENT AUTOMATION PERFORMANCE UAT

Business Case for Software Creating Useful Metrics to Don’t Be Another Statistic! How to Fit Performance Testing Tips for Maintaining UAT Testing and QA Operations Provide Quality Software Develop a Strategy for Long- into Agile Dev Cycles Integrity Presentations Bernd Haber, Accenture Helene Astier, Cars.com Term Test Automation Success Steve Weisfeldt, Neotys Carolyn Swadron, CIBC Lee Barnes, Utopia Solutions

12:15 PM – 1:30 PM [Grand Ballroom 1-3] Special Interests Roundtables & Lunch - Sponsored by Neotys

1:30 PM – 3:00 PM LEADERSHIP DEV/OPS AUTOMATION SECURITY PROCESS IMPROVEMENT

Enhancing Your Leadership 10 Steps to Continuous Applying Design Patterns to Real World Security Testing The Red Bead Experiment Skills to Become an Effective Integration, Testing and Delivery Automated Testing Matt Konda, Jemurai Mike Kaufman, EMC Workshops Test Manager Tanya Kravtsov, ROKITT Brian Le Suer, Zeenyx Software Michael W Ennis, TEKsystems

1:30 PM – 2:00 PM [Discover] EXPO TALK: Combining Manual and Automated Testing with Microsoft Visual Studio - Paul Herzog, SPR Consulting

2:00 PM – 2:30 PM [Discover] EXPO TALK: Jump Start Automation through Utopia Automation Framework (UAF) - Lee Barnes, Utopia Solutions

2:30 PM – 3:00 PM [Discover] EXPO TALK: Making the Most of Selenium: Your Tough Questions Answered - David Dang and Chris Lawson, Zenergy Technologies

3:00 PM – 3:30 PM [Grand Ballroom Foyer and Cloud Gate Foyer] Afternoon Refreshment Break - Sponsored by DCG Software Value

3:30 PM – 4:30 PM LEADERSHIP DEV/OPS AUTOMATION SECURITY DELIVERABLES

Polyskilling Testers: Good, Bad DevOps: A Testers Best Friend Keyword Driven Testing with Security Testing Scripts for the Testing Deliverables: Define, or Ugly? Thomas Janik and ken Robertson, Selenium: The Good, the Bad Non-Hacker: Straight from the Align, Document and Approve Presentations Matthew Eakin, Centric Consulting American Family Insurance and the Use Case Security Pro’s Handbook! Clareice Chaney, MITRE and Brian Van Stone, QualiTest Group Glenn Stout, HALOCK Security Clyneice Chaney, Quality Squared Labs

3:30 PM – 4:00 PM [Discover] EXPO TALK: Linking Requirements to Test Cases with TestTrack - Kayla Gillman and Mike Turton, Seapine Software

4:00 PM – 4:30 PM [Discover] EXPO TALK: Continuous Performance Validation with NeoLoad and NeoSense - Steve Weisfeldt, Neotys

4:00 PM – 4:30 PM [Grand Ballroom 4-6] Exhibitor EXPO - Browse and learn from the industry’s leading service and technology providers!

5:00 PM – 6:30 PM [Grand Ballroom Foyer] EXPO Reception

FRIDAY, APRIL 22: Conference

7:30 AM – 8:15 AM Registration & Breakfast

7:30 AM – 8:15 AM [Discover] Early Bird Session: Take Leadership by the Marshmallow! - Mike Kaufman, EMC

8:15 AM – 8:30 AM [Grand Ballroom 1-3] Announcements - Nancy Kastl, QUEST Conference Chairperson

8:30 AM – 9:30 AM [Grand Ballroom 1-3] Keynote Presentation: Shift Left and Steer Right - Joe Colavito, Corevu

9:30 AM – 10:00 AM [Grand Ballroom Foyer] Morning Refreshment Break - Sponsored by CompuGain Solutions

[Cloud Gate 1] [Cloud Gate 2] [Cloud Gate 3] [Cloud Gate 4] [Cloud Gate 5]

10:00 AM – 11:00 AM LEADERSHIP TEST DATA TEST STRATEGY REGRESSION CERTIFICATION

Leading Indicators of Quality: 5 Critical Elements for Isn’t an Enterprise Test Strategy Regression Test Management CSTE/CSQA Practice Driving the Conversation & a Successful Test Data just for an Enterprise Project Using a User Interface – Certification Exam Presentations Managing Risk Management Program Release? CARTTS Tool Dana Dietz, Nationwide Robert Kelman, AT&T Susan Schanta, Cognizant Mani Rajappa, GSI Health Technology Solutions

11:15 AM – 12:15 PM LEADERSHIP TEST DATA CONTINUOUS TESTING CLOUD

Efficiency and Effectiveness: Data, Data Everywhere! Building ‘Quality Software’ The Cloud’s Impact on Testing When Process and Pressure Understand Your Data & with Continuous Integration & Tom Chavez, SOASTA Presentations Collide Maximize Test Coverage Continuous Testing Frank Rios and Rich Valde Jessica Paddock, Orasi Software Ashish Nirgudkar,Cognizant Technology Solutions

12:15 PM – 1:30 PM [Grand Ballroom 1-3] Lunch & QAI Grand Prize Drawing

1:30 PM – 2:30 PM [Cloud Gate 1-2] Panel Discussion: Achieving Cross Roles Collaboration to Build Quality Software

1:30 PM – 2:30 PM [Cloud Gate 5] TCOE: Harmonizing Business and Technology Needs Using Next Generation Testing - Kimberly Tatum

[Cloud Gate 3-4] [Cloud Gate 3-4] [Cloud Gate 3-4] [Cloud Gate 3-4]

2:30 PM – 3:00 PM ALM COLLABORATION ALM COLLABORATION ALM COLLABORATION ALM COLLABORATION

Shift Left through Tester – Shift Left through Tester – Shift Left through Tester – Shift Left through Tester – Roundtable Project Manager Collaboration Business Analyst Collaboration Developer Collaboration Scrum Master Collaboration Discussions PMI Chicagoland David DeWitt, IIBA Chicagoland Christopher Jones, IEEE Michael Marchi, Agile Professional Chapter Learning Network-Chicago

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE Are Software Testing Efforts Being Impaired by “Bad” Data? Reduce Costs, Improve Efficiency across the SDLC with More Effective Test Data Management

Most enterprises take a disorganized approach and helps develop and implement a mature to test data management, with roles and methodology for gathering the right test data, responsibilities poorly defined, if at all. Often, on time and on budget. Better data means testers end up handling data gathering with more effective tests, so teams can pinpoint and little to no understanding of exactly what data is resolve more defects before application release needed for the tests. In the process, testers likely to production. spend 50% of their time—or more—gathering data for tests instead of doing their jobs. To learn more, visit www2.orasi.com/tdm.

Orasi’s professional services team assesses organizational test data management processes

Orasi Software, Inc. 114 TownPark Drive, Suite 400 Kennesaw, GA 30144 Automate Your Mobile Testing Global Consulting to Increase Device Functional & Coverage and Automate Your Services Performance App Reliability Orasi’s Experts Test Data Testing Know SAP Management for the Busiest for Fast of Software and Accurate Development Testing Schedules

www.orasi.com EXPO TALKS 29

Test Workbench for Holistic Test Management Wednesday, 11:15 – 11:45 AM Chaithanya Rajanna, Deloitte Consulting Learn how tools can reduce the gap between business and IT through holistic test management and creating automated scripts without writing code. Test Workbench by Deloitte™ is one stop shop solution that helps transform testing organizations to higher maturity. Workbench is built on an integrated platform with multiple modules that cater to increasing efficiencies and effectiveness across testing life cycles. Some of the key modules are “Holistic Test Planning”, “Automated Status Reporting”, “Demand Management”, efficient test design management using Design Workspace and Scriptless Automation” and “Effective Test Coverage Analyzer”.

Automated Tests without Recording or Scripting with AscentialTest Wednesday, 11:45 AM – 12:15 PM Brian Le Suer, Zeenyx Software Get a brief introduction to AscentialTest from Zeenyx Software and learn how it helps organizations save time and reduce costs by enabling domain experts to design and create manual and automated tests without recording or scripting. In this product demonstration, you’ll find out how AscentialTest eliminates costly and inefficient test frameworks, while minimizing the test maintenance effort. AscentialTest is an enterprise level Test Management System that encompasses test planning, development, data management and execution for applications running on Windows, the web, java, dotNet, terminals and PowerBuilder. Come and learn how Zeenyx is making testers more productive. Sizing, Estimating and Testing: Can You Answer the 3 Questions? Wednesday, 1:30 – 2:00 PM Tony Timbol, DCG Software Value Sizing software establishes timelines for completing work, including appropriately allocating resources (team members and budget). But how does this relate to the testing process? The adage, “What you can’t measure, you can’t manage,” applies here. What is needed is a method of making the importance and effectiveness of testing visible and measurable. This presentation will outline how sizing in testing can help you answer 3 important testing questions: Is there enough time?, Is there enough data?, and “Are there enough people to test what is needed?”

Right Data, Right Place, Right Time Wednesday, 2:00 – 2:30 PM Mike Cartina, Orasi Software The application economy is driving massive digital transformation. As a result, organizations are increasingly under pressure to continuously deliver valuable and high quality applications faster than ever. Yet the quality of an application depends on the quality of the testing data, and creating the right test data, to the right place, at the right time, remains a significant challenge. Orasi provides best-of-class partner technologies and services that can help organizations find, create and provision the data needed for testing– automatically and quickly. Test data constraints, which routinely compromise application quality, can be eliminated, accelerating application delivery to market, on time and within budget. Moving to an Onshore team and Managing Technical Millennials Wednesday, 2:30 – 3:30 PM Michael Faulise, tap|QA Are you struggling with how to keep up with the demands being made on your testing team and managing Millennials? Come see how transitioning to an on-shore model using “tap|Lakeshore” can improve your productivity, reduce cost, and increase the quality of deliverables. With increased security concerns and agile methodologies many companies are leveraging a near-shore solution for their testing needs. We see a 33% to 50% reduced cost for companies that transition to tap|Lakeshore. Attend this session and see how companies are using this model to solve testing challenges, new management techniques with Millennials, mobile testing, automation, and CI needs. Automation for Devs and Testers with TestComplete Wednesday, 3:30 – 4:00 PM Gregory Hanson, SmartBear Software In this talk you will gain insight into how mixed teams of devs and testers are able to use TestComplete and our new Visual Studio plugin to enhance your automation suite. With the world moving to a more DevTest model, having combined teams of testers that can work in a Record and Playback model as well in their development IDE on the same platform is a necessity. QA Best Practices for Agile Environment Wednesday, 4:00 – 4:30 PM Piyush Sachar, Microexcel In an Agile/Scrum project, QA is a team’s responsibility. Everyone should know what type of testing is needed and who will perform testing at what time in the sprint process. The QA team member selects the tools for the desired testing. For example, system testing can be performed through Selenium and integration testing can be done through SOAP UI or REST API. Test case prioritization and test coverage should follow QA best practices. Team selection also plays an important role in delivery of Agile projects. The discussion on Agile QA best practices will be followed by a case study of a large enterprise that includes Demandware, Marketo, Ampliance, SAP, OMS and Highway 905.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 30 EXPO TALKS

Selenium: The Core of Automation Thursday, 10:00 – 10:30 AM Manju Naglapur, CompuGain Solutions When examining the rapid development of the software industry over the past several years, automation has taken a central role in delivering effective and reliable software-based business tools and solutions. Today, business tools must be agile and able to adapt to the frequently changing approaches and strategies shifting markets and consumer trends require. Such agility is a key component of modern software tools seeking to minimize disruptions to in-place solutions.

Mobile SLA Monitoring & Validation Automated Framework Thursday, 10:30 – 11:00 AM Vinayak Gaur, Hexaware Technologies Business critical mobile applications require constant monitoring of business SLAs to ensure the reliability, availability and efficiency of services to the customers. A new mobile testing trend is to establish a framework that combines the validation and monitoring requirements in a common integrated testing approach on supported mobile platforms. Hexaware has implemented an automated mobile Test/Monitoring framework for one of our telephony clients to diagnose, check (24X7) and report the overall health of functional components and features of a core business critical mobile application that provides VoIP calling features across various countries.

Secure Mobile App Testing with Mobile Labs Thursday, 11:15 – 11:45 AM Jamie Moore, Mobile Labs Winning in today’s mobile-first enterprise means delivering quality cross-platform mobile apps that perform perfectly. Getting apps ready for prime time takes the right mobile app testing solutions to help conquer the challenging dynamics of mobility. Mobile Labs’ patented technology provides enterprise-grade mobile app testing solutions and worldwide, 24×7 device access and management from a secure mobile device cloud. The result is more efficient testing, improved quality and increased user satisfaction. Come hear about the Mobile Labs solution: deviceConnect™: a private mobile device cloud, Labs Trust: a certified add-in to HP QTP, and deviceBridge™: the only virtual USB cord available today.

SOFTWARE TESTING & IT QUALITY ASSURANCE EXPERTS

CompuGain SOLUTIONS

Scale your business applications to & future~proof your ENTER WIN! infrastructure Schedule an appointment or demo with one of our software using our expertise. quality experts to enter our drawing for a $100 gift card! www.checkpointech.com 813-818-8324 www.compugain-solutions.com | [email protected] | 703.956.7500

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE EXPO TALKS 31

Beyond Resizing a Browser: Useful Responsive Web Testing Tips Thursday, 11:45 AM – 12:15 PM Eran Kinsbruner, Perfecto Half of web traffic comes from a mobile device, so it’s no surprise that organizations are adopting different strategies to ensure a consistent user experience on any device. However, there’s a lot more to a quality digital experience than simply viewing a website in different screen sizes. To truly deliver seamless web viewing and interaction on any device from laptop to smartphone, RWD apps using Selenium need to go through testing rigors including: testing on actual devices (not emulators), testing against real user conditions and interruptions, and testing visual aspects such as screen orientation changes. In this talk, Perfecto’s Eran Kinsbruner will discuss practical RWD testing tips and also demonstrate RWD testing scenarios.

Combining Manual and Automated Testing with Microsoft Visual Studio Thursday, 1:30 – 2:00 PM Paul Herzog, SPR Consulting There are very few tools on the market that combine all aspects of application lifecycle management as efficiently as Microsoft’s Visual Studio/Team Foundation Server, especially when incorporating Microsoft Test Manager. You can build manual test cases, control manual testing cycles, build test data, and also integrate automated tests from Visual Studio and its CodedUI library into a common testing approach and planning structure. There’s no need to have multiple testing tools, test repositories and referencing multiple dashboards for testing status. Join Paul in an investigation of a singular approach to test management, execution, metrics, and defect tracking for manual and automated testing.

Jump Start Automation through Utopia Automation Framework (UAF) Thursday, 2:00 – 2:30 PM Lee Barnes, Utopia Solutions Over more than 15 years of implementing test automation, Utopia Solutions’ engineers have collected best practices and core features that are required independent the functionality or technology of the application you’re testing. These features have been incorporated into the Utopia Solutions Automation Framework (UAF) and form the foundation for implementing successful test automation across a variety of technologies and applications. The UAF supports HP UFT and Selenium and includes an extensible common UI interaction layer, flexible reporting, error detection and recovery, and interacting with external data sources. Attend this talk to understand how the UAF can jump start your automation success. If you have existing automation assets, learn the critical test automation factors your solution must include.

Making the Most of Selenium: Your Tough Questions Answered Thursday, 2:30 – 3:00 PM David Dang and Chris Lawson, Zenergy Technologies Join QUEST presenters and workshop instructors, David Dang and Chris Lawson of Zenergy Technologies, for a question and answer session on Selenium implementations. This open session is a chance to share your specific questions with experts who, having conducted numerous Selenium engagements for clients, have encountered and solved a multitude of challenges with the open source framework. Let David and Chris make your Selenium implementation smoother by learning from their first-hand experience.

Linking Requirements to Test Cases with TestTrack Thursday, 3:30 – 4:00 PM Kayla Gillman and Mike Turton, Seapine Software By linking test cases to their requirements, TestTrack makes it possible for you to go directly to the exact requirement the test case was written for. No more combing through design documents for a specific requirement! Seapine Software’s Kayla Gillman, Solutions Specialist, and Mike Turton, Business Development Manager, will show you firsthand how much time and frustration TestTrack can spare you when you have to refer back to the requirement from a test case or test run.

Continuous Performance Validation with NeoLoad and NeoSense Thursday, 4:00 – 4:30 PM Steve Weisfeldt, Neotys At Neotys, we think Continuous Performance Validation is the best way to produce faster applications, deliver new features and enhancements in less time and simplify interactions across Dev, QA, Ops and business stakeholders around application performance. This is achieved by testing, monitoring and improving performance at every stage of the application development lifecycle, from development to production, leveraging automated and collaborative tooling. In this talk, we’ll show a live demo of our products NeoLoad and NeoSense working together to validate the performance of an application from Dev to Prod.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 32 EARLY BIRD SESSIONS & PANEL DISCUSSION

Successful Networking: Making the Right Connection

Thursday, 7:45 AM – 8:15 AM Charlene Woolley, Equifax E Networking is vital for anyone and everyone today to be successful. There are so many ways to network, so A how do you know which method is the right one for you to follow? Join Charlene to explore some “Out of the Box” Networking styles, tips and tricks, and learn how to expand your Networking skills in order to make the R right connections! L Y Learning Objectives: • Learn the importance of a connection and how they can help you B • Understand different ways to network using “Out of the Box” networking styles I • Obtain the key steps to networking – Do’s and Don’ts R D

Take Leadership by the Marshmallow! Friday, 7:30 AM – 8:15 AM Mike Kaufman, EMC E Every guru, philosopher, and management leader out there says the first step to Leadership is taking A Responsibility. But none of them tell you how! We will explore the research-driven approach that provides clear R steps on how to take Responsibility in any situation – work, home, or life. This session is targeted to all team members who wish to explore and expand their Leadership capabilities. Anyone, not just managers or leaders, L can exhibit leadership, regardless of their role, by demonstrating responsibility in their own actions. Come for a Y fun breakfast of spaghetti and marshmallows and discover the leader in you! Learning Objectives: B I • Differentiate between responsibility and accountability R • Learn how to take responsibility D • Transform to personal responsibility and leadership using three key pillars

Achieving Cross Roles Collaboration to Build Quality Software Friday, 1:30 PM - 2:30 PM Moderator: Nancy Kastl, QUEST Conference Chairperson

Today’s software development teams are comprised of specialists, each playing a specific role based on skills P and responsibilities. Project managers are responsible for managing projects. Scrum masters guide Agile teams. A Business analysts focus on analyzing business requirements. Developers code the software, and QA/testers test the software. Many of these roles are defined by a body of knowledge (BOK), have certifications, and/or N professional communities for continuous learning. Whether a software development project is agile, iterative or A waterfall, the project’s ultimate success is based on collaboration and an emphasis on building quality into the L software instead of testing in quality at the end. Our panelists, representing each of the roles within a software project and are leaders within their respective professions. Come join them as they breakdown role-based silos D and share insights to collaboratively building quality software. I • How does each role define quality software? What are the similarities and differences in these perspectives? S • How does each role’s Certification Body of Knowledge support building quality software? C • What challenges does each role face within a project team? How can collaboration overcome these challenges in waterfall, U iterative or agile? S • What are the pros and cons of specialized roles vs. project team members interchangeable in their roles? • How can application lifecycle management (ALM) tools foster cross role collaboration? S • How can other roles help testers ‘shift left’ within a project? I O Panelists include: N Nancy Kastl, Chicago Quality Assurance Association Aisleigh McGanni, PMI Chicagoland David DeWitt, IIBA Chicagoland Chapter Christopher Jones, IEEE Chicago Section Michael Marchi, APLN Chicago

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE FEATURED ARTICLE 33 Choosing What to Automate By Brian Le Suer, Zeenyx Software

Job descriptions for QA engineers almost routinely require experience Next, consider the number of different test cases that follow the with one or more commercial automated testing tools. From a distance, same path through the target application. When automated tests are it would appear that most software products were tested via scripting or properly designed with separation of test steps and test data, a good record/playback. Yet despite how long these tools have been around, return on the work effort can be achieved very quickly. In fact, it is how many organizations really know how to harness the potential of possible that the tests could pay for themselves the very first time that test automation? they are run because it is likely that most of the data combinations will One of the most fundamental reasons why organizations may not never have to be executed manually. Order Entry in an eCommerce get the most from their investment in commercial testing tools is in application is a good example where sales of different products and choosing what and what not to automate. Most software applications quantities are loaded into a shopping cart and where subtotals and do in fact provide plenty of good opportunities to increase productivity totals must be verified. Search engines offer another good opportunity, and improve reliability of testing through effective use of automated where only a few user events need to be simulated in order to testing tools. complete the test. The purpose of this article is to provide a set of criteria that can be Well-designed automated tests are comprised of reusable steps. Steps used to evaluate automation candidates. These criteria can be broadly are created to drive the target application to a test state, verify an organized into two categories: efficiency, which involves a financial application response and then return the application to a known ‘base’ cost/benefit analysis and effectiveness of manual vs. automated state. The steps required to verify the actual against the expected testing. result usually present the biggest challenge. Revisiting the eCommerce example, the best way to design a test that verifies the contents of a Shopping Cart is to generate the expected results by capturing the Efficiency and Effectiveness The most basic set of questions regard cost/benefit analysis and price, quantity and other attributes of the products being purchased consider the cost of development and maintenance. How many person as part of the test. Again, this approach requires more effort, but the hours will it take for test development? How many hours will it take to tests will be self-maintaining as the content of the dynamic storefront maintain the tests for a selected time horizon? These costs need to be changes. compared with an estimate of how long it takes to perform the same Some test types can be developed in such a way that they can be tests manually. How often do these tests need to be executed? This used universally against any application. Examples include verifying analysis is not as simple as it might seem for a number of reasons. field data types, field length, required/optional fields, tab order and First, it is not always well known how the target application will change adherence to GUI standards. Writing a universal test requires an over time. Application change may translate into script maintenance, understanding of abstraction, but otherwise, they are not difficult to but it is also the primary reason for automating tests in the first place. write. The following is a simple example: After all, if the application didn’t change, there would be no need to retest it. Therefore the frequency of change needs to be factored into both sides of the equation. Tests that can be automated quickly may be able to pay for themselves the very first time that they are run. Others may never achieve a positive cost/benefit ratio. There are other factors impacting the cost/benefit analysis beyond a comparison of person hour costs for manual and automated testing. Time to market for software products must also be considered. More difficult to measure, of course, are the less tangible aspects of testing. For example, what is the likelihood that a manual tester will fail to catch a defect that an automated test would have caught. Here is a place where a look at the tests themselves can help bring some clarity to the decision. Automated tests are very effective at validating a lot of detail. If a single character does not match when a comparison between an actual and expected result is made, a properly designed test will alert the tester to have a closer look to determine if there is in fact a failure. Testing software installations and un-installations are good candidates for automation. Testing tools are more effective than manual testers at validating a large amount of detail. There are types of tests that are difficult to perform manually. Stress This simple test step is capable of verifying the field length of any field and performance tests are obvious examples. But even on a single that accepts a string. It takes two parameters: the name of the field desktop, an automated testing tool is much more effective at running and the expected field length. It assumes that the field will truncate a routine set of tasks repeatedly to ensure that the target application characters beyond the field length limit. It raises an error if the field is not leaking memory and that system resources are being utilized accepts characters beyond the limit. Executing tests of this type properly. They are also better at measuring the duration of an event. manually are not a good use of a domain expert’s time and are better It’s easy to create a script that performs a task, starts a timer, waits for assigned to the automated testing tool. a cue from the GUI that the system is finished responding and then measures the elapsed time. Attempting to do the same thing with a There are a number of reasons why a software development stopwatch seems like a poor use of person power. organization should consider test automation including: Productivity, Repeatability, Efficiency, Effectiveness, Flexibility, Accountability, Stability, Complacency, and Preservation. Evaluating the Feasibility of Automating a Test One of the most challenging aspects of choosing what to automate is And if the right choices are made in choosing what to automate, a good evaluating the relative difficulty of automating a given test. return on investment can be achieved. Yet, as thorough a job as we First, consider the complexity of the test. Tests that navigate a few might do analyzing the costs and benefits of a test automation effort, pages or screens and can be verified with data captured directly from some things defy quantification. the application will be relatively easy to automate. When prioritizing Brian Le Suer is the CEO of Zeenyx Software, Inc., a company automation tasks, schedule the easier tests first so that the benefits of dedicated to building next generation solutions for manual and automation are realized quickly. There are plenty of tests that can be automated software testing. Visit www.zeenyx.com to learn about their executed on a single page or screen like validating error messages innovative step-based approach. when required fields are omitted or testing boundary conditions. CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 34 WEDNESDAY, APRIL 20 - PRESENTATIONS 10:00 AM - 11:00 AM

Pursuing World Class Quality: Transforming Your Organization The Tester’s Story: Painting the Picture of Risk Clyneice Chaney, Quality Squared Shaun Bradshaw, Zenergy Technologies

The traditional time versus cost versus quality conundrum is faced Identifying risk by detecting bugs may be the primary goal of a tester L by organizations trying to keep pace with the rapid pace of market but we have a unique responsibility within software development E driven changes today. The Quality Management/Assurance/ projects. Clearly communicating risk can mean the difference Testing organization is constantly under pressure to deliver low between successful mitigation and the nightmare scenario of critical A incident products in continuously shrinking development timelines. revenue streams being interrupted. But no one wants to channel D Some enterprises establish world-leading quality assurance (QA) Chicken Little or conjure images of the boy who cried wolf every time E functions while others implement small-scale change. a bug is discovered. R R Clyneice provides practical hands-on techniques for changing Critical issues must be communicated in a manner that delivers S I organizations. Join Clyneice to align expectations with reality and S the right messages while building trust. But trust can be difficult to H improve the view of testing. Effect change in your organizations create given the special nature of testing and the challenges it can I utilizing principles and methodologies. Transform your organization K present in the relationship between testers and developers. Add the P and get respect. stakeholders into the mix and it is not always easy for testers to be heard, much less trusted. Learn how to better communicate with developers and stakeholders, build and maintain trust, and ensure issues and defects are proactively addressed by telling an effective story that paints the right picture for all parties.

Simplicity: The Path to Achieving Agile Testing Join Shaun to determine the best way to communicate your story Efficiency to the relevant stakeholders and identify the risks that exist without losing trust or crying wolf. Get your voice heard in your organization. Paul Herzog, SPR Consulting

The pace of an Agile project creates demands efficiency in all Leveraging Free, Open Source, and Low-Cost testing techniques and processes. Traditional approaches run counter to this efficiency and must be changed during the Agile Tools for Back End Testing transition. Join Paul as he applies the Agile Manifesto Principle A #10: “Simplicity – the art of maximizing the amount of work not Elysia Lock, Emmi G done – is essential” to distinguish what past testing practices O work and don’t work to clean out the clutter of the non-working. P Front-end GUI testing is a small slice of the QA pie. Much more goes I He will identify common process traps when adopting Agile on beyond the interface in the server, database, and API layers. Many L methodologies, suggest priorities that are most important to E testers are discouraged from really digging into the back-end to find E Agile testing, and present ways to remove testing inefficiencies. N the source of issues and uncover bugs that aren’t presented in the Determine how to include process evaluation in regular Sprint application’s GUI. Learn how to identify some areas of the back-end Retrospectives or other checkpoints and implement continuous S that are prime targets for low-effort, low-cost testing. Elysia shows improvement focused on simplicity. Experience a successful how back-end testing does not need to be expensive by giving a transition to Agile with Paul! O real-world demo of back-end testing of popular web applications such U as Google and Twitter using grep and tail, jmeter, SoapUI, and smart R SQL queries. Join Elysia to learn some quick and easy ways to get C started with back-end testing for true white-box testing. Finish with a Q & A session aimed at real-life challenges. E

Mobile App Testing: What and How to Test? Nikhil Kaul, SmartBear Software QUEST Exhibitor EXPO & EXPO Talks With Apple, Google, and Microsoft making it easier for developers to build cross-platform apps, mobile app testing will continue to come under more pressure. There is more to test in less time. Opening on Wednesday morning, the Exhibitor EXPO features vendor Simultaneously, with recent releases such as Windows 10, the line booths from leading organizations in the industry. Enter for a chance to M between desktop and mobile is getting blurred, essentially meaning O win exhibitor prizes, and get your QUEST Passport stamped to enter in traditional testing frameworks wouldn’t work for long. Add to all the QAI Grand Prize drawing on Friday during lunch (must be present B of this, the challenges mobile app testing faces from increased to win). I API dependency, fragmented marketplace, and hardware data determining the user experience. And with app store approval If you are looking to learn more about specific products and services L processes becoming more stringent, these challenges just continue showcased by EXPO exhibitors, then the EXPO Talks are designed for E to grow. Join Nikhil to learn about the recent trends in mobile you! Starting on Wednesday and ending with the EXPO Reception, app development and what they mean for testers. Gain insights these Talks are short 30-minute sessions featuring innovative product into how to roll out a robust mobile app testing framework, while demos or service presentations. You will have the chance to talk with following reusability practices that reduce testing time. exhibitor representatives and have your questions answered away from the busy EXPO booths. The EXPO Talks are a convenient one-stop-shop to learn the latest about products and services.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE WEDNESDAY, APRIL 20 - PRESENTATIONS 35 11:15 AM - 12:15 PM

What Time is It Over There? Maximizing the Effectiveness of Your Global QA Team Risk Based Testing at the Enterprise Level Elizabeth Wisdom, Ulta Beauty Bernd Bornhausen, Banque Nationale du Canada

Cheaper! Faster! Smarter! These 3 words are what a QA team The test organization of an enterprise has unlimited resources at its L leader hears almost every day. Many organizations today recognize disposal in order to test all applications used by this enterprise. This E that a globally distributed QA model will achieve some of those is the dream world of QA organizations around the globe. In reality A objectives, but it comes with some challenges! there is no such thing as unlimited resources for any given QA or- D ganization as it is true for all organizations within an enterprise. The Create a global QA team that can effectively engage and R enterprise, thus the QA organization, has to prioritize its resources E collaborate with each other as well as with with project stakeholders in order to maximize the benefits of the invested effort. In order to R operationally with maximum effectiveness and efficiency. Set I do so we need to apply a prioritization method to identify the ap- S the correct expectations and assumptions with a global resource S plications the most critical as these will be the ones the most effort H team model. Build trust within the team and create effective K should be spend on. Risk based testing at the enterprise level tries communication channels and daily reporting to help the QA team exactly that and gives the QA organization the method to utilize its I act as a cohesive team without boundaries. Join Elizabeth to get resources where they are needed. P your global team to the highest level.

Budgeting, Estimation, Planning, #NoEstimates and the Agile Planning Onion” How to Tackle Open Source Test Automation in Incredible Ways Tom Cagley, DCG Software Value Harpreat Singh and Piyush Sachar, Microexcel Observed from the outside, the idea of estimation might seem like a foreign concept when applied to Agile testing. However, O Open Source Tools for Test Automation has been crowded with agile practitioners implement many levels of estimation, including many options in the last few years. The presence of so many budgeting, high-level estimation and task planning (detailed P tools and the various ways of using them makes the choice of tool A estimation). We can link a more classic view of estimation to E difficult for stakeholders and all the supporting tools has made the choice harder. Mobile Automation has now been added to the G the Agile planning onion popularized by Mike Cohn. In the Agile N planning onion, strategic planning is on the outside of the onion and mix. This session introduces open source tools along with their I the planning that occurs in the daily sprint meetings is at the core supporting tools to give a perspective in the wide world of “Open L of the onion. Each layer closer to the core relates more to the day- S Source Test Automation” along with the strategies and mindsets E to-day activity of a team. The #NoEstimates movement eschews O behind them. Join Harpreat and Piyush to make a success of your developing story- or task-level estimates and sometimes higher U Test Automation initiative. Find out the strategies to use to serve levels of estimation. As you get closer to the core of the planning R development models like Agile, TDD and BDD. Learn about open onion the case for #NoEstimates becomes more compelling and, source mobile test automation tools like Appium which are using dare I say, useful. A case study will be used to focus on how an C similar API’s to Selenium. organization that tests both within the Agile teams and through an E independent testing group has implemented estimates for Agile testing activities.

Faster and Better Mobile Testing in the Cloud

Jamie Moore, Mobile Labs

Developers and QA professionals face tough challenges managing Lunchtime Reminders mobile devices. Existing tools can force you to tie devices to a single machine. Then you have to pass them around physically when it’s time to share or collaborate. This diminishes team agility M Wednesday and Thursday of the QUEST Conference features Special and DevOps efficiency in mobility and impacts test coverage. Find Interest Roundtables during lunch, which encourages attendees O out what makes mobile so different than other types of testing in to connect over specific topics of interest. As you enter the general B environments and processes. Recapture lost efficiencies using the session room for lunch, certain tables will have signage indicating that I correct strategy. Use a Private Device Cloud to build and manage it is reserved for roundtable discussions for that particular subject. your device inventory. Automate your mobile application test cases Connect over similar interests and discuss your issues with your peers. L in order to take full advantage of test automation ROI and include E your mobile application testing process within DevOps. Join Jamie Also remember to confirm with QAI staff members whether you plan to make use of the Cloud and other efficiencies for faster and better on attending the Evening Event in Chicago. mobile testing.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 36 WEDNESDAY, APRIL 20 - WORKSHOPS 1:30 PM - 3:00 PM

ZAP, You’re QA Team Leader! How to Build a High Performance Team Mobile Testing: To Automate or Not to Automate? Rebecca Staton-Reinstein, Advantage Leadership David Dang, Zenergy Technologies

All too many QA managers begin their tenure with no previous Companies are moving into mobile technology at a rapid pace, which managerial experience or training. One day you’re a highly competent has significantly increased the need for manual testing in that area. technical person and the next day you’re in charge of at least one Companies are turning to automation to help ease the workload but it L other person and are at a loss. To make things worse, you’re often is not always obvious what should be automated. Mobile has its own E told to continue all your technical work while you “manage” your team. set of complications, compounded by a huge variety of devices and Unfortunately, this “tradition” is alive and well and the poor results M OS platforms. This presentation helps attendees learn what mobile A have been documented for decades. O testing activities are ripe for automation as well as those items best D left to manual efforts. In particular David will consider whether to You choose to break this pattern. You learn the basic skills of great B automate Mobile Web; Native Applications and Hybrid Applications. At E management and use them to build a strong, high performing team. I the device level we will consider orientation (Portrait vs. landscape), R Whatever your official title is or the size of your team, some basic facts pinching and zooming, calling feature and SMS. Types of testing will apply because we are all dealing with human nature. You can hone L cover User Experience, Functionality, and Business Process Flow and S your leadership skills and apply practical solutions to get the robust E Data. Lastly we will consider some available tools. H results your management requires. These are basic survival – and “thrival” – skills in today’s global marketplace and “do-more-with-less” Learning Objectives: I business culture. Join Rebecca in this session to break with “tradition” • Determine automation effectiveness based on all factors P and thrive! • Calculate a targeted automation percentage for your efforts • Use a success story to motivate your mobile testing Learning Objectives: • Get results by bringing out the best in people • Apply management approaches with proven effectiveness • Avoid classic mistakes technical team leaders can make

Deconstructing SAFe – the Scales Agile Framework Making the Case for Collaborative Test Case in a Nutshell Development

Angela Dugan, Polaris Solutions Todd Peak & Mike Lipps, Seapine Software

With so many software delivery process frameworks and Collaboration between quality analysts and developers enriches methodologies out there, it’s hard to know where to begin. And just software’s quality in ways that increase its value to the end user and when the industry seems to be warming up to agile, here comes P helps ship the release! Poor or non-existent collaboration between SCALED agile with frameworks like SAFe, LESS, and a host of L these departments bogs down development efforts, resulting in others. Should we all just be SAFe? But then maybe SAFe is just a delays, blown budgets, and buggy releases. Throwing new builds glorified waterfall process for companies that “can’t handle real Agile”. A A “over the wall” is inefficient and can create a counter-productive SAFe, the Scaled Agile Framework, leverages the best of several N “us vs. them” mentality between QA and developers. Creating test G well-established frameworks, including Lean, Kanban, and scrum. cases independently has unmistakable merit, but stopping there does While SAFe is certainly intended for large, enterprise organizations / I the software a disservice. Quality analysts and developers working delivering extremely complex and interdependent systems, many D together create better test cases, a better work environment, and L SAFe principles and practices can be used to improve much smaller better software. Each team brings important talents to the table, and teams. Join Angela in this workshop to gain a better understanding of E E breaking down barriers between them through collaboration and the SAFe, and how teams can adopt SAFe principles and practices to S knowledge sharing uncovers potential issues before they occur, improve the development, testing, and delivery of products. increases testing coverage, and fosters an appreciation for each I other’s contributions. Technology was intended to make our lives Learning Objectives: easier—but collaboration can make making technology easier. • Get an overview of SAFe processes, roles, and terminology G • Take a SAFe approach to large scaled software delivery and learn N Learning Objectives: best practices for both large and small teams • Learn how collaboration leads to better software • Procure all of the resources you need to do this • Determine the most valuable service each group can provide • Leverage the groups to make your life easier One-on-One Coaching Sessions Getting Started with Jmeter! Daniel Schiff, edo Interactive

Have you ever heard an interesting idea or solution in a conference O Get performance statistics on your web page and automate a web page presentation and would have liked to discuss it further with the functional test at that same time. Get introduced to test automation P and obtaining performance metrics with JMeter, a popular, free, open speaker? But, when you tried to talk to the speaker immediately at the source competitor to HP LoadRunner. JMeter is one of the most popular end of the presentation, you found that the conference schedule just E web performance and functional testing tools available. Together, we didn’t allow enough time? N will walk through obtaining performance statistics on a web page and complete a functional test or two. The demonstrations will provide Included with the QUEST conference experience is the opportunity for the basics and the foundation to build your own tests. Attendees are you to meet one-on-one with conference speakers or the professional S encouraged to bring their laptops if possible, and it will be helpful (but QAI instructors in an informal setting to discuss how to turn ideas into O not required) to download and install Java and Apache JMeter prior solutions that address your specific needs. to the workshop. A useful preparation for this session is: http://jmeter. U apache.org/usermanual/best-practices.html Speakers will be available for free coaching sessions on the day of their R conference presentation. Sign-up sheets with available speakers and Learning Objectives: times will be posted at the conference on Wednesday, Thursday and C • Learn how to write extensible tests • Use JMeter for functional API tests as well as load tests Friday. Sign-up at the conference is required to reserve your coaching E • Connect JMeter to a scheduler for great smoke tests and regression session. tests

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE WEDNESDAY, APRIL 20 - PRESENTATIONS 37 3:30 PM - 4:30 PM

Culture of Quality: Integrating QA in the SDLC The Testing Pyramid: It’s Not about Testing Helene Simmons, Lincoln Financial Group Gary Pedretti, Sodoto Solutions Jackie Wilson, Lincoln Financial Group Do you struggle with building and maintaining an automated The Culture of Quality program plays a strategic role in test suite? Do you wonder how you can work together with other implementing best practices to achieve quality excellence through P specialists in a true cross-functional agile team? Do you push all L collaboration with our IT and Business Partners. The objective L testing to the end, even though you’re using agile techniques and of a Culture of Quality Program is to support the IT Enterprise E A shorter cycles – snowplowing risk forward and compressing the test by incorporating Quality Assurance into the SDLC process cycle like we did in waterfall? A during the project stages. It will maximize performance in the N D production environment, will increase business and technical / Mike Cohn introduced the Testing Pyramid in his 2009 book, E partner satisfaction, and reduce redundancy and waste during D Succeeding with Agile, as a model for thinking about sustainable the testing cycle. This has included process improvements such R E test automation. But it also has powerful implications for analysis, as Risk-Based Testing, Entry/Exit Criteria, Metrics, Professional architecture, coding, and documentation. Building a product that S Development, and Consistency in Quality Center usage and a S is well covered by tests, in the ratios described by the Testing H common QA Terminology. Implementing a Culture of Quality will I Pyramid, requires specific thinking and approaches at both I require the support of various IT organizations as you verify and G the technical and human levels. In this talk we cover modern improve processes, standards, execution, and measurements. P N techniques and patterns that allow for all software specialists to be Our journey started in 2014-15 with the formation of workgroups guided by the Testing Pyramid to build shared, collaborative team focused on improvement. We continue to learn through environments. development of metrics. Find out how we’ve succeeded in process maturity and continued promotion of a Culture of Quality, and how we’ve impacted our QA teams and IT/Business Partners.

Using BDD and Specifications by Example in Acceptance Test Driven Development (ATDD) with Increase Software Value SpecFlow Diane Walker and Nick Hussey, Equifax Chris Taylor, Polaris Solutions

Software that works but doesn’t solve the right problem isn’t O Acceptance Test-Driven Development is a test methodology that valuable! We have a habit of focusing our attention on whether P picks up where unit testing ends and can be leveraged to make the applications are doing things right. But how do we know if our testing a collaborative effort for the entire agile team. You will application is doing something valuable? Diane and Nick share E learn the Given-When-Then nomenclature of ATDD and how it their journey to solve this and other quality issues using BDD and N can be applied to writing requirements or acceptance criteria that A Specification by Example. They use these tried and true techniques easily flow into test case development. We’ll look at the setup, G to increase the clarity of specifications for the entire software team S syntax, roles of each agile team member in making it work, and as well as their business partners. Find out how they increased also at some strategies for using SpecFlow in a project regardless I O L time for test analysis and increased test automation. They will share of testers’ technical expertise. Although SpecFlow is Microsoft’s with you how they were able to shift the entire schedule left and U implementation of Cucumber for .NET, what you will learn in this E decrease time to market. Increase the Value of your Software with R session can be applied to any other tool of your preference. Diane and Nick. C E

Mobile Test Automation and the Need for Evening Event & Bonus Session Continuous Quality Eran Kinsbruner, Perfecto Join tap|QA and your fellow attendees for a spectacular Adopting agile practices is a struggle for many mobile app private event at the Chicago House of Blues. This teams. Rapid introduction of new mobile devices and operating notoriously “cool” venue is located in historic Marina City M systems along with internal time-to-market pressure is pushing Complex, downtown along the Chicago River. You can O teams to discover the set of changes required to embed quality let loose after a day of education at Quest in one of the throughout the code-build-test cycle. While the answer sounds windy city’s premier music venues. Attendees will enjoy B simple – automate process, testing, environment provisioning and dinner and live music. I deployment – in reality this can be hard to achieve. In this session, REMINDER: Thursday morning begins with an Early Bird Perfecto’s Eran Kinsbruner will dive into automating mobile L Session at 7:45 AM - Successful Networking: Making testing. The focus will be on implementing automation that can be E the Right Connection, presented by Charlene Woolley, executed in parallel on real devices without requiring any manual Equifax (see page 32). intervention. We’ll cover the core pillars of a mobile automation framework that work as part of a continuous quality process and offer a template attendees can apply to their teams.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 38 THURSDAY, APRIL 21 - PRESENTATIONS 10:00 AM - 11:00 AM

The Art of Testing Transformation: Blending Load It UP: Effectively Combining Functional and Technology with Cutting-Edge Processes Performance Testing

Jennifer Bonine, tap|QA Chris Lawson, Zenergy Technologies

Technologies, testing processes, and the role of the tester have P Software testing usually separates performance testing, functional evolved significantly over the past several years. As testing L E test automation and manual testing procedures. Different teams professionals, it is critical that we evaluate and evolve ourselves with alternate skills and expertise perform their respective testing E to continue to add tangible value to our organizations. In your R in Silos with limited cross-team collaboration. This lengthens the A work, are you focused on the trivial or on real “game changers”? F test schedule, feedback loops and time to market. Doing multiple D Jennifer Bonine describes critical elements that, like a skilled O practices in tandem shortens testing cycle times and uncovers painter, help you artfully blend people, process, and technology E R potential defects sooner. Chris provides techniques to achieve into a masterpiece; woven together to create a synergistic optimal combined test results including conceptual framework R relationship that adds value to your organization. Jennifer shares M design patterns, common functional and load modeling techniques S ideas in the areas of mastering politics, maneuvering core versus A and a methodology for combining both and incorporating automated H context, and innovating your technology strategies and processes. N tools. Accelerate your testing using the techniques in this session. I She addresses questions on how many new processes can be introduced in an organization, what the role of organizational C P culture is in determining the success of a project, and how can E you know what tools will add value versus simply adding overhead and complexity. This discussion can lead you to technologies and processes you can stake your career on.

Agilify Your Manual Testing Through an Metrics: The Force Awakens Exploratory Approach Joseph Ours, Centric Consulting Ryan Yackel, QASymphony E “You cannot improve what you cannot measure.” That statement X Developers often have the unfortunate distinction of not thoroughly has led to a proliferation of measure and metrics gather programs P testing their code. It’s not that developers do not understand how M throughout history. In software testing, metrics are used frequently L to test well; it’s just that often they have not had an opportunity to E to inform stakeholders regarding the quality and/or progress of understand how the product works. Ryan Yackel maintains that testing in a project. Many time metrics are presented in visual O implementing a team-wide exploratory testing initiative can help A form in order to tell a compelling story – often to influence decision R build the collaboration and knowledge sharing needed to elevate all S making. That makes metrics a life force in the universe of quality I assurance. T team members to the level of product master. Exploratory testing U can be performed by anyone, but the real challenge is making sure R O Joseph discusses some common quality assurance and testing R that the process is properly managed, documented, and optimized. metrics and demonstrates how the force can be manipulated Ryan describes the techniques necessary to drive a deeper E Y M for good and evil. For those with ill intent, they will learn how to understanding of software quality and to implement an effective manipulate the metrics for their own purposes. For those pure of and impactful exploratory testing practice. Creating better software T E heart, they will learn how to see past the visual and defend against is not just about writing code more accurately and efficiently; it is N the dark arts. Join Joseph to determine the best metrics for your E about delivering value to the end user. Well-executed exploratory T needs and how to present them to make your argument. Make sure S testing helps unlock this capability across the entire development your antennae are attuned to any inaccurate stories and make sure T team. your metrics are a force for good. I N G

How to Make Test Automation SMARTER Jim Trentadue, Original Software Last Day Reminders! Test automation is not an exact science. As we drive toward an A automation solution that validates accurately, the application or data U undergoes changes, making it challenging to maintain the tests. The test automation professional must plan to make each test as Thursday will be your last chance to check out the T predictive as possible. Jim Trentadue introduces a framework called Exhibitor EXPO and EXPO Talks. Be sure to attend the O S.M.A.R.T.E.R that can be used to accomplish this. The acronym EXPO Reception at the conclusion of Thursday’s program M is defined as: Strategy for understanding application behavior and variations, Methodology for implementing the logical model, for light snacks, drinks, prize drawings, networking, and A Adaptable across different platforms or browsers, Roadmap for entertainment! T outlining the sequence and priority of those tests to address first, Friday will be the last day for Coaching Sessions. Check the I Toolbox to work with technologies available, Experienced personnel schedule or with a QAI staff member to see what topics and requirements for those to support such changes, and a Repeatable speakers will be available for the day. O design for future success. By implementing this framework, your N automation will be structured for ongoing success by making your test cases SMARTER!

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE THURSDAY, APRIL 21 - PRESENTATIONS 39 11:15 AM - 12:15 PM

Business Case for Software Testing and QA How to Fit Performance Testing into Agile Dev Operations Cycles Bernd Haber, Accenture Steve Weisfeldt, Neotys

L Too often companies try to ‘test-in’ quality at the end of the devel- P Agile development methodologies have many benefits like E opment life cycle rather than shifting quality left. The holistic view of E increasing visibility into a project’s progress and keeping A Quality is ignored. The Application Testing Services Blueprint Re- R requirements fluid enough to respond to what customers want D port published by HfS Research Ltd. in August of 2015 states under F today — not what they wanted two years ago. However, many ‘Trends in Application Testing’ that “the testing community has to Agile (or Agile-ish) teams struggle with determining which testing E overcome its focus on tools and technology [and] it has to speak O practices to keep, which ones to automate, and which ones to stop R the language of C-level executives and work around the strategic R doing all together. Performance testing is no exception. Creating S business imperatives.” In this talk Bernd shows how to create a M a performance testing plan that fits into your development process H compelling and convincing test service business case. Assume you A is easier than you might think. Join Steve to learn when to do only have 15 minutes to talk to the CIO, SVP or VP of IT to make continuous performance testing and when to fit load testing into I your case. Join Bernd to make your case for your future! N your sprints. One size does not fit all! Steve will present you with P C practical tips for sizing tests to match your needs. E

Creating Useful Metrics to Provide Quality Software Tips For Maintaining Testing Integrity Helene Astier, Cars.com Carolyn Swadron, CIBC M Requests to complete testing faster than planned in order to meet E Metrics are the key to quality software but they must be useful, applicable and span the entire Software Development Life Cycle. a project deadline are increasingly common. Shortening testing to A meet a mandated schedule can threaten the integrity of testing results Metrics are categorized in three ways – people, process, and P S and conclusions. This session describes boundaries that testing technology. People metrics are used to monitor teams, to plan R U teams, and to measure team productivity. Process metrics evaluate team leads and managers need to establish in order to ensure that O their certification results are accurate, meaningful and valuable to the R the health of products, the day to day operations and enforcement of new practices. Technology metrics assess the impact of new C project and its stakeholders. It addresses approaches for resisting E pressures to give in to demands that negate the value of testing, and technology and measure QA automation. Making metrics actionable E M provides guidelines for negotiating solutions that are acceptable to all is the key to a successful program, quality software and process S E improvement. This presentation provides the What to measure; the parties. These include the need for proactive replanning as project S scope, knowledge and circumstances change, and identifying the N Why to measure and the How to measure. It also shows how to benchmark effectively, spot trends over time, interpret the results best people for preparing and executing testing based on application T and convey the information back to the stakeholders. requirements, required testing deliverables and test results. The session includes the opportunity to ask the group how to resolve personal testing challenges.

Don’t Be Another Statistic! Develop an Automation Strategy for Long-Term Success Lee Barnes, Utopia Solutions

Choosing the appropriate tool and building the right framework are typically thought of as the main challenges to successful A test automation. However, even after careful tool selection and Lunchtime Reminders U advanced automation framework construction, long-term success proves elusive to many. Lee Barnes discusses the key strategy T components that must be in place to avoid becoming another test O automation statistic. Learn the importance of, and techniques for, Thursday lunch is another opportunity to participate in M assessing your organization’s readiness for test automation in the Special Interest Roundtables. Join fellow attendees A foundational areas including test objectives, organizational structure, for a discussion on hot topics relevant to the everyday process integration, environment and resources/skills. Once you practitioner. T understand your state of readiness, you can begin to formulate a Remember to visit the Exhibitor EXPO and have your I strategy for addressing gaps and laying the groundwork for long- EXPO Passport stamped by all the vendors before term success. Lee presents a framework for developing a solid test O the conclusion of Thursday’s program. Turn in your automation strategy that addresses automation scope, required N completed EXPO Passport to the QAI Registration desk organizational & process changes, and implementation roadmap. to receive a raffle ticket for QAI’s Grand Prize Drawing Take back a blue print for implementing successful test automation during Friday lunch (must be present to win). in a way that uniquely fits your organization, and become a positive test automation statistic!

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 40 THURSDAY, APRIL 21 - WORKSHOPS 1:30 PM - 3:00 PM

Enhancing Your Leadership Skills to Become an Effective Test Manager Real World Security Testing Michael W Ennis, TEKsystems Matt Konda, Jemurai

L In the fast paced world of software development, often times Testing for security is an increasingly important and visible part E the “smartest” or most technically savvy person is promoted to of software delivery. The classic formula for security testing isn’t A becoming a Test Manager. While your technical skills may have working and security analysis tools can’t reliably find certain basic problems. Matt introduces concrete things testing teams can do to D separated you as being a high performer, technical skills rarely transfer into becoming an effective manager. Being an effective contribute to the security of a system and identifies opportunities to E manager requires a combination of technical skills and what I term include more advanced manual testing of scenarios that are often R as soft skills. As an individual contributor, your training curriculum S overlooked. Process improvements that range from articulating S is almost always focused on increasing your knowledge and skills security acceptance criteria to checklists are discussed. In some E cases, test automation can be used to raise the security of H in the area of your technical focus but rarely are you prepared for the emotional intelligence that is required to becoming an effective C delivered software. In all cases, the villain persona and negative I leader of your team. Join Mike Ennis in this workshop and see how U testing scenarios are foundational to effective security testing. In P you can take your leadership to another level. addition to specific actionable security testing strategies, one goal R of the talk will be to provide some high level context for thinking I about security testing and how to integrate it into the software T development lifecycle effectively. Take the security of your 10 Steps to Continuous Integration, Testing and Y applications to the next level and be more confident. Delivery Learning Objectives: Tanya Kravtsov, ROKITT • Learn manual testing steps for two classes of security vulnerabilities (xss and authorization) DevOps is based on continuous delivery and anything that breaks • Identify where and when to use automated tools for security the continuity is a bottleneck. QA often becomes that bottleneck due testing to an unstable test environment, unavailable test data and/or manual • Integrate security into the development process processes. While Agile has become a common term in Development D and Testing organizations, manual build and deployment processes are still causing problems along with integration and testing. Tanya E discusses various automation tools and techniques that can help V to address process bottlenecks and achieve a true Continuous / Integration, Testing and Delivery state. Join Tanya to learn how to The Red Bead Experiment reduce the bottleneck that is QA. O Mike Kaufman, EMC P Learning Objectives: Come watch, and participate, in this engaging, interactive and S • Identify bottlenecks/manual processes in your product development lassic experiment made famous by Dr. Deming. Learn about and testing life cycle process improvement by exploring the link between special • Learn how to use tools and techniques to implement the cause and general cause of process variation, systems analysis, • Continuous integration, test and delivery and overall quality. Learn how changing a process without really • Identify best practices in addressing data, environment and test P understanding the factors impacting the process can actually bottlenecks R degrade the process instead of improving it. Join Mike and be part O of the experiment. The White Bead Corporation is looking for Above C Average Employees for expanded production. On-the- job training Applying Design Patterns to Automated Testing provided. Earn bonuses! The White Bead Corporation is a proud E producer of shiny, perfect, white beads. We work hard to meet our S Brian Le Suer, Zeenyx Software customer’s exacting demands and won’t settle for anything less S than perfection. We need Willing Workers who are Above Average Design patterns are often used in the development of object-oriented Employees to handle this rigorous task in an inspiring environment. software. A design pattern is a description of a commonly occurring Apply within. problem along with a template for a reusable solution. Design patterns can be applied to automated testing to make tests more Learning Objectives: A reusable and easier to maintain. Brian explores the use of design • Quality is not (just) about the employee U patterns to solve common problems encountered in automated • Special cause and general cause of process variation T testing. According to the authors of ‘Design Patterns: Elements • System process evaluation and improvement O of Reusable Object-Oriented Software’, a design pattern has four basic elements: the pattern name, the problem, the solution and the M consequences of applying the pattern. Join Brian to explore how the A four basic elements of patterns can be used to reduce the level of T effort to build automated tests and reduce the costs associated with I maintaining them. O Learning Objectives: N • Use encapsulation to build general solutions instead of repeatedly writing custom solutions to common problems • Learn specific scripting techniques that will translate to any scripting language and take home samples • Save time and costs in test maintenance by building reusable solutions to common problems in automated testing

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE THURSDAY, APRIL 21 - PRESENTATIONS 41 3:30 PM - 4:30 PM

Security Testing Scripts for the Non-Hacker: Polyskilling Testers: Good, Bad or Ugly? Straight from the Security Pro’s Handbook!

Matthew Eakin, Centric Consulting Glenn Stout, HALOCK Security Labs

L Agile demands much more of the tester. Testers are now asked Do you feel unsure about web application security? Are you not an to be much more technical. They have to test database changes, E S expert but still responsible for application security? This session web services, and integration with other systems. On top of that will arm the participant with a guide to test web applications testers have to automate our test scripts as fast as they are being A E for common security threats that can be tested without a deep written. But is this change a good thing? Are testers becoming D C knowledge of “hacker” type tools. A usable takeaway checklist better testers? Are products becoming “better” or “more solid”? In E this session Mr. Eakin will examine polyskilling and the Dunning- U with test scripts that the non-hacker can use to give applications R Kruger Effect from a testing point of view and try to explain how it R a good security review is provided. “Hacker-esque” tools to do some additional security testing are identified and demonstrated. S can destroy teams if applied incorrectly and make them stronger if I applied correctly. Join Glenn and become an ‘ethical’ hacker of your own web H T applications. I Y P

Testing Deliverables: Define, Align, Document DevOps: A Testers Best Friend and Approve

Thomas Janik and Ken Robertson, American Family Clareice Chaney, MITRE and Clyneice Chaney, Quality Insurance Squared

Have you ever asked yourself how DevOps could succeed in a D Deliverables are outcomes and often tangible representations company that has an existing set of testing processes, deployment E in determining the success of a project. Deliverables must be practices, multiple segregated environments, and silo teams? Is L identified, specified, designed, scheduled, produced, tested, D it possible to take autonomous teams and bring them together accepted and implemented. With the rising cost of testing and to increase efficiencies within the deployment pipeline in a large I E the increased need for and the pace of software development company that’s ingrained with “we’ve always done it this way”? We V and testing—let’s look at testing deliverables, both project and V asked these same questions at American Family Insurance. What E product, and identify methodologies for identifying, aligning and / we discovered was that by uniting certain teams, re-evaluating documenting them. The focus of this session is to look at identifying the tools we used, streamlining processes, and integrating our R O and aligning test deliverables with outcomes; determine the environments, we could evolve into a DevOps culture that offered A impact of the use of Waterfall and Agile software development P our developers continuous integration and our testers expediently B methodologies on test deliverables; and clarify why clearly S deployed code in stable environments, all seamlessly integrated. defining and documenting deliverables is a critical component Join us as we discuss the before, the, after, and the step-by-step L to demonstrating progress so that your customers, internal and process American Family took to evolve toward planned production E external, can achieve their desired outcomes. maintenance releases, an automated deployment pipeline, standardized smoke tests, rapid deployment of defect fixes for S retesting, and stable testing environments to facilitate better functional and integrated testing processes.

Keyword Driven Testing with Selenium: The Good, the Bad and the Use Case

Brian Van Stone, QualiTest Group EXPO Reception & Evaluations

Keyword Driven Testing (KDT) is a design pattern that enables A test automation to be designed around business logic and which At the conclusion of Thursday’s program, stop by the U allows for non-technical business users to be more directly Exhibitor EXPO for the EXPO Reception, sponsored T involved in the process of test automation. It can also reduce the cost of test automation maintenance. Many organizations have by all our exhibitors participating in the QUEST 2016 O shied away from the prospect of developing a full featured KDT EXPO. Refreshments will be served, entertainment will be M framework around Selenium because of the enormity of the task provided, and the exhibitors will raffle off their prizes to A and instead fall victim to the maintenance nightmare that results eligible winners. from record-and-play or one-off automation scripts. In this session Tell us how we did! Remember to fill out your Overall T we will discuss the benefits, challenges and use cases of KDT Conference Evaluations, and turn them in to QAI staff I with Selenium as well as how best to address some of the largest members before lunch on Friday to enter the QAI Grand O challenges therein. We discuss how to make up for the deficiencies in Selenium and when KDT is the right solution. Prize Drawing. N

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 42 FRIDAY, APRIL 22 - PRESENTATIONS 10:00 AM - 11:00 AM

Leading Indicators of Quality: Driving the Isn’t an Enterprise Test Strategy just for an Conversation & Managing Risk Enterprise Project Release? Dana Dietz, Nationwide Susan Schanta, Cognizant Technology Solutions

Quality is not judged by defects alone. When you watch closely, T L E Have you ever heard a Project Manager refer to it as a strategy for E you can identify, monitor and act on issues long before a defect an enterprise project release? The purpose and use of an Enter- appears. If you’ve ever hoped for a more proactive approach to S prise Test Strategy exists in many organizations because there is A quality, this session is the one for you! Leading indicators of quality T not a shared understanding regarding how to drive quality through D abound if you are willing to look for and track them. In this session collaborative disciplines. The Enterprise Test Strategy provides E we’ll discuss options for getting out ahead of quality – what factors S the foundation for how the collective software team delivers quality T R might you chose to track, how you can make the indicators visible to the organization. The strategy encompasses a mission state- to those who care and how can you connect the indicators to R ment, standards for test analysis, planning and validation as well as S metrics that you already measure on your teams? You’ll leave this A expectations for interaction with cross-functional organizations. In H session prepared to jump start the quality conversation and ready T this session, Susan will explain the value proposition of having an I to track leading indicators of your own choosing. You’ll be ready E Enterprise Test Strategy, how to introduce the strategy to your or- P to tell the quality story in your organization so that associates and G ganization and how to measure against standards set. Learn how to leaders alike can understand the current state of quality and act to Y create a customized template and build a comprehensive strategy improve it. that documents a disciplined approach to quality practices.

5 Critical Elements for a Successful Test Data Regression Test Management Using a User Management Program Interface – CARTTS Tool

Robert Kelman, AT&T Mani Rajappa, GSI Health

The Effectiveness of a Test Data Management program can Change requests originating from both clients and internal R T determine success or failure of any enterprise testing effort. departments create a need for regression testing. Regression However, implementing a successful Test Data Management E testing for every change is challenging based on the sheer amount E program can be technically challenging and costly. This G of changes and deployment timing. In this session, we illustrate the S presentation highlights the critical components which the DIRECTV R solution to ensure regression test cases are successfully executed T Software QA Team (now part of the AT&T family) has implemented for enhancements, patches, configuration changes or code to ensure testing success. Join Robb as he walks through the E changes using the CARTTS (Coordinator Application Regression evolution of DIRECTV’s current Test Data Management program. S Testing Test Suite) Tool. The CARTTS Tool is a custom user D Learn the five critical components of the program, which makes S interface designed to execute regression test cases by downloading A the testing effective and will allow DIRECTV to move into the future I tests from a list. Using the CARTTS tool, regression tests can be T and create additional opportunities. This includes a centralized run by the infrastructure team, the development team and client O A team, automation, refresh process, Use Case categorization and teams. This helps to ensure the reusability of tests created by experimentation. N the QA team. Learn the capabilities of the CARTTS tool, how this custom UI tool was built, and the value that it is providing.

11:15 AM - 12:15 PM

Efficiency and Effectiveness: When Process and Data, Data Everywhere! Understand Your Data & Pressure Collide Maximize Test Coverage Frank Rios and Rich Valde, HERE Jessica Paddock, Orasi Software

Imagine having a defined process so important that not following Measuring your test cases against the most appropriate conditions it means the potential destruction of a priceless and irreplaceable to ensure that all of your requirements are tested is critical. The L item. So why would any rational, well-intentioned person T testing process needs to provide the best coverage possible to E deliberately choose not to follow the process? Better yet, why E improve quality. Data coverage analysis is critical in identifying what would three intelligent, rational, well-intentioned people choose A data is required to ensure that faults related to code interaction not to follow the process? Prepare for a shocking, real-world case S D are discovered during the test phases and not in production. This study where we discuss this exact scenario, the potential causes of T session focuses on the issues and risks of poor data coverage. E pressure these three people felt, and the dangerous environment The process of Test Data Management (TDM) must be broken R where it was not safe to speak up. Further, we will use this scenario D down into a cycle of phases, which follow the environment setup. to highlight the impact of focusing on efficiency over effectiveness. S These phases are; Data analysis, Data pools creation, Data pools All three people knew the process, but the pressure they felt from A H validation, Data delivery, and Continuous improvement. Join management to be efficient in fixing the problem, caused them to T Jessica to learn how to use TDM tools to measure and improve I solve it ineffectively. Don’t be like this company. Learn to recognize A data coverage and provide a better quality product. P the real root-cause and take action to correct it, before it causes permanent damage to an irreplaceable artifact.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE FRIDAY, APRIL 22 - PRESENTATIONS 43 11:15 AM - 12:15 PM

Building ‘Quality Software’ with Continuous Integration & Continuous Testing The Cloud’s Impact on Testing

Ashish Nirgudkar,Cognizant Technology Solutions Tom Chavez, SOASTA C O Highly integrated application environments prevalent in Cloud computing, now almost ten years old, continues to grow at N Telecommunications and Financial industries result in many a rapid pace, and it seems that everything is moving to the cloud. T dependencies and challenges for agile teams. This causes Cloud services are replacing what used to be done on desktops, in I prolonged integration and regression testing phases, and no labs, and data centers. What is the impact of the cloud on testing? N improvement in time to market or quality. As business and C Can the cloud make testing better? The cloud enables building U technology leaders push for continuous delivery, the testing team solutions that scale larger and faster than before where adding O needs to partner with the development team in building the ‘right L capacity in data centers took weeks to months. Now applications U software’. Ashish shares his experience of implementing continuous O can be deployed to cloud servers in not hours but minutes. As S testing across multiple environments with ‘early automation’, ‘early U the cloud enables increases in app deliveries, it also enables new services that increase testing efficiency and quality while T performance testing’ and even ‘early User Acceptance Testing’. He D explains the core principles of continuous integration/continuous decreasing total testing time. Tom will discuss the migration of E applications to the cloud and the new tools and services that enable S delivery pipeline, continuous testing and ongoing quality feedback T —and why testers also need to look at a role transformation testing to be just as agile as the new development processes. He I into ‘Quality Engineers’ and ‘Partners’ with development team. will also address some of the concerns companies have with cloud N Continuous testing is not easy. Ashish provides a learning strategy computing such as security, reproducibility, and repeatability. G to help your team’s transition from Testers to Quality Engineers so they can be partners in Agile Transformation journey. 1:30 - 2:30 PM

Panel Discussion: Achieving Cross Roles Collaboration to Build Quality Software

Nancy Kastl, Chicago Quality Assurance Association; David DeWitt, IIBA Chicagoland Chapter; Michael Marchi, APLN Chicago; P Aisleigh McGann, PMI Chicagoland; Christopher Jones, IEEE Chicago Section A N Today’s software development teams are comprised of specialists, each playing a specific role based on skills and responsibilities. Project E managers are responsible for managing projects. Scrum masters guide Agile teams. Business analysts focus on analyzing business L requirements. Developers code the software, and QA/testers test the software. Many of these roles are defined by a body of knowledge (BOK), have certifications, and/or professional communities for continuous learning. Whether a software development project is agile, iterative or D waterfall, the project’s ultimate success is based on collaboration and an emphasis on building quality into the software instead of testing in quality I at the end. Our panelists, representing each of the roles within a software project and are leaders within their respective professions. Come join S them as they breakdown role-based silos and share insights to collaboratively building quality software. C U • How does each role define quality software? What are the similarities and differences in these perspectives? S • How does each role’s Certification Body of Knowledge support building quality software? S • What challenges does each role face within a project team? How can collaboration overcome these challenges in waterfall, iterative or agile? I • What are the pros and cons of specialized roles vs. project team members interchangeable in their roles? O • How can application lifecycle management (ALM) tools foster cross role collaboration? N • How can other roles help testers ‘shift left’ within a project?

Harmonizing Business and Technology Needs Using Next Generation Testing

Kimberly Tatum, Deloitte Consulting

Operating a Testing Center of Excellence (TCoE) in an environment with increasing demand (50+ concurrent projects) and complexity (700+ applications) is exceedingly challenging. Some challenges include managing budgets when projects are running concurrently; balancing workload across projects based on skillset; improving test coverage when there is limited access to subject matter expertise; and reducing repeated tasks; T and understanding test progress in business terms. Join Kimberly to find out her solutions to the above challenges which included: holistic test C planning that indicates Project health at all times; optimal demand management; Intention Driven Testing; using past performance to improve test O coverage for the future; and creating visibility into testing progress through standardized and effective communication in business terms. Create E successful Go-Live experiences free of critical defects. Learning Objectives: • Leverage the existing test repository through Intention Driven Testing • Implement optimal demand management across concurrent projects and reduce costs • Create visibility into testing progress through standardized and effective communication in business terms

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 44 FRIDAY, APRIL 22 - ROUNDTABLE DISCUSSIONS 2:30 - 3:00 PM

Shift Left through Tester – Shift Left through Tester – Project Manager Collaboration Business Analyst Collaboration Aisleigh McGann, PMI Chicagoland David DeWitt, IIBA Chicagoland Chapter

A Testers can shift left to be involved earlier in software A Testers can shift left to be actively involved in requirements L L M development projects, if the overall project plan includes M definition or user stories creation instead of waiting for testing activities early in the project instead of at the requirements/user stories to be finalized and ‘turned over’ C C O end of the project. Project estimates must also include O for testing. QA/testers can provide valuable insight to L adequate time for testers to be actively engaged throughout L whether or not the requirements/user stories are complete L L A the project. Join this discussion following the panel on A and testable. They can also suggest exception scenarios B B outside of the ‘happy path’. Join this discussion following O ‘Achieving Cross Roles Collaboration to Build Quality O R Software’ to define innovative ways to work with project R the panel on ‘Achieving Cross Roles Collaboration to Build A A T managers in shifting testing left in projects. T Quality Software’ to define innovative ways for business I I analysts and QA/testers to work together during business O O N N analysis activities to shift testing left in projects.

DCG Ad_PRINT.pdf 1 1/4/16 2:45 PM

OUR QA/TESTING SERVICES

Managed Services POC Services C

Test Evaluation/ Assessment Services Y

ERP Testing - SAP & Oracle CM

Test Automation CY

Performance Testing CMY

K Mobile Testing Open Source Test Automation

P: 201-866-6789 | [email protected] | www.microexcel.com

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE FRIDAY, APRIL 22 - ROUNDTABLE DISCUSSIONS 45 2:30 - 3:00 PM

Shift Left through Tester – Shift Left through Tester – Developer Collaboration Scrum Master Collaboration Christopher Jones, IEEE Chicago Section Michael Marchi, Agile Professional Learning Network- Chicago The traditional wall between developers and testers is A A Agile holds the promise of testers shifting left in software L counterproductive to building quality software. Bugs found L M by QA/testers need to be addressed by developers as soon M development through involvement in sprint planning, daily stand-up meeting, application demos, retrospectives, C as possible, while the code for the function/user story is still C O top-of-mind for the developer. Challenges in reproducing O etc. However in some agile teams, the developers are L L L bugs, receiving false bugs, or insignificant bugs do not L agile while testing is still performed in a waterfall manner. A foster a value-added working relationship between testers A Builds are delivered to testers the last couple of days B B O and developers. Join this discussion following the panel O within a two week sprint when there is not enough time to R R complete testing within the sprint, so testing lags behind. A on ‘Achieving Cross Roles Collaboration to Build Quality A T Software’ to define innovative ways for developers and QA/ T Join this discussion following the panel on ‘Achieving Cross I I to define O testers to work side-by-side during development activities to O Roles Collaboration to Build Quality Software’ N shift testing left in projects. N innovative ways for QA/testers to work with Scrum Masters in transforming testing to be fully integrated within sprints to prevent Scrumfall while shifting testing left in agile projects.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE Realize your potential. Instructor-led courses bring the experts to you with a full year of educational opportunities!

Experienced instructors with subject matter expertise offer a full year’s worth of public training courses at popular locations across the United States and Canada. QAI Global Institute has trained over 140,000 professionals in software quality management, project management, agile method testing, test automation, estimation, software reviews, and more. Find the right training for you and your team! 2016 Training Courses

Facilitated courses are available for all levels – from the top-rated Manager’s Solutions Workshop to the Essentials of Software Testing. Learn more about each of the following courses, including dates, locations, and instructors online at www.qaiUSA.com. ■■ Agile Test Strategies and Management ■■ Essentials of Software Testing ■■ Boot Camp for Business Analysts ■■ Metrics for Managing and Improving Testing ■■ Writing Testable Requirements ■■ Requirements Based Testing Techniques: Modeling and Use ■■ CMST Exam Study Workshop Cases ■■ CSTE Exam Study Course ■■ Selecting and Executing the Most Critical Tests ■■ Manager’s Solutions Workshop ■■ Testing Mobile Applications ■■ Effective Project Management for Leaders ■■ Security Testing for the Web and How to Automate It ■■ Boot Camp for Software Quality Web Testing Techniques

■■ Test Automation for Managers Find the training opportunities nearest you, or plan a trip to some ■■ Effective Methods of Software Testing - Test Planning of the world’s most popular destinations! For course detail, visit and Design www.qaiUSA.com. ■■ Essentials of Leadership in Software Testing

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 2016 SPONSORS, EXHIBITORS AND SUPPORTERS 47

Accenture Gold Sponsor | www.accenture.com Accenture is a global management consulting, technology services and outsourcing company, with more than 358,000 people serving clients in more than 120 countries. Accenture offers the entire breadth and depth of testing services across a broad array of applications, digital technologies and industries delivered under flexible business arrangements to help companies shape their digital future and lead their industry while delivering an exceptional customer experience. With more than 31,000 testing professionals across more than 30 delivery centers in 17 countries, Accenture serves over 1,000 testing clients across more than 40 industries. Sponsoring Breakfast.

Checkpoint Technologies Gold Sponsor and Exhibitor | www.checkpointech.com Checkpoint Technologies, Inc. is a solutions provider that specializes in Business Technology Optimization. We are experts in all areas of quality assurance and software testing – performance, functional, and security. Checkpoint Technologies provides leading-edge software solutions, training, mentoring, senior consulting, and staff augmentation. Our services include both manual and automated testing with automated testing being an area in which we are known for our expertise. Checkpoint Technologies is an HP Business Partner and Certified Training Partner. We have assisted numerous organizations with their implementation of testing solutions with on-site consulting, staff augmentation, and training. Sponsoring pens.

CompuGain Solutions Bronze Sponsor and Exhibitor | www.compugain.com CompuGain Solutions is your trusted product-engineering firm. As a Microsoft Gold Partner, we have over a decade of experience in legacy modernization, infrastructure virtualization, and cloud migration. Over time we have mastered one simple paradigm: learn, engage, deliver. Through this process we are able to continually match the needs of our clients with quality delivery. Our expertise lies in four main areas: Cloud Engineering, Application Development, Data Services, and Testing Services. CompuGain Solutions is strategically headquartered in the Washington DC Metropolitan area. Sponsoring Friday morning coffee break.

The Chicago Quality Assurance Association Supporter and Exhibitor | www.cqaa.org The Chicago Quality Assurance Association was established in 1984 and is the second oldest chapter of the QAI Global Institute. CQAA promotes software quality principles and practices within the Chicagoland area by providing a forum for networking and information sharing. CQAA offers monthly speaker programs, lunch & learns, webinars, and training classes a to over 1500 members for continuing education. Professional certification is supported by hosting the CSQA and CSTE certification prep classes in Chicago and facilitating local study groups. Other activities have included one-day vendor showcases and symposiums, special interest groups for information exchange, co-hosting programs with other professional organizations, and job search service.

DCG Software Value Bronze Sponsor | www.dsoftwarevalue.com David Consulting Group (DCG) helps its clients make software value visible. DCG is a global provider of software analytics, software quality management and Agile development and measurement solutions. We enable companies to understand and communicate the value of their software development initiatives in terms of the greater goals of the business. Since 1994, large enterprises, growing mid-cap companies and emerging technology leaders have relied on DCG to address immediate and long-term software development issues, delivering key improvements that have a lasting impact on the bottom line. DCG maintains corporate offices in the U.S. and Europe. Sponsoring Thursday afternoon coffee break.

Deloitte Consulting Silver Sponsor and Exhibitor | www.deloitte.com Deloitte’s Testing Practice is uniquely positioned to utilize our very strong industry knowledge coupled with global delivery capabilities to offer a solution that enables building quality across the life cycle. Whether it’s a large critical implementation or an Enterprise Testing CoE, we offer end-to-end functional testing services along with specialized services such as test data management, testing tool management, mobile, performance, automation, SOA and service virtualization. Sponsoring Bags.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 48 2016 SPONSORS, EXHIBITORS AND SUPPORTERS

Hexaware Technologies Platinum Sponsor and Exhibitor | www.hexaware.com/digital-assurance.htm Hexaware’s Digital Assurance practice enables enterprises to be digital disruptors in their market place. In addition to providing end-to-end quality assurance services for modern and legacy enterprise systems, we have specific offerings to cover the digital dimension of a business assuring the multifaceted testing needs of a Digital transformation across Digital ecosystem which includes cloud, mobility, big data and connected devices. More than 100 enterprises worldwide trust Hexaware’s end-to-end QA for sustained, predictable quality of their products/applications. We deliver significant value by ensuring customer delight through significantly lower cost of quality, agility in delivery, secure applications and an excellent end user experience across multi-channel platforms. Sponsoring QUEST Magazine.

IEEE Chicago Section Supporter and Exhibitor | www.ieeechicago.org IEEE Chicago Section serves electrical engineers and computer related professionals in the Chicago Metropolitan Area. It is an active professional network of over 5000 local technology practitioners, innovators, business leaders, educators and students. It is part of the world’s largest professional association (www.ieee.org) dedicated to advancing technological innovation via publications, conferences, standards, and professional and educational activities.

IIBA Chicagoland Chapter Supporter and Exhibitor | www.chicago.iiba.org The Chicagoland Chapter of the International Institute of Business Analysis (IIBA®) works to build awareness of the business analyst profession and to promote the ongoing development of individual practitioners. With the changing face of today’s business organizations and IT departments, the Business Analyst (BA) performs a role crucial to the success of the dynamic business cycle of planning, implementing, and managing change within companies of all sizes and in every industry. Our meetings are conducted 9 months of the year on the first Wednesday evening of the month at a variety of sites around the Chicagoland area.

Microexcel Bronze Sponsor and Exhibitor | www.microexcel.com Microexcel provides end-to-end QA services in ERP, Product and Web Application testing segments across various domain, technologies and database leveraging their proven experience and expertise in functional and non-functional testing. Their perennial focus is in delivering “Test Consulting” services that include ” Testing Evaluation Services”, “Customized Test Lifecycle Process”, “Test Automation Roadmap”, “Designing & Maintaining Regression Test Suite” and measuring performance parameters. They have experience in setting-up, operating and managing Testing Centers of Excellence (TCoE). As a part of Managed Testing Services they have dedicated QA Group which help’s customer’s formulate and establish a set of standardized QA processes. Microexcel offers various automated test solutions for mobile, web and Continuous integration builds with custom frameworks and industry best practices. Sponsoring Wednesday morning coffee break.

Mobile Labs Bronze Sponsor and Exhibitor | www.mobilelabsinc.com Mobile Labs is a leading provider and innovator of cross-platform mobile application testing solutions. Its private, internal device cloud, deviceConnect™, delivers comprehensive management capabilities for mobile devices, apps, and users in corporate test labs. deviceConnect fully supports manual testing and in conjunction with Mobile Labs Trust™ provides effective and efficient automated mobile application testing. All without jailbreaking or rooting smartphones or tablets. Sponsoring the Thursday morning coffee break.

Morningstar Supporter | www.morningstar.com Morningstar, Inc. is a leading provider of independent investment research in North America, Europe, Australia, and Asia. We offer an extensive line of products and services for individual investors, financial advisors, asset managers, and retirement plan providers and sponsors. Morningstar provides data on more than 500,000 investment offerings, including stocks, mutual funds, and similar vehicles, along with real-time global market data on more than 17 million equities, indexes, futures, options, commodities, and precious metals, in addition to foreign exchange and Treasury markets. Morningstar also offers investment management services through its investment advisory subsidiaries, with more than $170 billion in assets under advisement or management as of Sept. 30, 2015. We have operations in 27 countries.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 2016 SPONSORS, EXHIBITORS AND SUPPORTERS 49

Neotys Platinum Sponsor and Exhibitor | www.neotys.com Neotys is the leading innovator in Continuous Performance Validation for Web and Mobile applications. Neotys load testing (NeoLoad) and performance monitoring (NeoSense) enable teams to produce faster applications, deliver new features and enhancements in less time and simplify interactions across Dev, QA, Ops and business stakeholders. Neotys has helped over 1600 customers test, monitor and improve performance at every stage of the application development lifecycle, from development to production, leveraging its automated and collaborative tooling. Sponsoring Thursday Lunch.

Olenick Exhibitor | www.olenick.com Olenick is the largest US-Headquartered software quality specialist. We are experts at ensuring client success with software projects. Our service offerings include software testing and quality assurance, project management, business analysis, and other custom solutions. Founded in 1998, Olenick has over 300 consultants, four global locations, and a client base with a mix of small- to mid-sized businesses as well as Fortune 500 companies. We have deep industry expertise and offer delivery methods that include managed services and nearshore. We reduce risk, improve quality, and provide ROI for our clients.

Orasi Software Exhibitor | www.orasi.com Orasi is a leading provider of software, support, training, and consulting services. Through strategic industry partnerships, we offer market-leading test management, automated testing, application performance management/intelligence, test data management, continuous delivery/integration, and mobile testing technologies to enable our customers to focus on a complete software quality lifecycle. For more than 13 years, Orasi has helped customers successfully implement and integrate software testing environments to reduce the cost and risk of software failures.

Original Software Exhibitor | www.origsoft.com With a world class record of innovation, Original Software offers a test automation solution focused completely on the goal of effective software quality management. By embracing the full spectrum of Application Quality Management across a wide range of applications and environments, the company partners with customers and helps make software quality a business imperative. Solutions include manual testing, full test automation mobile, UAT and a software quality management platform all delivered with the control of business risk, cost, time and resources in mind.

Parasoft Exhibitor | www.parasoft.com Parasoft develops automated software quality solutions that prevent and detect risks associated with application failure. To combat the risk of software failure while accelerating the SDLC, Parasoft offers a Development Testing Platform and Continuous Testing Platform.

Perfecto Exhibitor | www.perfectomobile.com Perfecto enables exceptional digital experiences. We help you transform your business and strengthen every digital interaction with a quality-first approach to creating web and native apps, through a cloud- based test environment called the Continuous Quality Lab. The CQL is comprised of real devices and real end-user conditions, giving you the truest test environment available. More than 1,500 customers, including 50% of the Fortune 500 across the banking, insurance, retail, telecommunications and media industries rely on Perfecto to deliver optimal mobile app functionality and end user experiences, ensuring their brand’s reputation, establishing loyal customers, and continually attracting new users.

Project Management Institute (PMI) Supporter and Exhibitor | www.pmi-chicagoland.org The Project Management Institute (PMI) establishes project management standards, provides seminars, educational programs and professional certifications for project management professionals worldwide. The Chicagoland Chapter of PMI was chartered in 1977 and today has more than 4,200 members. The vision of the chapter is to be the professional association chapter of choice for project management knowledge, accreditation, development and practice. It strives to promote project management knowledge, standards and ethical practice, provide value to members, increase awareness of the importance of project management among senior management, awareness of the PMI certification process and improve communications with business and the community. CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 50 2016 SPONSORS, EXHIBITORS AND SUPPORTERS

QAI Global Institute Sponsor and Exhibitor | www.qaiusa.com Founded in 1980 in Orlando Florida, QAI is a global workforce development and consulting organization addressing the education and ‘Operational Excellence’ needs of information technology and knowledge-intensive organizations. QAI Global Institute, the workforce development division of QAI, focuses on creating education and training products and services. The Institute caters to a wide variety of industries and provides access to a wealth of concepts and skill building reinforced through consulting, training, assessments, benchmarking, certification, conferences, and eLearning. QAI has trained over 140,000 individuals and certified over 50,000 professionals.

QualiTest Exhibitor | www.qualitestgroup.com – QualiTest is the world’s second largest pure play software testing and QA company. Testing and QA is all that we do! QualiTest is pleased to have been recognized as a Visionary in Gartner’s Magic Quadrant for Application Testing Services, Worldwide for two consecutive years. We design and deliver contextualized solutions that leverage deep industry-specific understanding with technology-specific competencies and unique testing-focused assets. QualiTest produces results by combining customer-centric business models, critical thinking and the ability to gain a profound comprehension of customers’ goals and challenges.

Seapine Software Exhibitor | www.seapine.com Seapine Software, Inc. is a privately held technology company whose application lifecycle management (ALM) solutions help companies manage the process of developing high-quality complex products—often in regulated industries. Our award-winning ALM solutions drive the creation of recognized brands, life-saving medical devices, even games of the year. From a home-based startup founded in 1995, Seapine has grown into a multinational corporation with headquarters in Cincinnati, Ohio, and offices in Europe, Asia-Pacific, and Africa with over 8,500 customers worldwide.

SmartBear Software Exhibitor | www.smartbear.com As the leader in software quality tools for the connected world, SmartBear supports more than three million software professionals and over 25,000 organizations in 194 countries that use its products to build and deliver the world’s greatest applications. With today’s applications deploying on mobile, Web, desktop, Internet of Things (IoT) or even embedded computing platforms, the connected nature of these applications through public and private APIs presents a unique set of challenges for developers, testers and operations teams. SmartBear’s software quality tools assist with code review, functional and load testing, API readiness as well as performance monitoring of these modern applications.

SPR Consulting Gold Sponsor and Exhibitor | www.spr.com A trusted partner to businesses for more than 40 years, SPR Consulting builds, integrates, tests and manages technologies that drive enterprise revenue and improve operational efficiency. With its expert onshore testing team, SPR applies automated, manual, and exploratory testing methods to an array of web, mobile, and enterprise applications to increase technology usability, functionality, compatibility, accessibility, security, and performance. Testing services range from setting strategic direction and transforming testing organizations to building reusable test repositories and performing test execution as a trusted testing partner. SPR improves access to information, company-wide collaboration and helps organizations more effectively connect with their customers. Sponsoring Lanyards.

tap|QA Diamond Sponsor and Exhibitor | www.tapqa.com tap|QA is a consulting services firm 100% focused on quality. Our consultants’ wide range of experience includes Strategic Analysis, Business Analysis, Quality Assurance & Testing within a vast array of industries. We enable organizations to meet the growing demands of their business partners and customers. Our solutions include: tap|Strategy- Strategic Consulting to Optimize IT Capabilities, Technology & Organizational Structure; tap|Technology – Implementing Continuous Integration, Delivery and Deployment through Automation; tap|Lakeshore – Cost-Competitive with Offshore, but embedded Locally with your team, or at our site in Minneapolis; and tap|Consulting – Leveraging our Key Experts and Consultants for your IT & Business needs. Sponsoring the Attendee Appreciation Night, Exhibitor.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE 2016 SPONSORS, EXHIBITORS AND SUPPORTERS 51

Utopia Solutions Gold Sponsor and Exhibitor | www.utopiasolutions.com Utopia Solutions is a global quality and testing firm known for its innovative quality solutions built from over a decade of helping hundreds of companies achieve breakthrough performance. Utopia Solutions offers packaged and custom solutions, including mobile quality, performance testing, test automation, and test outsourcing. These solutions enable businesses and their IT departments to focus on achieving business outcomes rather than struggle with quality and performance barriers. Sponsoring Portfolios.

Zeenyx Software Bronze Sponsor and Exhibitor | www.zeenyx.org – Zeenyx Software, Inc. is the creator of AscentialTest, an enterprise level Test Management System that encompasses test planning, development, data management and execution for applications running on Windows, the web, java, dotNet, terminals and PowerBuilder. Our patented ‘snapshot’ technology is the core of AscentialTest. By interacting with these graphical representations of the target application, users build test steps by dragging and dropping objects in a visual test editor without recording or scripting. Re-usable steps can be combined to form a multitude of tests that are as easy to maintain as they are to create. Sponsoring Wednesday afternoon break.

Zenergy Technologies Exhibitor | www.zenergytechnologies.com – Zenergy Technologies helps its clients launch and maintain better software. Utilizing QA, test, and automation techniques that enhance software development, Zenergy tailors solutions that contribute maximum benefit with minimal disruption. Zenergy is on the forefront of test automation, both commercial and open-source toolsets, including Selenium, and creates advanced frameworks that reduce maintenance and increase scalability while ensuring a higher return on investment. Zenergy performs significant amounts of mobile testing, both manual and automated, and has a U.S. based facility with test engineers at all levels who augment clients’ own testing efforts and offshore capabilities.

CALL 866.724.6013 OR 407.363.1111 EXT 301 TO REGISTER OR WWW.QAIQUEST.ORG/2016

QAI GLOBAL INSTITUTE Digital disruption and hyper convergence are changing the business dynamics and enterprises must leverage next generation digital assurance to ensure flawless transformation and superior customer experience Hexaware’s point Are you formula for assured of digital delight: 6Digital assurance: Providing end to delivering end validation of Bi-Modal IT from digital transformation to digital maturity

Xtreme Automation: Intelligence powered automation for the complete Digital life cycle

Delight? Data quality: Make Big Data meaningful by ensuring quality of data

Security: Manage reputation and protect privacy

Performance Engineering: Ensure high performance & responsiveness across all devices

Omni-channel usability: Ensure Reach us at superior user experience across all [email protected] platforms and channels. for more details on our solutions and offerings www.hexaware.com