Presentation

www.sp-assurance.com
As presented June 9, 2014
Mobile App Testing Strategy
SOFTWARE ASSURANCE, LLC
Mobile Evolution
www.sp-assurance.com
As presented June 9, 2014
Mobile Evolution
An average consumer spends 127
minutes a day on the mobile phone

There are 4.5 times as many
mobile devices in use as there are
PCs

49% of mobile users in the US now
have smart phones and this number
is going up at a very rapid rate

Mobile Evolution
www.sp-assurance.com
As presented June 9, 2014
Mobile Ecosystem Framework
Mobile Ecosystem Framework
www.sp-assurance.com
As presented June 9, 2014
Mobile Portals Vs Native Applications
www.sp-assurance.com
As presented June 9, 2014
Agenda
What is Mobile App Testing
Why Test Mobile Apps
How to Test Mobile Apps

www.sp-assurance.com
As presented June 9, 2014
What is Mobile App Testing
QA Strategy & Planning
Test Case Management
Manual & Automated
Testing


Compatibility Testing
Functional Testing
Exploratory Testing
Security Testing
Performance Testing
Memory & Leakage
Testing
Localization Testing
Usability Testing
www.sp-assurance.com
As presented June 9, 2014
www.sp-assurance.com
Do you Bother?
As presented June 9, 2014
www.sp-assurance.com
How to Conduct the
Mobile App Testing?
Manual Automated
S
i
m
u
l
a
t
o
r

Easy to Setup
Access to wide range of simulated
devices

Not Realistic
Slow/Time Intensive
Increased Test Coverage
Excellent Functional Testing

Not Realistic
Doesnt Test User Experience
O
n
-
D
e
v
i
c
e

Realistic Testing


Expensive to Acquire/Maintain
Device Library
Increased Test Coverage
Can Test Physical Devices Worldwide

High Upfront Investment
As presented June 9, 2014
www.sp-assurance.com
iPhone/iOS:
The testing matrix is a bit simpler as there is only one device manufacturer - The
challenge is still to make sure the iPhone applications work across iOS versions.
This challenge, along with Apple's strict limitation on UDIDs, has made testing a
major hassle for developers
Android:
Is more complex in terms of its testing matrix - Each new app - and each new app
version has to function as expected on multiple device models from various
manufacturers.
Functionality on mobile devices with touch screens vs. physical keyboards.
Performance on various Android OS versions.
Approach to QA Challenges
As presented June 9, 2014
www.sp-assurance.com
Approach to QA
Test Planning and Strategy
Test Plan and Strategy
Devised custom mobile test strategy based upon the business
requirements.
Based on the requirements of the mobile application, finalized the
best applicable approach out of Full Automation, Partial
Automation or manual testing to test the mobile application and
also develop a suitable framework for the automation testing
Test strategy specifies the test approach and the best framework.
Unit and Integration Testing; Functional and System Testing;
Compatibility Testing; Network Connectivity Testing;
Performance Testing; Security Testing; UI Specifications in Cross-
mobile OS; Acceptance Testing.
As presented June 9, 2014
www.sp-assurance.com
Mobile Apps
Manual & Automated Testing
Approach Types of Testing Manual Testing Automation Testing
Devices Emulators
Standard Testing
Integration Testing No Yes No
System Testing Yes No No
Regression Testing Yes No Yes
Special Type of
Testing To Address
Specific Challenges
Compatibility
Testing
Yes No Yes
GUI Testing Yes No No

Types Of Testing
More Relevant for
enterprise Mobile
Applications
Performance Testing Yes No Yes
Security Testing Yes No Yes
Synchronization
Testing
Yes No No
As presented June 9, 2014
www.sp-assurance.com
Usability testing should happen as soon as the basic stable for the
application is ready. This is also true in order to test whether the
application UI is user-friendly or not, or whether some part/functionality
of the application is easily discoverable or not. Also, usability studies
should be done for the different types of devices, such as touch screen
devices, since the user has different experience for the same application
on these devices.
Some Key Criteria
Device specific UI guidelines
Text entry
Finger sized targets
Well organized work flow
Consistency
Call handling
Response times




Usability Testing
As presented June 9, 2014
www.sp-assurance.com
Performance testing is key criteria for the application success on the
market. It may happen that application testing is carried though wi-
fi network under which application might perform well, but it also
happens that application has the poor performance for the end-user who
are accessing site through the mobile carries. Application must be tested
with different devices + carries wise mix depending on the county and
region.

Some Key Criteria
Network
Battery
Volume
Rendering

Performance Testing
As presented June 9, 2014
www.sp-assurance.com
Compatibility Testing assures that a given application works as
intended with selected devices with different screen sizes, resolutions,
and internal hardware (memory size, processor speed, and
button/input differences).It defines the feasible compatibility
combinations of devices and interfaces for a specific testing
assignment, in concurrence with the customers requirement.
OS
Device
Screen resolution
Synchronization testing: This testing focuses on data exchange and
synchronization among different mobile devices, PDAs, and PCs using
infrared frequency and USB ports.

Compatibility Testing
As presented June 9, 2014
www.sp-assurance.com
All the tests relevant to a thick client application can be applicable to mobile
applications.

Authentication checks
Input Validation checks
Session Management checks
Encryption checks
Application checks
SQL injection checks
LDAP injection checks
XPATH injection checks

Security Testing
As presented June 9, 2014
www.sp-assurance.com
Testing Process
Ensure functionality of the site is stable Test mobile applications on
the desktop browser
Test on device emulator to get the browser/platform coverage
Test on the device itself to find the device specific bugs


As presented June 9, 2014
www.sp-assurance.com
Conclusion
Scope Definition
Device/OS selection, keeping track of ever-changing trends
Requirements Compatibility Assessment
Investment to build expertise in specific areas of expertise in Mobile space
Areas of Focus/Critical to Quality Areas
Tools and Technologies and Resources
Comprehensive Test Strategy - judicious mix of manual & automated
testing

As presented June 9, 2014
www.sp-assurance.com
Why Software Assurance
1. Near-Zero Ramp Up SPA Testers have extensive knowledge and various
Industry domain expertize.
2. Zero Cost to Clients for Devices, Tools/Emulators, Setup - SPA Mobile
Lab has key devices, iMacs/PCs and will add new devices as required. SPA
Mobile Lab has emulators installed to emulate one-off devices. Also, we
monitor devices usage and proactively add real devices as usages increases.
3. Very Experienced Team: Testers have 4 10 years testing experience
with manual, mobile testing with devices and tools, automation experience
including exposure to DeviceAnyWhere
One of the mobile solution we are testing is Confidential Mobile Apps
(Android and iPhone) and Backend Server which is integrated with many
III systems (coupon server, advertisement servers, Lottery Agency Servers,
etc.) and deals with complex State lotteries Rules. Already launched for
Texas & CA and adding all the states in US.
As presented June 9, 2014
www.sp-assurance.com
As presented June 9, 2014
www.sp-assurance.com
Contact us for Mobile App Testing
Strategy free one hour consultation!
Software Assurance, LLC
7708 Mapleridge Drive, Plano, Texas 75024, United States.
Phone No: +1 972.992.4200 x103 E-Mail ID: SPASolutionTeam@sp-assurance.com
As presented June 9, 2014