Importance Rating

Green Hat

iTKO Lisa
SOATest
# Pugh Concept Selection Matrix Comparison Criteria Comments

A. Functionality
LISA has a very mature offering with numerous customers
1 Supports HTTP, MQ, JMS, TIBCO, CICS (Fidelity), JDBC simulation 5 - - + using across the various technology stacks.

Supports simple (complete incoming message), complex (multiple portions of an LISA supports all of these: simple (through hash), complex
2 incoming message), and custom (pluggable Java code determines comparison 5 S - + (through standard data handlers for SOAP, XML, etc.) and
criteria) message comparisons custom (through custom data handler)

Supports simple (returns a single message), complex (returns a message based on LISA supports all of these: simple (for static responses),
3 criteria), and custom (custom Java code generates custom reply) reply messages 5 S - + complex (for responses with dynamic fields) and custom
(through custom data response handler)
Supports the use of message handlers to transform and extract data from LISA was the first product to use a common library of data
4 protocol specific messages 5 - - + handlers

5 Create responders from recording live traffic 5 - - + LISA has built-in recorders for numerous protocols
LISA recorders will automatically identify data that should be
6 Use data substitution on reply messages in responders 5 - - + substituted, and users can further customize as needed
Typically 10% of the time to custom code a stub, with all of
7 Time and complexity to create a script 3 - - + the load capabilities and dynamic nature included
8 Modeling from WSDL 1 S S S
Generally speaking this is accomplished through Service
9 Streamline test data management 3 - - + Images and "Virtual Test Data Management" approach to
service virtualization
10 Ability to debug 3 - - + Numerous built-in debugging tools
11 Event recording should be non-intrusive 5 - - + Can be active/passthrough, or passive with agent
The ability to operate multiple virtual services in parallel is
12 Time to execute/execute in parallel 4 - - + core functionality
LISA provides the ability to isolate which operations,
13 Specify which events to record for simulation (a specific service or method) 2 - - + methods are recorded, and multiple recordings can later be
merged for ease of use
Use the same UI for testing, recording, simulation instead of having to start All product capabilities are available through the LISA
14 different components 3 - - + Workstation.

15 Reusability 5 - - + Easy to re-use through modular design

Automatically create parameterized (data substitution) responders from recorded LISA recorders will automatically identify data that should be
16 events 4 - - + substituted, and users can further customize as needed

17 Support multiple platforms 5 S - S Windows, Linux, Solaris, AIX, MacOS

Proven to thousands of TPS with numerous customers
18 Scalability 5 - - + deployed in performance labs

B. Vendor/Company Considerations
19 Is simulate functionality built into the base product 1 S S S Simulation is an add-on to the Testing capabilities
Patch releases are rolled out for SEV1 defects monthly, and
20 How are patches or updates rolled out/handled? 5 S - + are available as a new install (previews of the patch release
can be made available through typical support)
21 Support: Do we have 24-hour support? 5 S S S

Bank of America Confidential 10/25/2017 Page 1

 iTKO is well recognized for world-class support and the ability
22 Support: Custom solutions/Personalized support 3 - - + to get on-source resources

C. Cost (inc. Training needs)

iTKO has fully developed training courses, experienced
23 Learning Curve with this solution 3 - - + delivery consultants and delivery partners
24 Cost of new product: (a) vendor training 3
25 Cost of new product: (b) additional product licensing costs 3
26 Cost of new product: (c) costs for consulting services that are needed 3
27 Cost of new product: (d) yearly maintenance fees. 3
28 Cost of new product (e) hardware/infrastructure 3

Sum of +'s 0 0 19
Sum of -'s 16 20 0
Sum of Sames 7 3 4
Weighted Sum of +'s 0 0 78
Weighted Sum of -'s 63 83 0
Net Total >> -63 -83 78
+ Better Alternative
- Worse Alternative
S Same Alternative

Focus on alternative with the most +'s and fewest -'s

Bank of America Confidential 10/25/2017 Page 2

 Importance Rating

Green Hat

iTKO Lisa
SOATest
# Pugh Concept Selection Matrix Comparison Criteria Comments

A. Functionality
All of the tools use the same underlying functionality for this
1 Create test scripts from WSDL, XSD 3 S S S feature.
iKTO LISA has a scheduler in addition to command line
2 Command line functionality (execute test cases and test suites) 5 S S + functionality.
Sub routines in iTKO LISA allow you to call a test as a part of
3 Ability to call test cases outside of current test suite 4 - - + a larger test suite.
iKTO LISA can generate excel spreadsheets for complicated
4 Data substitution 5 S S + WS operations
LISA Pathfinder Pro is a passive way to record transactions
5 Recording functionality 1 - - + and convert into baseline test cases
6 Simulation functionality (also called responders, stubs, virtual services) 5 - - + Mature service virtualization capability
7 Quality Center integration for test execution, defect creation, and reporting 5 S S + iTKO - Partnered with HP
iTKO- can generate reports in multiple formats, and has a
8 Reporting functionality 5 S + web based reports dashboard.
Recognized as a leader in MQ (IBM GS uses in their own
Supports HTTP, HTTPS, MQ, JMS, DB2, JDBC/ODBC, TIBCO (RV), CICS (Fidelity) - via
9 native call and by a ws call 5 - - + implementations) and TIBCO (used internally by TIBCO QA
and service consultants)
Pathfinder Pro can monitor an existing test execution and
10 Migration utility to move existing test artifacts from existing to new tool 1 - + save as a new test case
test artifacts can be imported to MKS just like application
11 Integration with MKS software 5 S - S EAR files.
12 Supports multiple sources for data substitution (Excel, Access, etc.) 5 S S + iTKO- can build data sets in individual test cases.
13 Automatically generate spreadsheet for data substitution 1 S - +
Pathfinder Pro will capture logs and make available to the
14 Integrated log capture functionality 5 - - + running test case
15 Integrated validation (SQL queries) 4 S S
16 Integrated WS-Security options 1 S S S
17 Validation with regular expressions, xPath filters, etc 5 S S S
18 User interaction with test case (to enter one or more fields on the fly) 3 S S S
19 Ability to continue on error 4 S S S
20 Ability to skip test cases 4 - - +
B. Vendor/Company Considerations
21 Is simulate functionality built into the base product 1 S S S Simulation is an add-on to the Testing capabilities
iTKO-Patch releases are rolled out for SEV1 defects monthly,
22 How are patches or updates rolled out/handled? 5 - - + and are available as a new install (previews of the patch
release can be made available through typical support)
23 Support: Do we have 24-hour support? 5 - S +
iTKO is well recognized for world-class support and the ability
24 Support: Custom solutions/Personalized support 3 - - + to get on-source resources

Bank of America Confidential 10/25/2017 Page 3

 C. Cost (inc. Training needs)
iTKO has fully developed training courses, experienced
25 Learning Curve with this solution 3 - - + delivery consultants and delivery partners
26 Cost of new product: (a) vendor training 3
27 Cost of new product: (b) additional product licensing costs 3
28 Cost of new product: (c) costs for consulting services that are needed 3
29 Cost of new product: (d) yearly maintenance fees. 3
30 Cost of new product (e) hardware/infrastructure 3
31 Overall cost to create a new script (not including the purchase cost) 1

Sum of +'s 0 0 17
Sum of -'s 11 11 0
Sum of Sames 14 11 8
Weighted Sum of +'s 0 0 67
Weighted Sum of -'s 41 41 0
Net Total >> -41 -41 67
+ Better Alternative
- Worse Alternative
S Same Alternative

Focus on alternative with the most +'s and fewest -'s

Bank of America Confidential 10/25/2017 Page 4