Professional Documents
Culture Documents
LearnQuest Solutions
LearnQuest provides complete education solutions for organizations that need to train their staff on the latest business skills and Information Technology tools, methodologies, and languates. With over 20 years of experience, LearnQuest provides complete education solutions for corporations and government organizations that need to train their staff on the latest business skills and information technology tools, methodologies, and languages. LearnQuest offers an extensive library of customized private and public instructor-led training. Services include custom instructor-led classroom training, Virtual Classroom Training, project mentoring, assessments, blended learning, and comprehensive reskilling/new hire boot camps. LearnQuest works with organizations to better plan, develop, administer, and deploy training to their employees
Courseware Copyright 2001 - 2013 by First Contact Software Consultants Inc. All rights reserved. All text and figures included in this publication are the exclusive property of First Contact or its licensors, and may not be copied, reproduced, or used in any way without the express permission in writing of First Contact. Information in this document is subject to change without notice and does not represent a commitment on the part of First Contact. First Contact may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give you any license to these patents except as expressly provided in any written license agreement from First Contact. This document may also contain registered trademarks, trademarks, service marks and/or trade names that are owned by their respective companies or organizations. First Contact disclaims any responsibility for specifying which companies or organizations own which marks. If you have any comments or suggestions regarding this document, please send them via e-mail to: training@firstcontactconsulting.com
130211_QC_USING
This hands-on course teaches Students how to use Quality Center to manage their testing data. Students will learn how to manage quality information to construct and organize requirements, create and execute test sets, monitor defects and use graphs and reports to track the success of a project.
Course Overview
Intended Audience
Quality assurance engineers Quality testers Project managers Developers
Course Objectives
At the end of the course, you will be able to: Define Releases and Cycles Define test requirements. Organize subjects and tests in the test plan tree. Design and create test plans. Execute manual tests Record and track test execution results. Log and manage defects Generate reports and graphs Export Data into Quality Center
II.
Application testing is a complex process. Quality Center helps you organize and manage all phases of the application testing process, including specifying testing requirements, planning tests, executing tests and tracking defects.
Quality Center offers an organized framework for testing applications before they are deployed. Because test plans evolve with new or modified application requirements, you need a central data repository for organizing and managing the testing process. Quality Center guides you through all phases of the testing process.
The Quality Center testing process includes 5 phases: Specifying Releases - Develop a release-cycle management plan. Specifying Requirements - Identify and validate the functional and performance requirements that need to be tested. Planning Tests - Plan and confirm which tests need to be performed and how these tests must be run. Running Tests - Organize test sets, schedule their execution, perform test runs and analyze the results of these runs. Tracking Defects - Add defects that were detected in the application and track how repairs are progressing.
Throughout the testing process, you can generate reports and graphs.
Specifying Requirements
After you have defined releases and cycles, you specify requirements in the Requirements module. Requirements describe in detail what needs to be tested in your application and provide the test team with the foundation on which the entire testing process is based. You can define the requirements in Quality Center by creating a requirements tree. This is a graphical representation of your requirement specifications, displaying your requirements hierarchically. You can group and sort requirements in the tree, monitor task allocation, monitor the progress in meeting requirements and generate detailed reports and graphs. After you create tests in the Test Plan module, you can link requirements to given tests. Later, after you begin logging defects you can also link requirements to defects. In this way, you can keep track of your testing needs at all stages of the testing process. If a requirement changes, you can immediately identify which tests and defects are affected, and who is responsible for them.
Planning Tests
After you define your requirements, you need to determine your testing goals. To do this, examine your application, system environment and testing process to outline the testing strategy for achieving your goals. After you determine your testing goals, you build a test plan tree, which hierarchically divides your application into testing units, or subjects. For each subject in the test plan tree, you can define tests that contain steps. For each test step, you specify the actions to be performed on your application and the expected result. You can increase the flexibility of a test step by adding parameters.
To keep track of the relationship between your tests and your requirements, you can add links between them. This can help you ensure compliance with your requirements throughout the testing process. After you design your tests, you can decide which tests to automate. When you automate a test, you can generate a test script and then complete it using other HP testing tools (for example, QuickTest Professional).
Running Tests
Running tests is the core of the testing process. As your application changes, you can run manual and automated tests in your project to locate defects and assess quality. You start by creating test sets and choosing which tests to include in each set. A test set is a group of tests in a Quality Center project designed to achieve specific testing goals. Quality Center enables you to control the execution of tests in a test set by setting conditions and scheduling the date and time for executing your tests. After you define test sets, you can begin to execute your tests. You can then use Quality Center to view and analyze the results of your tests. When you run a test manually, you can execute the test steps you defined in test planning. You can pass or fail each step, depending on whether the actual results match the expected output. When you run a test automatically, Quality Center opens the selected testing tool, which runs the test and imports the test results to Quality Center.
Project customization
The HP Quality Center administrator should customize projects to meet the specific needs of your testing team. This includes adding and customizing fields, and creating categories and lists that reflect the needs of a specific testing project and suit your projects unique quality objectives, standards and testing approach. The administrator can modify the behavior of HP Quality Center fields by: Restricting users to selecting only values from associated lists Making an entry in certain fields mandatory Preserving a history of values entered in a specific field Including data unique to your project by creating user fields Associating these fields with HP Quality Center and user-defined lists
You can customize and add fields that may be critical to collecting relevant quality metrics. The data quality increases as the drop-down lists and automatic fill-ins are used. You can identify the information required for evaluating application readiness and progress of the testing development and other relevant IT processes. Properly customizing HP Quality Center helps to manage multi-application testing efforts.
Address
http://
Project
Domain Project
1. Open Internet Explorer by double clicking on the Desktop shortcut. The homepage is set to load the quality center home page (now also known as Application Lifecycle Management) 2. From the Quality Center home (now listed as Application Lifecycle Management), click on the Application Lifecycle Management link. 3. For the Login Name:/Password: , enter the values provided by the instructor and click Authenticate. 4. Select the Domain and Project provided by the instructor and click Login.
This case study will describe the simplest complete way to implement Quality Center across all the modules.
Activities Summary
Releases Testing needs to be done on the Progressive.com website. The specific applications being developed are Find a Quote, navigation links, Report a Claim, and Site Search. We will create a Release structure for each of the applications being tested, with Cycles for each release. Each Cycle will describe the functionality to be tested during that cycle. Requirements We will create an organizational structure similar to that used in the Releases module to hold the testing requirements and the applications being tested. Testing requirements will be created within each folder and linked to their appropriate cycles to indicate where they should be tested. Tests We will create a Test Plan folder structure similar to those used in the Releases and Requirements modules to hold the tests being developed. We will create manual tests to verify the testing requirements we created for the Get a Quote application. Test steps will be added to one of the tests so that it can be executed. The tests will be linked to their appropriate requirements so that we can monitor whether the requirements are being met. Test Execution We will create a Test Set Folder structure to organize the execution of the tests during the cycles of development. We will create a Test Set for an execution of the regression tests to be executed during Cycle 1. The Test Set Folder will be linked to Cycle 1 so that we can see a report of the progress of the cycle. We will perform a manual execution of one of the tests on the Progressive.com website and report a defect when the test fails. Defects The defect found during test execution will be updated once the problem has been found. A new defect will be opened to report a problem found outside of the execution of a test. Analysis Generate graphs and reports.
Quality Center Implementation Case Study 1|2
You can begin the application management process by defining a releases tree in the Releases module. The foundation of the Releases module is the releases tree. This tree enables the modeling of upcoming releases within a hierarchical tree structure. You can start by defining a release folder along with its releases. A release represents a group of changes in one or more applications that will be available for distribution at the same time. After defining the release, you define cycles. A cycle is a set of development and quality assurance efforts performed to achieve a common goal based on the release timeline. After defining the releases tree, you define and review the requirements in the Requirements module and assign them to releases and cycles. Following test runs, you can review the test progress to determine how well it meets the release goals. You can also determine how many defects were resolved and how many still remain open. The results can be analyzed at a release or cycle level.
Instructor-Led Demo
2. Create the Releases 3. Add the Cycles
5. In the New Release Folder window, name the new folder Progressive.com. 6. Click OK. 7. Select the Progressive.com Website folder. 8. Use the table below to create additional folders under the Progressive.com Website folder. Folder Name Get A Quote Navigation Report Claim Site Search 9. The Releases tree should resemble the following:
3. Name the release Release 1 4. In the *Start Date: field, enter the current date 5. In the *End Date: field, enter the current date two months from now 6. Click OK.
9. Name the new cycle Cycle 1 - Regression. 10. In the *Start Date: field, enter the current date. 11. In the *End Date: field, enter the current date one week from today. 12. Click the OK button. 13. Ensure Cycle 1 - Regression is selected. 14. Click the Duplicate Cycle button.
15. Select Cycle 1 - Regression_Copy_1. 16. In the Details tab, select the Name field and replace the existing name with Cycle 2 New Features.
17. Click the Refresh button. Verify the name changes in the folder tree.
18. Ensure Cycle 2 New Features is selected. 19. Click the Reschedule button.
10. Change the Start Date to one week from today and the End Date 4 weeks from today. 11. Select Release 1. 12. Select the Master Plan tab to view where the overall release schedule.
1. Use the table below to create Releases and Cycles for the remaining applications. For each release, select a Start Date of today and an End Date two months from today. For each cycle, Cycle Name Cycle 3 Performance Testing Cycle 1 Sanity Testing Cycle 2 Stress Testing Cycle 1 Security Testing Cycle 2 End To End Testing Cycle 1 UAT Testing
You can begin the application life cycle management process by gathering all available documentation on the application under development, such as marketing and business requirements documents, system requirement specifications and design documents. Use these documents to obtain a thorough understanding of the application under development and determine your scope, goals, objectives and strategies.
Requirements
Instructor-Led Demo
2. Add a Requirement 3. Add an attachment
4. Refresh the Requirements page 5. Filter the Requirements 6. Use Zoom to filter the Requirements 7. Examine the various Requirements views
2. Select View > Requirement Details. Note: With the exception of the Requirements Grid view, you can create the structure in any of the views but Requirement Details is a commonly-preferred view.
5. In the Requirement Folder Name field, type Progressive.com and Click OK. 6. Select the newly created folder and Click the New Folder button. 7. Name this folder Get A Quote and Click the OK button. 8. Use the details in the following table to create additional Requirement Folders: Parent Folder Progressive.com Progressive.com Progressive.com Folder Name Navigation Report Claim Site Search
3. In the New Requirement window, click the Requirement Type drop down menu select Functional.
4. Use the table below to fill in the required information: Name Request a Homeowner Quote Priority 2-Medium Target Release Progressive.com > Get A Quote > Release 1 Target Cycle Progressive.com > Get A Quote > Release 1 > Cycle 1 - Regression Description The application needs to provide the ability for a user to request a Homeowner policy quote and the application needs to provide a valid quote based on the users input. 5. Click the Submit button.
7. Click the Submit button. 8. Use the table below to fill in the information for the third requirement. Name Find Agent Type Functional Priority 2-Medium Target Release Progressive.com > Get A Quote > Release 1 Target Cycle Progressive.com > Get A Quote > Release 1 > Cycle 2 New Features 9. Click the Submit button. 10. Use the table below to fill in the information for the fourth requirement. Name Rate Comparison List Displays Correctly Type Functional Priority 2-Medium Target Release Progressive.com > Get A Quote > Release 1 Target Cycle Progressive.com > Get A Quote > Release 1 > Cycle 2 New Features 11. Click the Submit button, followed by Close. 12. The requirements tree should resemble the following:
C a s e S t u d y 1 | 11
Report Claim parent folder: Type Name Functional Successful login Functional Incorrect logins are unsuccessful
Target Cycle Progressive.com > Report Claim > Release 1 > Cycle 1 Security Testing Progressive.com > Report Claim > Release 1 > Cycle 1 Security Testing
Site Search parent folder. Type Name Functional Search results are correct
Target Cycle Progressive.com > Site Search > Release 3 > Cycle 1 UAT Testing
C a s e S t u d y 1 | 12
Developing a clear and concise test plan is fundamental to successful application testing. A good test plan enables you to assess the quality of your application at any point in the application management process. The test plan tree is a graphical representation of your test plan. It is a hierarchical list of tests organized according to topic, which describes the set of tests you will implement in order to meet your quality requirements. Plan tests for each subject in your test plan tree. Decide which types of tests to create for each subject, such as sanity level tests or regression tests. (For an explanation of these test types, see Creating Test Sets.) Then create the tests and assign them to a branch of the test plan tree.
Instructor-Led Demo
1. Create the test plan tree 2. Create tests 3. Add test steps 4. Link Tests and Requirements
C a s e S t u d y 1 | 13
4. 5. 6. 7. 8. 9.
In the New Folder window, name your new folder as Progressive.com. Click OK. Click the New Folder button. In the New Folder window, name your new folder as Get A Quote. Click OK. Use the following table to create test plan folders for the remainder of the applications being tested: Parent Folder Folder Name Progressive.com Navigation Navigation Home Page Navigation Site Nav Progressive.com Report a Claim Progressive.com Site Search
C a s e S t u d y 1 | 14
3. 4. 5. 6.
In the New Test window, ensure the Test Type is Manual. Enter Request a Quote in the Test Name field. Click OK. Click in the Description field and enter the following text: This test will request the various types of quotes (Auto, Homeowner, etc.) and validate the values returned to the user.
Description of the site Verify that the Home and Renters Insurance link goes to the correct section of the site Verify that a user can correctly login with a valid Username and Password Verify that a user CANNOT login with an invalid Username or Password Verify that the Site Search feature returns correct results
Report a Claim
Site Search
C a s e S t u d y 1 | 16
1. In the Description Field, type Navigate to Progressive.com Website. 2. In the Expected Result Field type The Progressive.com Website loads. 3. Within the Design Step Editor window, Click the New Step button to proceed to the next step:
4. Using the above process, continue adding the following Description and Expected Result values: Step Name Description Expected Result Step 2 In the Get a Quote section, select the Policy Holder Name and Address type as Auto, enter your zip code (or screen should appear. 44143) and click Quote and Compare button. Step 3 Complete the Name and Personal Add Vehicles to your Quote screen Information screen and Click Next. appears. Step 4 Select the vehicle Type, Year, Make and The vehicle is added to the list and Model. Click Add This Vehicle. the caption reads, 1 Vehicle On Your Quote Step 5 Click Next. Provide Vehicle Details screen appears. Note: In real life youd complete all the remaining steps, but to save time well stop here. 5. Click OK in the Design Step Editor window when steps are complete. 6. Your steps should appear in a grid format as follows: Quality Center Implementation C a s e S t u d y 1 | 17
Expected Results Progressive.com homepage is displayed. Rate comparison list is displayed to the right of Get a Quote. Rate comparison list is scrolling vertically. Selected rate is correct. Progressive.com homepage is displayed. Page corresponding to the link clicked is displayed. Progressive.com homepage is displayed. Page corresponding to the link clicked is displayed.
C a s e S t u d y 1 | 18
3. Click the Select Req button. The Requirements tree is displayed on the far right of the screen:
9. Select the Request an Auto Quote requirement. 10. Click the Add to Coverage button. 11. The requirement coverage list should resemble the following:
12. Select the Find Agent test in the Test Plan tree. 13. Select the Find Agent requirement in the Requirements Tree. 14. Click the Add to Coverage button. Quality Center Implementation C a s e S t u d y 1 | 19
C a s e S t u d y 1 | 20
Test Execution
As your application changes, you can run the manual and automated tests in your project in order to locate defects and assess quality. Start by creating test sets and choosing which tests to include in each set. A test set is a group of tests in a Quality Center project designed to achieve specific testing goals. Once you have defined test sets, you can begin executing the tests. When you run a test manually, you can execute the test steps that you defined during test planning. You can pass or fail each step, depending on whether the application's actual results match the expected output.
Instructor-Led Demo
1. Create a Test Set tree 2. Create a Test Set 3. Add tests to the Test set 4. Run a manual test
C a s e S t u d y 1 | 21
2. In the Test Lab tree, select the Root folder. 3. Click the New Folder button.
7. In the Description field type Execution of all the regression tests for Cycle 1.
C a s e S t u d y 1 | 22
3. Use the table below to fill out the required information: Test Set Name: R1.1 Tests Description First execution of all the regression tests defined in the Test Plan 4. Click OK. 5. Select the Execution Grid tab.
7. In the Test Plan Tree on the right side of the screen, expand the Progressive.com folder and select the Get A Quote folder. 8. Click the Add Test To Test Set button.
C a s e S t u d y 1 | 23
C a s e S t u d y 1 | 24
2. Click the Run drop down menu and select Run with Manual Runner.
3. Open a new Internet Explorer window and perform the operations described in the Description field: navigate to http://www.progressive.com. Type a description of the result into the Actual field: Progressive.com website loaded 4. Click the Pass Selected button.
5. Follow the Description for Step 2. In the Actual pane, type Policy Holder Name and Address page loaded
C a s e S t u d y 1 | 25
8. Use the table below to fill in the required information: Summary Severity Priority Target Cycle Vehicle Quote Fails 4-Very High 4-Very High Get A Quote > Release 1 > Cycle 2 New Features
Note: The defect that you just reported represents a fatal error: we cannot continue executing the test because the application crashed. We will need to stop executing the test at this point, leaving Step 4 and Step 5 unexecuted 11. Click the End Run button.
12. At this point the execution grid should resemble the following:
C a s e S t u d y 1 | 26
3. Click the Begin Run button. Note all the Steps show a status of No Run.
4. Open a new Internet Explorer window and perform the operations described in the Description field: navigate to http://www.progressive.com. Type a description of the result into the Actual field: Progressive.com website loaded 5. Click the Pass Selected button. 6. Complete the remaining steps as Passed steps. (We will assume the remaining steps work properly so that we can see what a passing test looks like.) 7. Once all the steps are passed, the Manual Runner should resemble the following:
Part 2 Stop the Test 8. Click the End Run button. 9. At this point your Execution Grid should resemble the following:
C a s e S t u d y 1 | 27
12. Review the information displayed in the Report tab between the two runs and click OK.
C a s e S t u d y 1 | 28
Defects
Locating and repairing application defects efficiently is essential to the development process. Defects can be detected and added to your Quality Center project by users during all stages of the application management process. Using the Quality Center Defects module, you can report design flaws in your application and track data derived from defect records. When you discover a defect in your application, you can submit a defect to the Quality Center project. The project stores defect information that can be accessed by authorized users, such as members of the development, quality assurance and support teams. You can associate this new defect with the cycle and release in which it was detected.
Instructor-Led Demo
1. Add a Defect 2. Filter the Defects grid 3. Save the filter to the Favourites list 4. Update a Defect 5. Add a comment to a defect 6. Manually link a defect to a test
C a s e S t u d y 1 | 29
C a s e S t u d y 1 | 30
9. In the Defects To Link window, select the Incorrect Quote Value defect and click Link. 10. Select the Req Coverage tab.
C a s e S t u d y 1 | 31
11. Under the Entity Name column, click the Rate Comparison List Displays Correctly link. 12. Select the Linked Defects tab.
13. Click the Type of Link drop down menu and select All Links.
14. Verify the Defect now is present. Click the Defect ID link to head back to the Defects module.
C a s e S t u d y 1 | 32
Analysis
You can generate graphs that let you view images describing the information in a Quality Center project. You can also design graphs that combine data from multiple projects. Standard reports offer you a variety of report types that list data from Quality Center modules.
Instructor-Led Demo
1. Create a graph 2. Create a report
C a s e S t u d y 1 | 33
7. In the New Graph dialog window, select Defects from the Entity list and select Progress Graph from the Graph Type list. Name the graph Defects Progress Graph. 8. Click OK. 9. Repeat the steps for the following graphs: Entity REQUIREMENTS TEST INSTANCES TESTS Graph Tree PROGRESS GRAPH SUMMARY GRAPH PROGRESS GRAPH Graph Name Requirements Progress Test Instances Summary Tests Progress
16. Enter My Dashboard Page for the name. Click OK. Part 3 - Configuring Dashboard Pages
17. Click the Configuration tab.
18. Click the Refresh button to refresh the graphs tree. 19. Select and expand My Graphs folder. You should see the graphs you have created. 20. Add all graphs to your dashboard page by clicking the Add Graph to Dashboard Page button. Alternatively, you can drag a graph to a new row above or below existing graphs, or to an empty box alongside a graph. 21. The Tests Progress graph should be expanded. Click the Expand button. The button is located at the top-left corner of each graph.
22. Do the same for the Test Instances Summary graph. 23. Move the Requirements Progress graph next to the Defect Progress graph by dragging the graph. 24. Remove the Tests Progress graph by clicking the Remove button which is located at the topright corner of the graph.
C a s e S t u d y 1 | 35
C a s e S t u d y 1 | 36
3. From the Analysis menu, select Reports > Standard Requirement Report.
5. Click the Add to Analysis Tree button. 6. In the New Standard Report window, select the Private folder and click the New Folder button.
7. Name the new folder as your student** account and click OK. 8. Click Save. 9. If you are not automatically transported to the Analysis View module, navigate there and select the newly created report.
C a s e S t u d y 1 | 37
12. Mouse over the row for Req Parent and click the drop down menu.
13. In the Select Filter Condition window, expand the Requirements root folder and select the Progressive.com > Get A Quote folder. 14. Click OK twice. 15. Click the View tab and review the contents of the report. Note the number of pages now present in the report.
C a s e S t u d y 1 | 38
18. In the New Standard Report window, use the table below to complete the requirement information. Entity Standard Report Type Standard Report Name 19. Click OK. 20. In the Configuration tab, click the Filter button. Tests Test Plan Report Get A Quote Test Cases
21. In the Filter Tests window, select the Cross Filter tab.
23. In the Cross Filter: Requirements window, click the drop menu for Req Parent.
24. In the Select Filter Condition window, expand the Requirements root folder and select the Progressive.com > Get A Quote folder. 25. Click OK. 26. Click the ellipsis button for the Type drop down menu.
C a s e S t u d y 1 | 39
29. In the Add Sub-Report window, select Design Steps from the Type drop down menu and click OK. 30. Click the View tab and review the contents of the report. Note all of the tests cases displayed are MANUAL test cases and their Design Steps are displayed as well.
C a s e S t u d y 1 | 40
If you have existing test documents in Microsoft Excel, you can export them directly to Quality Center. To export Requirements, Test Plans, or Defects from Microsoft Excel to Quality Center, the user must install the Microsoft Excel Add-in on their client machine. The Add-in is installed through the Quality Center home page under the Add-Ins Page
General Setup
Once the user navigates to the More HP ALM Add-ins page, the Add-in will be found under the Microsoft Office Add-ins: section. Installation is completed through a wizard that guides the user through a relativity fast setup process Once the Add-in is installed, a link under the Add-Ins ribbon will now be visible to the user call Export To HP ALM Note: The Add-in can be uninstalled through Add/Remove programs in Windows Control Panel
When creating data to export to Excel, the first row is typically used as the column heading. As such when selecting which cells to export, the column heading row must never be selected. When exporting, Excel will start an exporting wizard, starting with prompting the user to enter
in the address of the Quality Center server, followed by the user's login credentials and what project the data will be exported to. Mapping Fields The user must match the column heading to the field value to be populated in the Mapping wizard. Any Quality Center fields that are red require the user to specify a column with data for that field or the export process cannot go any further. The mapping wizard also has a button that will ask for the row with the column headings and will text match the headings to the Field names in Quality Center.
Once the export is complete, the wizard closes and the user can then view the results in Quality Center
Instructor-Led Demo
Activity Summary
Test Plan
Export and view results
4. In the Quality Center Export Wizard, enter the server name and press Next 5. Enter the login and password credentials (student/mercury) and click Next 6. Select the Domain and Project specified at the beginning and press Next 7. Select the type of data as Tests 8. Select Type a new map name and use the following name: TestMap1. Then click Next. 9. In the left column, select Subject and press the > to move it to the right side. In the popup that appears, choose column A and press OK. Complete the mappings as follows:
10. Press Next 11. You should have a message saying You have successfully exported the Microsoft Excel Worksheet to Quality Center 12. Press Finish 13. Navigate to the Test Plan Section and expand the section to validate the tests have been imported correctly.
Lesson 3-1
Test Parameters
To increase the flexibility of manual tests, you can add parameters to design steps. This enables you to run the same test repeatedly with different data each time. A test parameter is a variable that can be assigned a value outside the test from which it is defined. Before you can use parameters in design steps, you need to define them in the test. Manual tests with parameters can be called from other tests. This is useful if you have common steps you often want to perform as part of other tests.
Lesson 3-2
Instructor-Led Demo
1. Add test parameters
Lesson 3-3
Activity Summary
Tests
Add test parameters to make the login test more flexible Call a test that uses the new login test.
Test Execution
Run a test with parameters
Lesson 3-4
Open a web browser and navigate to the home page In the User ID field enter a valid username In the Password field enter the correct password for the username you entered Click the Log in button
Part 2 - Add Test parameters 4. Click on the Design Steps tab 5. In Step 2, position the cursor after the last word in the description cell and click on the Insert Parameter button ( ) ) 6. In the Parameters window, click on the New Parameter button ( 7. Type UserID in the Parameter Name: field 8. Click OK 9. Click OK to close the Parameters window 10. Repeat the above steps to create a parameter called Pwd in Step 3. 11. Your steps should look like the following:
Lesson 3-5
Part 3 - Call the test 12. Highlight the Website Security folder. 13. Create a new test called Test Authentication. 14. Click on the Design Steps tab 15. Click on the Call to Test button ( )
16. In the Select Test window, remove the check besides Show only Template Tests 17. Navigate the tree and highlight the Login with Parameters test and click OK 18. In the Called Test Parameters window, click on the drop down menu button ( in the Actual Value field for the UserID parameter 19. Enter training and click OK 20. Enter the value mercury for the Pwd parameter )
21. Click OK to close the Called Test Parameters window 22. Right click on the Description for Step 1, and select Called Test Parameters.... 23. Change the password to qwerty and click OK 24. Your Test Authentication test steps should look like the following:
Lesson 3-6
8. From the Test Plan Tree that opens to the right of the screen, select the Test Authentication test. 9. Click on the Add Tests To Test Set button ( )
Part 3 - Run Test 10. Click on the right end of the Run button ( ) to bring up the drop down
menu and select Run Manually (or Run with Manual Runner).
11. The Manual Runner window pops up. Click on the Begin Run button ( and click OK 13. There should be no errors in the test run, so pass each step by clicking on the Pass Selected ( ) button for each step
12. The Test AuthenticationRun dialog box opens. Verify the values of the parameters
14. Once all steps are marked as Passed under the Status field, click on the End Run button ( )
Lesson 3-7
Test Configurations
You can run tests for different use-cases of the application you are testing. Each use-case of a test is represented by a test configuration. A test configuration is a set of definitions that describe a specific use-case of a test. You can associate different sets of data for each test configuration. Working with test configurations enables you to run the same test under different scenarios. When creating a test, by default, a single test configuration is created. This test configuration is created with the same name as the test. Using the Test Configurations tab of the Test Plan module, you can create as many additional test configurations as needed. You associate a test configuration with data defined in the Parameters tab of the Test Plan module. You can associate different data with each test configuration. When creating coverage, instead of covering each requirement only at the level of the test, you can link a requirement to a test configuration. Associating test configurations with requirements provides finer granularity for requirements coverage by enabling coverage by different use-cases of a test. After creating coverage, you define a test set in the Test Lab module. A test set can include any or all of the test configurations defined for a test, or it can include test configurations based on requirement coverage. When you run a test set, the parameter values are retrieved from the data resource according to the settings defined for each test configuration.
How to Work with Test Configurations 1. Define tests with test parameters in the Test Plan module 2. Define test configurations 3. Define a test set 4. Add test configurations to a test set 5. View results
Lesson 3-8
Instructor-Led Demo
1. Add parameters
Lesson 3-9
Activity Summary
Prerequisites
You should know how to create tests with parameters. You should know how to add a test set and include tests
Test Plan
Create a test with parameters Add test configurations
Test Lab
Use test configurations Run the test configuration
L e s s o n 3 - 10
3. Modify Step 2 to include the funds parameter as follows: Open an investment account using fund <<<funds>>>
tip: Don't type the word <<<funds>>>. Instead click on the Insert Parameter button and select funds from the list of parameters.
L e s s o n 3 - 11
4. Click on the Test Configurations tab. 5. Click on the New Test Configuration button.
6. In the New Test Configuration window, type "Capital Value" and press OK. 7. With the new configuration created, select the Data tab.
8. Click in the Actual Value field, and click on the dropdown arrow to open the data entry window.
9. In the data entry window, type "Capital Value" and press OK to close the window.. 10. Repeat the above steps to create two additional configurations: Configuration Name Precious metals US Growth Data Precious Metals and Mining U.S. Growth
L e s s o n 3 - 12
11. Delete the default configuration "Create Investment". You should have only 3 configurations.
Part 2 Run the test configurations 12. Select the Test Lab module. 13. Choose a folder (or create a new one) and add a new test set called "Configurations" 14. In the Execution Grid tab, click Select Tests. 15. locate the "Create Investment Account" test and add it to the test set. Notice that it adds all 3 configurations as test instances. 16. Run the Run menu, select Run Manually
17. Click Begin Run. 18. Pass Step 1 19. On Step 2 notice that the <<<funds>>> parameter has been replaced with the data value. 20. Pass all the steps and press End Run to complete the test execution.
21. Repeat the above steps to run the remaining two tests instances.
L e s s o n 3 - 13
2. Challenge: Create two functional requirements and associate each one to each of the configurations. Choose any data for the requirements and associate each configuration in the Test Coverage tab. 3. Add the test to the Configurations test set. 4. Run the tests. Pass the 401K instance and fail the Account transfer instance. 5. Examine the results and the requirement status.
L e s s o n 3 - 14
Draft Runs
Overview
A test run whose outcome does not impact test statistics such as execution status or coverage. You can set a test run as a draft before or after the run, enabling you to try out tests while they are in development, or after they have been modified. When you change the draft run value, ALM recalculates tests statistics and updates status fields.
After a test run. You can mark any test run as a draft by modifying the Draft Run field for the run.
L e s s o n 3 - 15
L e s s o n 3 - 16
Instructor-Led Demo
1. Perform a Draft Run
L e s s o n 3 - 17
4. Click Begin Run to start the test. 5. Pass all the steps and end the test run.
L e s s o n 3 - 18
Purge Draft Runs only From run older than: Number of runs per test to keep:
checked 0 days 0
6. Click Next. 7. Click Finish. 8. With the Test Runs tab open, click the refresh button
L e s s o n 3 - 19
L e s s o n 3 - 20
Advanced Reporting
Standard Reports
Quality Center provides you with analysis tools enabling you to analyze and display ALM data in various formats. Dashboard contains two modules: The Analysis View module and the Dashboard View module. The Analysis View module contains the analysis tree in which you organize all of your analysis items. Analysis items can be any of the following analysis types: graphs, project reports, Excel reports, and standard reports. Standard Reports can have several layers, or sub reports to them. For example, a Standard Report for Requirements can have a sub report showing the linked tests cases, or defects. Filters can be applied to the Standard Reports to grab only the data that is relevant to your report. This is handy in that a Standard Report without such filters can be massive in size.
Advanced Reporting
Instructor Demos
1. Generating a Standard Report from module Notes
Advanced Reporting
3. From the Analysis menu, select Reports > Standard Requirement Report.
5. Click the Add to Analysis Tree button. 6. In the New Standard Report window, select the Private folder and click the New Folder button.
7. Name the new folder as your student** account and click OK. 8. Click Save. 9. If you are not automatically transported to the Analysis View module, navigate there and select the newly created report.
Advanced Reporting
12. Mouse over the row for Req Parent and click the drop down menu.
13. In the Select Filter Condition window, expand the Requirements root folder and select the Mercury Tours Application folder. 14. Click OK twice. 15. Click the View tab and review the contents of the report. Note the number of pages now present in the report.
18. In the New Standard Report window, use the table below to complete the requirement information. Entity Tests Standard Report Type Test Plan Report Standard Report Name MT Test Cases 19. Click OK. Advanced Reporting Case Study 4|5
21. In the Filter Tests window, select the Cross Filter tab.
23. In the Cross Filter: Requirements window, click the drop menu for Req Parent.
24. In the Select Filter Condition window, expand the Requirements root folder and select the Mercury Tours Application folder. 25. Click OK. 26. Click the ellipsis button for the Type drop down menu.
27. Select MANUAL and click OK, followed by OK. 28. Click the Add Sub Report button.
29. In the Add Sub-Report window, select Design Steps from the Type drop down menu and click OK. 30. Click the View tab and review the contents of the report. Note all of the tests cases displayed are MANUAL test cases and their Design Steps are displayed as well.
Advanced Reporting
Activity 2: Challenge
Defects Defects
1. Use the table below to create Two more reports. Entity Standard Report Type Standard Report Name Runs Runs Failed Test Runs Open Defects
Filter Status = Failed Status = Open Cross Filter With Req Parent = Mercury Tours Application
2. Hint: The Failed Test Runs report should resemble the following:
Advanced Reporting
Project Reports
Project Reports are a new feature in Application Lifecycle Management 11. They are generated through the Analysis View module, enableing you to design and generater a wide veriety of comprehensive reports. Usuing templates designed by the project administror for potentially each ALM entitiy, users can generate reports that follow company standards with regards to layout conventions and formating. Templates can be created using Microsoft Word, however this particiular feature is availible only to those running Word 2007 or 2010.
Advanced Reporting
Instructor Demos
4. Generating a Project Report Notes
Advanced Reporting
1. Ensure you are in the Analysis View module. 1. Under the Private folder, click on the student**folder you created earlier. 2. From the menu, select Analysis > New Project Report.
3. In the New Project Report window, type Requirements 4. Click OK. 5. In the Configuration tab, change the Output Format: to Doc.
7. In the Edit Document Template Field Values window, use the table below to change the following values: Field Name Field Value Project Mercury Tours Title1 Custom User Requirements Summary This is my custom report Author You Name 8. Click OK. 9. Click on the Add Report Section button.
10. In the Add Report Section window, change the Type field to Requirements and click OK. 11. Click on the Generate Report button. 12. Review the report and close Microsoft Word. Note: if Microsoft Word is not installed, try creating an HTML report.
Advanced Reporting
C a s e S t u d y 4 | 10
2. Set the Req Parent filter to the Mercury Tours Application folder.
5. In the Add Report Section window, click the Type drop down menu and select Tests, followed by OK. 6. Click the Filter button. 7. In the Filter Tests window, select the Cross Filter tab.
7. Under Requirements, click the Filter radio button. 8. In the Cross Filter: Requirements window, set the Req Parent filter to the Mercury Tours Application folder. 9. Click OK. 10. Click the ellipsis button for the Type drop down menu.
11. In the Select Filter Condition window, select MANUAL and click OK. 12. Click OK and verify the Filter box resembles the following:
Advanced Reporting
C a s e S t u d y 4 | 11
13. Ensure the Tests node is selected and click the Add Report Section button.
14. In the Add Report Section window, click the Type drop down menu and select Design Steps, followed by OK. 15. Click the Project Template drop down menu and select Design Steps Tabular Template green by Alice.
Select the Tests node and click the Add Report Section button. In the Add Report Section window, click the Type drop down menu and select Defects, followed by OK. Select the Document node. Change the Output Format to PDF.
20. Click the Generate button. 21. Navigate through the report and verify the Design Steps template looks slightly different in terms of style from the rest of the report.
Advanced Reporting
C a s e S t u d y 4 | 12
Ensure you are in the Analysis View. Select any of the graphs created in the previous activity. From the module menu, select Edit > Share Analysis Item. In the Share Analysis Item window, select Copy Analysis Item Public URL.
5. Click OK.
Advanced Reporting
C a s e S t u d y 4 | 13
Advanced Reporting
C a s e S t u d y 4 | 14
Instructor Demos
8. Live Analysis graph. Notes
Advanced Reporting
C a s e S t u d y 4 | 15
Group By X-axis
Status Designer
23. Click on the second Add Graph link. 24. Select the following options Graph Type Group By Progress Graph Execution Status
25. Review the second graph. 26. Delete the second graph, and add a new Summary Graph using Status as the X-axis and Group By value. 27. Starting with the Flight Reservation folder, note how many tests are in the Ready state in each folder Folder Flight Reservation Book Flight Flight Confirmation Flight Cost Flight Finder Select a Flight # of tests in "Ready" State
Advanced Reporting
C a s e S t u d y 4 | 16
Group By X-Axis
7. Update the following fields Tab Titles Appearance Bar Parameters Field Graph Title 3D Graph Mark Position New Value Tests by Test Set Uncheck Middle
8. Click on the bars in the graph to drill down to the details 9. Close the Drill down results. 10. Select different folders and verify the graphs are being updated
Advanced Reporting
C a s e S t u d y 4 | 17
Document Generator
The Document Generator enables you to create a hard copy of the data contained in a Quality Center project. You create the document by performing the following tasks: 1. Set document format. 2. Specify document content. 3. Generate and edit the document. First, you set formatting instructions in order to determine how your project document will look. For example, you can print a company logo on each page of the document, create a table of contents and an index, and place test scripts and file attachments in the text of your document. Next, you specify the project data that will be presented in your document. You can select information from the Quality Center modules. For example, from the Test Plan module, you can choose which folders and tests to include from the test plan tree, sort this data alphabetically or in a custom sort order, and display the data as lists or tables. After you have set the formatting instructions and specified the document's content, you can save the document settings as a favorite view for future use and generate the document. After document generation is complete, you can view and edit the document in Microsoft Word. The information for each module that you select is printed in a separate chapter of the project document
Advanced Reporting
C a s e S t u d y 4 | 18
6. Quality Center begins generating the document and a dialog box displays document creation progress. When the process is complete, Microsoft Word opens and displays the document.
Instructor Demos
4. Create a report using the Document Generator Notes
Advanced Reporting
C a s e S t u d y 4 | 19
6. Set the Req Parent filter to the Mercury Tours Application folder.
7. Checkmark the first two graphs at the bottom of the Document Generator window.
8. Use the table below to click the required check boxes: Test Plan Subject Tree Subject Tests 9. The Document Generator tree should resemble the following:
Advanced Reporting
C a s e S t u d y 4 | 20
10. Ensure the Subject Tests node is selected. 11. Click the Design Steps check box.
12. Click the Selected radio button, followed by Filter and Sort. 13. In the Filter Tests window, select the Cross Filter tab.
14. Set a Requirement filter for the Req Parent to the Mercury Tours Application folder.
15. Set the Type filter to MANUAL test cases and click OK. 16. Click the Full Document button. 17. Save the document as MTours Phase 1 to the Desktop. 18. Review the contents and close Microsoft Word.
Advanced Reporting
C a s e S t u d y 4 | 21
Excel Reports
You can export Quality Center data to Microsoft Excel. This enables you to analyze your data using any of the capabilities available in Excel. An Excel report consists of a set of data defined by SQL queries on the project database. You can also run a Visual Basic script on the extracted data to process and analyze the data. Once you have added an Excel report in the Dashboard module, you define which project data you want to include in the report. This data is defined by creating SQL queries. You can create multiple queries for an Excel report. When you generate the report, the results of each query are displayed in separate Excel worksheets. For advanced users, they can enter the SQL query directly in the Query tab You can include parameters in the SQL queries for your Excel reports. For each query parameter, you can assign a default value. When you generate the report, you are prompted to enter the value of the parameter, or confirm the default value. Alternatively, you can choose to always use the default value, without being prompted by Quality Center each time you generate the report. You can create a Visual Basic script to run after the data is exported to Excel. You use this script to manipulate the data in Excel. For example, you can present requirements data in Excel as a pivot table, you could perform calculations on defects data to calculate the average time an open defect takes to be fixed, or you could create a graph based on exported data. Before you run a post-processing script, you must configure your Microsoft Excel security settings so that Excel can run the script.
Advanced Reporting
C a s e S t u d y 4 | 22
Instructor Demos
1. Create an Excel report Notes
Advanced Reporting
C a s e S t u d y 4 | 23
This activity will generate an Excel report to display the count of the Requirements by the status.
and select New Excel Report. 4. The New Excel Report dialog box opens. 5. Under Excel Report Name, type Requirements Coverage 6. Click the Query Builder button. The Excel Report Query Builder window opens. 7. In the Query1 tab, type the following SQL queries to extract the requirements coverage data: SELECT REQ.RQ_REQ_STATUS as Status, Count( REQ.RQ_REQ_STATUS ) as Num FROM REQ GROUP BY REQ.RQ_REQ_STATUS 8. On the toolbar, click TEST QUERY to test the SQL query syntax. The query results appear in the Query Results tab at the bottom of the window.
9. Click OK to close the Excel Report Query Builder window 10. Click the Generation Settings tab. 11. Change the status to Ready. 12. Click the Generate button 13. Type a name for your Excel report and click SAVE to save the report on your computer. 14. The PROGRESS dialog box appears. After the process is complete, the Excel report appears. Close Excel.
Advanced Reporting
C a s e S t u d y 4 | 24
This activity will generate an Excel report to display the count of the Test Execution status. 1. Create an Excel report to display a summary of the Execution status of the tests.
Count( TEST.TS_EXEC_STATUS ) as Num FROM TEST /*Test*/ GROUP BY TEST.TS_EXEC_STATUS /*Test.Execution Status*/
3. Create the query in the Query Builder window, and test the query before generating the report. 4. Set the status of the report to Ready. 5. Generate the report.
Advanced Reporting
C a s e S t u d y 4 | 25
7. Add the following description: Description This report will include two queries to display the defect status and description.
14. The SQL query should look like: SELECT * FROM BUG /*Defect*/
Advanced Reporting
C a s e S t u d y 4 | 26
16. You should see the results in the Query Results pane. Note: You may need to resize some of the panes.
Note: The Test Query button displays a max of 10 queries. 17. Click the Add Query button.
19. In the Entities View, expand the Defect (BUG) entity by clicking on the plus sign next to the table. 20. Select the value Defect ID (BG_BUG_ID) 21. Click the Add Entity to Query button. 22. Add a "," (comma) at the end of the first line. (without the double quotes)
SELECT BUG.BG_BUG_ID /*Defect.Defect ID*/
23. Add a blank line after the SELECT ... line, and position the cursor on the blank line. 24. In the Entities Pane, select Description (BG_DESCRIPTION) 25. In the drop-down menu of the Add Entity to Query button (the downward pointing arrow to the right of the button), select Add Entity to Query with Entity Title as Alias.
27. Scroll the Entities Pane until you find the Defect (BUG) entity. Select it.
28. Click the Add Entity to Query button.
29. Your SQL should look something like the following: SELECT BUG.BG_BUG_ID /*Defect.Defect ID*/,
30. Click the Test Query button. 31. Verify that the Query Results is populated with the results from the query.
33. In the Query Parameters tab, click the New Parameter button.
34. The New Parameter dialog box opens. In the Parameter Name box, type BG_STATUS_PARAM In the Default Value, type Open Check Global Parameter In the Description, enter Parameter for the field BG_STATUS
35. Click OK to close the dialog box. The parameter is added to the Parameter list.
Advanced Reporting
C a s e S t u d y 4 | 28
Advanced Reporting
C a s e S t u d y 4 | 29
47. To run the post-processing script after the data is exported to Excel, select Run post-processing. If you do not select this option, the script is not run when you generate the report.
Advanced Reporting
C a s e S t u d y 4 | 30
Query 1
Rename the Query "RequirementsInfoWithParentID" SELECT REQ.RQ_FATHER_ID as Parent_Folder, REQ.RQ_FATHER_ID as Parent_Folder_ID, REQ.RQ_REQ_NAME as Requirement_Name, REQ.RQ_REQ_ID as Requirement_ID FROM REQ Where REQ.RQ_NO_OF_SONS = 0
Query 2
Rename the Query "RequirementFoldersWithChildren" SELECT REQ.RQ_REQ_ID as Folder_ID, REQ.RQ_REQ_NAME as Folder_Name From REQ where REQ.RQ_REQ_ID in (select REQ.RQ_FATHER_ID from REQ)
Advanced Reporting
C a s e S t u d y 4 | 31
Sub QC_PostProcessing() Dim lookupSheet as Worksheet set lookupSheet = ActiveWorkbook.Worksheets("RequirementFoldersWithChildren") dim countFolders, countReqs countFolders = lookupSheet.UsedRange.Rows.Count Dim mainSheet as Worksheet set mainSheet = ActiveWorkbook.Worksheets("RequirementsInfoWithParentID") countReqs = mainSheet.UsedRange.Rows.Count mainSheet.Cells(1,1).Value="Parent Folder" Dim vlFormula as string for row = 2 to countReqs vlFormula = "=VLOOKUP(B"&row vlFormula = vlFormula &",RequirementFoldersWithChildren!A2:B" vlFormula = vlFormula & (countFolders + 1) vlFormula = vlFormula &",2,FALSE)" mainSheet.Cells(row, 1).Value = vlFormula next 'change focus to RqequirementsInfoWithParentID sheet ' and autofit columns for readability mainSheet.Activate dim countColumns countColumns = mainSheet.UsedRange.Columns.Count for col = 1 to countColumns mainSheet.Columns(col).EntireColumn.AutoFit next End Sub
Advanced Reporting
C a s e S t u d y 4 | 32
Requirements Traceability
Requirements Traceability
Overview
Requirements traceability defines a relationship between two or more requirements. When analyzing the impact of a change proposed in a specific requirement, the traceability links indicate the other requirements that the change might affect. You can add traceability links to and from a selected requirement. Trace from links indicate requirements that affect a selected requirement. Trace to links indicate requirements that are affected by a selected requirement. When a requirement changes, HP Application Lifecycle Management (ALM) can alert the affected requirements.
Traceability Matrix
The traceability matrix enables you to determine the extent of relationships between requirements and other requirements, and between requirements and tests. It helps you verify that all requirements are met, and identify changes to the scope of your requirements when they occur. The traceability matrix lists source requirements and their associated requirements and tests. The total number of relationships is listed for each source requirement. A low value may imply that the source requirement is not associated with enough requirements or tests. A high value may imply that the source requirement is too complex and can perhaps be simplified. A zero value indicates that no relationship exists.
Requirements Traceability
Instructor-Led Demo
1. Define traceability links.
Requirements Traceability
Activity Summary
Requirements
Define traceability links. View traceability impact. View Traceability Matrix.
Requirements Traceability
For example, the Insurance page depends on the Forms, Navigation and Reports standards, while the Home page is only affected by the Navigation standards. 4. Select requirement CIBC Website Development > Help Screen.
5.
6.
Click on the Add Requirement Traceability button On the right hand side, a Requirements tree folder will be shown.
Requirements Traceability
7.
Locate the CIBC Standards > User Interface standards > Documentation requirement.
8. 9. 10. 11.
).
Locate the CIBC Standards > User Interface standards > Navigation requirement. Click the Add To Traceability button to add it to the Tools requirement ( Your Requirements Traceability should look like the following: ).
12.
Repeat the above steps to set up the relationship defined in the table above for the Insurance Page and Mortgage Page requirement. Verify the relationships are set up correctly by viewing the Impact Analysis for the CIBC Standards requirements. Look in the Trace To links area.
13.
Requirements Traceability
4.
In Filter by linked requirements, identify the requirements that have an impact on the defined source requirements.
Requirements Traceability
5.
Click OK to close the Configure Traceability Matrix window. The traceability matrix grid displays the source requirements and number of traced from requirements. Click Generate Traceability Matrix.
6.
7. 8.
When prompted, enter File name UI Standards and click Save. The saved file will resemble the following example.
Requirements Traceability
Requirement Risk
1. You want to assign your most important requirements to be tested by your most experienced testers. Using the table below, make a list of criteria you would use to differentiate the importance of a requirement. A suggestion is included in the table.
Requirement Risk
Requirement Risk
Calculating Requirement Risks About Calculating Requirement Risks
Risk-based quality management can assist you in determining testing strategy for your requirements.
When planning how to test your requirements, you generally do not have unlimited resources available and are not able to fully test every requirement. You must make compromises and only partially test requirements that have low criticality to the business, or those that have only a minor risk associated with their implementation. The risk-based quality management feature enables you to calculate at which level to test each requirement, based on the nature of the requirement and the resources you have available. You can then plan your testing process based on these recommendations. Each requirement type can be enabled for risk-based quality management. Each requirement type with risk-based quality management enabled can support either risk analysis which is referred to as an analysis requirement, or an individual risk assessment which is referred to as an assessment requirement. An analysis requirement is a requirement belonging to a type that represents higher levels in the requirements tree hierarchy, such as the Folder type. You perform risk analysis on an analysis requirement based on the assessment requirements under it in the requirements tree. The risk results of multiple assessment requirements are aggregated to give an overall risk analysis which can then be used to determine testing effort and test strategy. An assessment requirement is a requirement belonging to a type that represents requirements that are children of analysis requirements and at a lower level in the requirements tree hierarchy. Assessment requirements under a particular analysis requirement form the basis for risk analysis on that analysis requirement. You can work with risk-based quality management in the Requirement Details view of the Requirements module. You can also work with risk-based quality management in the Risk view of the Requirement Details dialog box.
Requirement Risk
Instructor-Led Demo
Requirement Risk
Activity Summary
Requirements
Create new requirements Perform Risk Analysis
Requirement Risk
1. In the Requirements module create a new folder called User Interface Requirements and add the following requirements Requirement Type
Requirement Risk
5. For each child requirement, select Business Criticality, Failure Probability, and Functional Complexity tabs and enter values for each Criterion (for this activity any value will suffice).
6. Navigate to the parent requirements and in the Risk Analysis tab and click on the Analyze button ( )
7. Identify the three most critical requirements listed in the graph (Note this will depend on the values you chose for the criterion)
1 2 3
Requirement Risk
Requirement Risk
One of the most important aspects of Quality Center is its ability to tie in all departments that are potentially in a company into a single cooperative workflow database. All of the different modules within Quality Center are built around tying everything and everyone together in the process of software development as to ensure a cohesive, efficient team. In the Business Components module, the user has the ability to import a business process model and integrate it into either the requirement or test entities. As a result, the coverage of the requirement or test gets expanded to include the business model. When a business model is imported into Quality Center, each block of the flow is given its own entity in the tree structure in order to attach details such as fields, descriptions, attachment and linkage to that single item. Items in the business model such as decisions are not given their own entity within Quality Center. As well each parent entity of the Business Model can be linked to a baseline.
The user has the ability to view the details of any part of the business model. By right clicking on any item in the flow chart, the user can bring up the details of that specific part of the business model.
From the Model Activity Details window, the user can also link the item to any requirement or test
After a business model in imported into Quality Center, if the user navigates to the Requirements module, they will notice the Business Model is also visible in the Requirements tree structure
Instructor-Led Demo
1. Import A Business Model
Activity Summary
Business Models
Analysis Business Model
Import a BPM file into Quality Center Tie Business Model to Requirements and Tests View Coverage of Business Process Models
Part 2 Convert Requirements to Test Cases 5. Right-click on the Process Complaint requirement folder and select Convert To Tests
6. In the Step 1 of 3: Choose an automatic conversion method window, select Convert lowest child requirements to tests and click Next. 7. Select the Process Notification node.
9. Click Finish, followed by OK in the Information dialog box. 10. Navigate to the Test Plan module and verify the test cases were successfully created.
Part 3 Import Business Model 11. Navigate to the Business Models module
12. Ensure the top folder Models is selected and create a new folder called Cloud DB.
15. Click the My Documents button and select Sample BPM.xml and click Open. 16. Click the Import button.
8. Click the Select Requirements button. 9. In the Requirements tree, select the Process Complaint folder and click Add To Linkage.
10. Select the Create complaint node. 11. Select the Linkage tab.
12. Expand the Process Complaint requirement folder and select the Create Complaint requirement, followed by Add To Linkage.
14. Click the Coverage drop down menu and select Linked Requirement Coverage.
16. Select the Quality Analysis tab. 17. Review the graph information and note the Test Cases that are linked to the Create complaint node of the business model.
C a s e S t u d y 7 | 10
HP Sprinter
Sprinter
Sprinter allows the user to access the Quality Center server and download the details of a test (such as steps, parameters, descriptions and expected results) and run the test on any machine with Sprinter installed. Depending on the settings of a given project, if a manual test is launched within Quality Center, Sprinter will automatically load. Otherwise Sprinter can be launched from the Start Menu or any other shortcut medium that is present. While Sprinter may have some automation features, it does not turn a manual test into an automated one. With Sprinter there are simply more features enabled to the user in order to provide better documentation for the results of the test run. The automation features can be turned on or off depending if Power Mode is enabled. If Power Mode is turned off, the user will not have access to these features. Before a test is run, the user has the ability to review Test Steps, General Settings and Parameters before executing the test. They also have the abilty to export, print or E-Mail the Test Steps.
HP Sprinter
Instructor-Led Demo
1. Overview of HP Sprinter
2. Run manual test with Power Mode off, show Defect creation
3. Return to Quality Center and show details that are now attached to test entity
HP Sprinter
Activity Summary
Sprinter
Select the tests to run Run test with Sprinter, capture screens, use annotations Run test and open smart defect Modify Smart Defect settings Run another test with Sprinter, set up a defect reminder Launch Sprinter results viewer
HP Sprinter
1. If you are logged into ALM, log out of the project and close any open browser windows.
2. Start HP Sprinter by clicking on the shortcut on the desktop or from the Start menu. 3. Click on the HP ALM button (in the top right corner) to configure your HP ALM
4. In the HP ALM Connection window, enter your credentials to log into ALM. Begin by entering the Server information and then by entering the Domain and Project information. 5. To choose the tests you will run, click the Open button in the Run Setup area.
6. The Open window is a view of the Test Set tree. Expand the Root folder and any child folders until you see CIBC.com/Sanity Tests test set and the First Contact Website/Website Forms test set.
7. Expand CIBC.Com and then select all the tests by clicking on the checkbox beside each test. 8. Expand First Contact Website and then select all the tests by clicking on the checkbox beside each test.
HP Sprinter
9. When all the tests are selected, press the Open button. The tests will be displayed in the Tests List.
10. Review the steps in the test by clicking on the Steps link. Note: Just read the steps, DO NOT attempt to complete the steps.
HP Sprinter
4. Begin following the instructions in the Steps tool window. After completing step 1 click on the Pass Selected Steps button ( successfully. 5. Follow each step and complete the test. Remember to pass each step as you complete it. 6. When the test is complete, click on the End Run button from the Run Control tool bar. ) to indicate that the step was completed
7. When the main Sprinter screen is displayed, review the results by clicking on the Run Summary.
HP Sprinter
7. In the Defect Reminder window, type the following description: Verify the correct sequence on the page for the insurance products. 8. Click OK to save the Defect Reminder. 9. Complete the rest of the test. Remember to pass each step as you complete it. 10. When the test is complete, click on the End Run button from the Run Control tool bar. 11. When the Sprinter window appears, click on Defect Reminders (1) from the Results group. 12. Verify that the Defect Reminder is correct. 13. Click on Submit Defect.
. 14. Click Submit Defect again, and create a defect choosing any options. Remember to supply values for all the mandatory fields.
HP Sprinter Case Study 8|8
6. Click on the words No Value. When the link becomes an edit field, enter the payment amount calculated by the website.
7. Repeat the above step to enter the Total Interest amount. Part 2 Capture the screen image 8. Click on the Actual results button.
HP Sprinter
A screen capture of your current screen is displayed. 10. Using the Annotation Tools, select the rectangle and the color blue.
11. Draw a square around the Personal Loan Amount. 12. Click the Save to Actual Results button.
HP Sprinter
C a s e S t u d y 8 | 10
Part 3 Open a defect 16. You notice that the font colour should be green, not red. Open a defect by selecting the Smart Defect link.
Options
Check -- Current step Check -- Include last steps actual result information Check -- Current Screen Capture
18. In the Smart Defect Settings window, click Submit Defect. 19. In the New Defect window, select values for any mandatory fields (fields with red labels), and click OK. 20. Click on the End Run button from the Run Control tool bar. 21. When the Sprinter window appears, click on Steps (7) from the Results group. 22. In the list of steps, verify that Step 7 has the screen capture. (You may need to scroll to the right to see the Screen Capture column.)
HP Sprinter
C a s e S t u d y 8 | 11
7. Complete the steps for the first test. Remember to pass each step as you complete it. 8. In the Run control tool bar, select Next Test to advance to the next active test in the list.
9. Complete the steps for the second test. 10. When the test is complete, click on the End Run button from the Run Control tool bar.
HP Sprinter
C a s e S t u d y 8 | 12
HP Sprinter
C a s e S t u d y 8 | 13
HP Sprinter
C a s e S t u d y 8 | 14
When you run a test in Power Mode, Sprinter learns your applications display and identifies its objects. This information enables Sprinter to track your activity during your test run and perform some user actions for you on your application.
Create and run macros to allow Sprinter to perform a set of actions in your application for you. Automatically enter data into fields in your application. Replicate your user actions on multiple machines. Keep a record of your user actions. Add comments and reminders to the recorded user actions in your run, for later review. Keep a record of the defects you submitted for each action. Automatically include the list of your steps or user actions in any defect you submit to create a defect scenario for you.
Data Injection During the testing process, it is often necessary to enter pre-defined data into a form in the application being tested. To make the data entry process faster and less error-prone, data injection enables you to automatically enter data contained in an .xls, .xlsx, or .csv file (data set) into fields in your application. You can store data sets in your file system or in HP ALM. To store data sets in HP ALM, upload them to the Resources folder for your project. After you create the data set, you associate it with your application in the Data Injection pane of the main window. When you associate a data set with an application, it is available for use in any test that is configured to use the currently defined application. Macros A macro is a recorded action that can be placed within a given manual test in the form of a drop down menu. To record an action, click on the Start Recording button and initiate the actions you wish to take and then click on the Stop Recording button. The user will be asked to name the saved marco and it will be placed in a drop down menu for the user to pull out the next time the user runs with test with Sprinter.
Mirroring A common testing requirement is the need to test your application's compatibility with different computer configurations, and in the case of Web applications, with different browsers. Sprinter's Mirroring feature enables you to run your test simultaneously on multiple machines with different configurations. A test run with mirroring has a primary machine and secondary machines: Primary machine. The machine on which you manually perform all the user actions in your test. Secondary machine. The machines on which Sprinter replicates your user actions.
To run a test with Mirroring, you configure each of the secondary machines with the specific configuration you want to test. After you perform each user action on your primary machine, Sprinter replicates that user action on your secondary machines. When you configure your secondary machines, consider that Sprinter replicates your user actions the same way they were performed on your primary machine. You need to configure your secondary machines in such a way that there will not be a conflict between the actions that are performed on all the machines.
Instructor-Led Demo
1. Record and Run a macro
2. Data Injection
3. Mirroring
Activity Summary
Sprinter
Create a manual test from Sprinter Create and use a Sprinter Macro Use Sprinter Data Injection Run a manual test with Sprinter using Cross-Browser Mirroring
5. Navigate to the Test Lab module. 6. Create a folder called Vanguard Tests (that is Root > Vanguard Tests) and create a test set called Website.
7. Add the ETF Links test to the Website test set. 8. Logout of Quality Center. 9. Close the Quality Center window (and any other open browser). Part 2 Load the test with Sprinter 10. Launch HP Sprinter 11. Connect to your assigned project in Quality Center. 12. Click on the Open button.
13. In the Open window, expand the Root folder, followed by Vanguard Tests > Website. 14. Checkmark the (1) ETF Links test and click Open. Part 3 Add an Application 15. Ensure Power Mode is set to On.
17. Click on the Add button. 18. In the Add Application window, use the table below to fill the required information. Name: Type: URL: Browser: checked Vanguard Web Application www.vanguard.com Internet Explorer Start the application when the run begins
19. Click OK to close the Add Application window. Part 4 Run the tests and complete some ad-hoc steps 20. Click on the Run the active test button.
21. When the Vanguard website opens, complete the following steps: a) Click on Learn more about Vanguarding b) Click on each link from Mutual Funds to Personal Services c) Close Internet Explorer. 22. From the Run Control tab, click on the End Run button.
Part 5 View the User Actions 23. In the HP Sprinter window, click on User Actions.
24. From the User actions toolbar, select Export > Export to Excel.
25. Save the file as ETF Test Steps to the Desktop. 26. Close HP Sprinter. Part 6 Copy User Actions To Export Template 27. Open the ETF Test Steps file. 28. Modify the file as follows: a. Add a column and type Subject in the first row b. Starting in Row 2 of the Subject column, type Vanguard c. Add a column and type Test Name in the first row d. Starting in Row 2 of the Test Name column, type ETF Links e. Rename the value Action to Step Name (Design Steps) f. Rename the value Description to Description (Design Steps) g. Delete columns Time and Comment.
Part 7 - Export Data to Vanguard Project 29. Highlight all rows containing data except row 1. 30. Select Tools > Export to HP ALM. 31. Enter the URL and click Next. 32. Enter your username and password click Next. 33. Select your domain and project and click Next. 34. Ensure Tests is selected and click Next. 35. Select Temporary and click Next. 36. Click on the Map fields by label button.
37. In the Map Fields By Labels window, enter 1 and click OK.
38. Click on Export. 39. When the wizards displays the worksheet was successfully exported to ALM, click Finish. 40. Close the Excel files, save the changes. Part 8 Verify The Data Was Exported Successfully 41. Open ALM and login to your project. 42. Navigate to the Test Plan module. 43. Select the ETF Links test. 44. Select the Design Steps tab and verify the excel data was successfully exported into the test.
Part 2 Setup the Application in Sprinter 4. Click the Application link under Power Mode 5. Click the Add button to define a new Application in Sprinter
6. Using the following values: Name: Type: URL: Browser: CIBC Website (IE) Web Application www.cibc.com Internet Explorer Start the application when the run begins checkbox is checked
C a s e S t u d y 9 | 10
7. Press OK to save the Application definition 8. Ensure that the CIBC Website (IE) application is selected in the Application: list box. 9. Begin the test run by pressing the Run button Part 3 Record the Macro 10. Read the instructions for the Step 1 of the Branch Locator test carefully. DO NOT perform any actions yet, you will record them in a macro. Note: This is a good place to use a macro because it is a set of steps that are not essential to the outcome of the test and will have to be repeated for any test that evaluates the Branch Locator utility. 11. Click the Macros tab and click the pushpin icon to pin the tab open. 12. Press the Record Macro button to begin recording
13. Navigate to the CIBC Branch Locator pop-up applet by following the Suggested method: in the first step of the Branch Locator test Click on the Contact Us link in the top menu, enter M2N5W9 in the search field and press Find.
C a s e S t u d y 9 | 11
15. In the Macro Details window, enter Open Branch Locator M2N5W9 in the Name: field and press OK to save the macro.
16. Continue the Run and complete the remaining test Steps. Remember to pass each step. 17. Stop the test Run in the Run Control tab Part 4 Use the Macro in a test Run 18. Right click the Branch Locator test and select Replace with New Run 19. Press the Run button to begin a new test Run 20. Minimize the Steps tab 21. To complete Step 1 of the Branch Locator test, click on the Macros tab 22. Use the drop down list to select the Open Branch Locator M2N5W9 macro 23. Press the Run button to complete Step 1 of the test 24. Click on the green checkmark icon on the Macros tab to view the Macro Status details
C a s e S t u d y 9 | 12
26. Complete the test Steps 27. Stop the Run and close any open Browser windows.
C a s e S t u d y 9 | 13
C a s e S t u d y 9 | 14
10. In the Data Set Details dialog press the Browse button to open the Test Resources for your ALM project. 11. Expand out the Resources tree to locate the First Contact Staff Data for Contact Form data source
12. Select the data source and press Open 13. Press OK in the Data Set Details dialog to define the new data set Part 3 Begin the Test Run 14. Start the Run in Sprinter 15. Follow the test Steps until you reach the Contact Us form (complete Step 2) Part 4 Inject Data 16. Click on the Data Injection tab and press the pushpin icon to pin it open 17. Adjust the scroll of the browser so that the Submit button is visible. 18. Click the Display Field Mapping button on the Data Injection tab
19. Review where the spreadsheet data will be entered into the form (fields are highlighted in yellow) 20. Click on the yellow yield sign on the Data Injection tab to open the Data Injection Status dialog
C a s e S t u d y 9 | 15
Note: Not all of the columns in the spreadsheet can be matched to fields on the form, specifically the Street2 and Province columns do not have corresponding fields.
21. Close the Data Injection Status dialog 22. Press the Customize Fields button on the Data Injection tab
23. In the Customize Fields dialog un-check the Street2 and Province fields, as they are not needed for this form, and press OK to save the changes 24. Press the Display Field Mapping button again Note: This time a green check mark is displayed on the Data Injection tab 25. Select the line of data containing Milan Danrels contact information 26. Press the Inject Data button and wait for Sprinter to complete the form
Part 6 Complete the Test Run 27. Follow the remaining test Steps 28. Stop the test Run and close any open browser windows.
C a s e S t u d y 9 | 16
Pre-Discussion
You are on working on a Quality Center project that has a need to be able to run the same testcase against two different versions of the application which are slightly different, so that the testcases are slightly different too. For instance, you have completed Version 1 of the application, and the developers are enhancing the functionality in Version 2 of the application. Now you need to support testing of version 1 and version 2 of the application using the same test cases. How would you organize this in Quality Center?
You can create libraries in the Libraries module. After a library is created, you can create and compare baselines for the library to track changes in your project.
In the Libraries module, you can define a hierarchical libraries tree to create and manage your libraries. A library represents a set of entities in a project and the relationships between them. The entities in a library can include requirements, tests, test resources and business components.
After you create a library, you can create a baseline. A baseline is a snapshot of your library at a specific point in time. You can use a baseline to mark any significant milestone in the application development life cycle. A baseline includes all the entities defined in the library, including requirements, tests, and test resources. Baselines also include the relationships between the entities in the library, such as traceability and coverage. Baselines enable you to keep track of changes made to your project over time.
When you create a baseline for a library, you have a snapshot of the library at a specific point in time. Baselines enable you to keep track of changes made to your project over time. You can use baselines in the following ways: Compare two baselines to view the changes in a library at different stages of development. You can compare baselines at all stages of the application development life cycle. For example, you can compare two baselines in a library to review changes made to requirements in the library over time. You can also compare a baseline to the current entities in the library. Pin a test set to a baseline. This ensures that when you run the test set, Quality Center runs the versions of the tests stored in a baseline you specify. For more information, see Pinning a Test Set to a Baseline
Libraries and Baselines Case Study 10|3
Instructor-Led Demo
1. Create a Library and Baseline
2. Comparing Baselines
Activity Summary
Management
Create a Library Create a Baseline Making changes to Baseline Creating another Baseline Comparing Baselines
Test Lab
Pinning a Test set to a Baseline
5. In the Tests tab, select all the tests in the CIBC.com folder by checking the checkbox to the left of the folder.
6. Press OK to close the New Library window. 7. Select the library that was just created. 8. Click on the Create Baseline ( ) button
6. Make changes to the Learn More About Credit Cards test by adding two additional
4. Click OK to close the New Test Set window. 5. Add the Learn More About Credit Cards test to the Baseline test set.
6. Run the test and verify that the additional steps that you added in Activity 2 are not included in the list of steps
Version Control
Version Control
other users.
To make changes to an entity in a version control enabled project, you must first check out the entity. When you check out an entity, Quality Center locks the entity, preventing other users from overwriting any changes you make. The checked out version of the entity is not visible to
When you finish making changes, you check in the entity. The new version of the entity is then available to the other users. The default version number for a new entity is 1. Prior to Quality Center 10.00, version numbers consisted of three segments separated by periods, such as 1.7.4. From Quality Center 10.00, version numbers consist of a single segment, such as 12. When an entity is checked in, the version number is increased by one. When an entity is checked out, you can undo the checkout to cancel your changes. You can view all previous versions of an entity, or check out an earlier version. You can also compare two versions of an entity to view the changes between versions. Note: To maintain usability and data integrity, Quality Center stores previous versions of an entity without most data related to relationships between entities. The following data is not stored for previous versions: requirements and tests coverage, requirements traceability and defect linkage. In addition, risk data is also not stored for previous versions of an entity. You can view the list of all entities that you have checked out in your project. You can create and manage entities in a version control enabled project in both tree and grid views. In the tree view, an entity checked out by the current user is displayed with an open green lock icon. An entity checked out by another user is displayed with a red lock icon. Grid views contain additional version control fields, such as Version Status, indicating whether the entity is checked in or checked out.
Version Control
Instructor-Led Demo
1. Check out a test
Version Control
Activity Summary
Tests and Requirements
Check out a test Check in the Requirement and the Test Comparing two versions of the Test Check out a requirement
Version Control
2. Expand the Progressive.com requirements folder and select the Request a Homeowner
4. Under the Check out comments, type in Version 1 and click OK 5. Note the requirement now has an open green lock beside the requirement 6. Make changes to the requirement such as changing the field values or descriptions 7. Click on the Check In button ( ) and click OK in the Check In window
8. Repeat Steps 3 - 7 for three other requirements. Select one from the Navigation folder, one from the Report Claim and the other from the Site Search folder. Note: You will notice that the Version number has increased by 1
Version Control
5. Under the Check out comments, type in Version 1 and click OK 6. Make some changes to the test (for example the description or expected result) 7. Right click on the test and select Version > Check In
8. Using the steps above, make changes to three other tests (again for example the description or expected result)
Version Control
2. Expand the Progressive.com requirements folder and select a requirement (make sure Requirement details is selected under the View menu).
4. Holding down the CRTL button, select two versions and click on the Compare button
5. The Compare Entities Requirement window appears, review the changes that have been listed
Version Control
Activity 4 Challenge
1. Check out a test and make changes to it.
2. After checking it back in, try and revert back to the original test.
Version Control
Automated Tests
Automated Tests
Manual software testing is performed by a human sitting in front of a computer carefully going through application screens, trying various usage and input combinations, comparing the results to the expected behavior and recording their observations. Manual tests are repeated often during development cycles for source code changes and other situations like multiple operating environments and hardware configurations. An automated software testing tool is able to playback pre-recorded and predefined actions, compare the results to the expected behavior and report the success or failure of these manual tests to a test engineer. Once automated tests are created they can easily be repeated and they can be extended to perform tasks impossible with manual testing. Because of this, savvy managers have found that automated software testing is an essential component of successful development projects. Test planning involves deciding which tests to automate. If you choose to automate a test, you can generate a test script and run the test using WinRunner, QuickTest Professional, LoadRunner, or Visual API-XP.
Automated Tests
Instructor-Led Demo
3. View the test in Quality Center
1. Create an Automated test in QuickTest Pro 2. Add the automated test to Quality Center Project
4. Define the Host computer where the tests will be run. 5. Run an automated test
Automated Tests
Test Name
Login Create Order
Steps
1. Open the application home page 2. Enter your username and passwords 1. Select Create Order link 2. Enter data for a new order 3. Submit order and record the order number 1. Search for order number 2. Update the order details 3. Save the order 1. Click the logout link
Update Order
Logout
Automated Tests
12. Click the Run Test Set button. 13. Select the Run All Tests Locally checkbox 14. Click on the Run All button 15. Wait for the tests to run. When all the tests have a Status of Passed, the test execution is complete. 16. Close the Automatic Runner window.
Automated Tests
Automated Tests