E2E Execution Kick Off C3 Evolution Q3FY09 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 2 12/12 BAT Exit Review and Sign-Offs TCB (10/17-12/12) TCC (12/22-2/13) TCA (9/8-10/10) September November October BAT Planning Scenario Identification Stakeholder Reviews Execute BAT BAT Tester Identification 10/6 10/24 9/29 10/10 We are here Tester Identification 9/15 9/26 Execute UAT 1/05-2/6 2/13 UAT Exit Review and Sign-Offs December Stakeholder Reviews 11/17-12/5 January 10/20 11/6 QA Dry Run 11/7 11/18 Execute E2E 11/18 12/05 9/1 9/19 UAT Planning 10/20 11/7 11/10 11/28 Data Prep 10/27 10/31 Retest 12/1 12/5 Scenario Identification 11/10 11/21 C3 Evolution Business Testing Timelines Test Case Prep Detailed Validation 10/13 10/20 E2E Kick Off Meeting 10/10 SWT Scenario Identification 7/28 - 8/9 Detailed Scenario Review 10/20 E2E Logistics Meeting 11/17 11/17-11/21 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 3 E2E: Planning Steps 11/10-11/17 COMPLETE QA, IT, and Business Obtain availability confirmation from infra, crossflow systems, and testers. Logistics Preparation 11/7 11/18 COMPLETE QA with IT Support First pass of E2E testing to ensure stability QA Dry Run Testing 10/22-11/6 COMPLETE Business with QA and IT Support Test cases identified and imported into Quality Center Business to add test cases to QC 10/22 COMPLETE PMO with Business, Theaters, IT, and QA Final inventory of scenarios with detailed steps and supporting data Review detailed steps/data with the team 10/21-11/3 In Process Theaters Scenarios augmented with data elements Identify required test data 10/13-10/21 COMPLETE Business Tracks Detailed steps with data requirements called out for each scenario Validate/edit detailed scenario steps Successful E2E execution demonstrating a stable and high quality solution. Common understanding of the E2E execution logistics Calendar indicating when scenarios will be run Agree on high level inventory and approach Output 11/18-12/5 Business, with QA and IT Support E2E Execution 11/17 TODAY PMO with Business, Theaters, IT, and QA E2E Execution Kick Off Meeting 11/17 COMPLETE PMO with Business Support Schedule Scenario Executions 10/10 COMPLETE PMO with Business, Theaters, IT, and QA E2E Planning Kick Off Meeting Dates Owners Activity 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 4 E2E: Business Scenarios High Level Scenarios Create Warranty Contract for product purchase Transact Product Based Service (PBS) Order with Product Purchase Transact Service Order for Installed Uncovered Products Transact a combined AS & TS Service Transact a Renewal Order in CSCC Transact a Quarterly Sweep a: Manage Contract Data MMAT b: Manage Contract Data OCM Provide Technical Support
Scenario Variations Standard vs. Non standard deals Large $ quotes vs. small $ quotes Direct, 1-tier, 2-tier Multi-national quoting E2E Scenario Inventory and Execution Schedule: https://ework.cisco.com/Livelink/livelink.exe?func=ll&objId=33271126&objAction=browse&sort=name 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 5 E2E Scenario Inventory and Tracker https://ework.cisco.com/Livelink/livelink.exe?func=ll&objId=33271126&objAction=browse&sort=name Key Contacts Scheduling Information Step Status 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 6 Team E2E Execution Schedule Scenario M 11/17 T 11/18 W 11/19 R 11/20 F 11/21 M 11/24 T 11/25 W 11/26 R 11/27 F 11/28 M 12/1 T 12/2 W 12/3 R 12/4 F 12/5 1 2 3 4 5 6 7a 7b 8 E2E Scenario Inventory and Execution Schedule: https://ework.cisco.com/Livelink/livelink.exe?func=ll&objId=33271126&objAction=browse&sort=name 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 7 Team E2E Execution Schedule Teams M 11/17 T 11/18 W 11/19 R 11/20 F 11/21 M 11/24 T 11/25 W 11/26 R 11/27 F 11/28 M 12/1 T 12/2 W 12/3 R 12/4 F 12/5 MCBS 2, 5 2 2 2 2 2 1, 2 1 7b SO 3 5 5 4 6 6 7a 7a 2 QTC 4 3, 4 4, 5, 6 4 6 2 2, 7a 1, 7a 1, 2 2 SCME 4 5, 6 8 6, 7a 7a 2, 7a, 7b 2 1 2 TS 8 1 BI 6 4, 6 4 ODS 4 6 2 1 EDW 4 2 E2E Scenario Inventory and Execution Schedule: https://ework.cisco.com/Livelink/livelink.exe?func=ll&objId=33271126&objAction=browse&sort=name 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 8 E2E: Execution Logistics Handoffs Execution will begin at 8am each day and run to 4pm Once you have completed your step(s), please send an email to Evan Epstein, Carlos Diego, Paul Jandrisevits, and the tester(s) who will be performing the next step(s). In your email, please reference the steps you have completed and any relevant data you are passing downstream. If you encounter any blocking issue that will have a material impact on your ability to complete your step within the estimated time slot, please email Evan Epstein, Carlos Diego, Paul Jandrisevits, and the tester(s) who will be performing the next step(s) so they can be made aware of the issue.
Communications Running sametime conference throughout each day including all of the days key contacts to provide easy access to work through issues. E2E wiki will be updated with testing status throughout the day. Wiki updates will trigger email notifications to all subscribed users.
2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 9 E2E: Test Entrance and Exit Criteria 100% execution 90% pass rate Defects S1= 2 S2= 4 S3= 6 S4= 8 S5= 10
E2E Entrance Criteria (TCB) BAT and E2E (TCB) (Discovery) E2E Scenarios Defined Detailed Steps Validated Data Requirements Identified Test Cases Entered into Quality Center Scenarios Scheduled Key Contacts Identified Handoff, Status Tracking processes defined
2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 10 Useful Links End to End Testing Wiki: http://zed.cisco.com/confluence/display/CAWIKI/E2E+Testing
End to End Folder on Livelink: https://ework.cisco.com/Livelink/livelink.exe?func=ll&objId=33271126&objAction=browse&sort=name
End to End Scenario Inventory and Schedule: C3E E2E Master Scenario Inventory
Test Data Folder: https://ework.cisco.com/Livelink/livelink.exe?func=ll&objId=33336708&objAction=browse&sort=name
Quality Center Link: http://qualitycenter.cisco.com/qcbin/start_a.htm
Quality Center End to End Test Plan Path: ERMO Quarterly Releases\Q3FY09 Mar Release\C3 Evolution\3.Enterprise Test\TCB\E2E
Quality Center End to End Test Lab Path: ERMO Quarterly Releases\Q3FY09 - Mar Release\C3 Evolution (C3E)\3. Enterprise Test\TCB\E2E\C3E E2E
2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential 11