You are on page 1of 16

Infrastructure Management

Monthly Report

May, 2009
Executive Overview
Status Trend IMStatus IPStatus
FINANCIAL MANAGEMENT PEOPLE MANAGEMENT

Status Trend CORE (Lights on ) BUSINESS Status Trend PROJECT DELIVERY


2009 Share Goal KPHC 99.85 2009 Shared Goal 85% On-time Delivery

Operations (Availability and Backup) On-time Rate Total # YTD Rate YTD Total #
Trends
IP&D 100% 6 87% 61

IS 100% 5 98% 56

DCS/NS 100% 1 100% 3

* Total 100% 12 92.5% 120

*
* 2008 12 Mo. Result 2
KPI Results for May
KPHC Availability: Target: 99.85%

KP.org Availability: Target: 99.8%


99.8 Target

3
Key Portfolio Business Accomplishments
Description Benefit

Care Delivery:
KP HealthConnect KP Health Connect
Completed OS upgrades in the Central Valley and Fresno Service areas to bring the In conjunction with the Shadow Read Write pilot the
OLTP up to the currently supported vendor levels. OS upgrade reduces the infrastructure outage time
Successfully completed Citrix 4.5 migration in the East Bay (NCAL) Service Area. from 3 hours 45 minutes to 1 hour 35 minutes,
significantly reducing the impact on end users.
Citrix 4.5 migration boosts KPHC performance and
helps resolve intermittent memory related problems.

Health Plans:
New California Membership Desktop (NCMD) replaces the aging Vantive call center NCMD delivery keeps the project on track to improve
system. PROD and DR environments were delivered, allowing user acceptance testing application and infrastructure reliability, call center
and production application loading to continue. representative efficiency, member feature and
The Fort Worth Consolidated Service Center (CSC) Functions were relocated to San satisfaction improvements.
Diego using an interim solution. The San Diego users are currently using the interim Function relocation allows the facility in Fort Worth to
solution while Denver users will come on line with the interim solution 4Q 2009. Initial be vacated before the lease is up. A solution is needed
tests completed, but revealed latency issues between data centers. (see Key that is outside Fort Worth.
Issues/Risks & Mitigation Plans).

Business Infrastructure:
eDiscovery project will install the PSS Atlas Litigation Hold, Custodian, Collection Ensures adherence to Federal and State eDiscovery
(LCC) application. UAT and Production environments were delivered, allowing testing to requirements. Mitigate risks of adverse judgments,
be completed and production application set up to continue. Excellent cooperation and sanctions, and damages in litigation matters and
innovation across IMG resulted in infrastructure being delivered on time and budget. government investigations by standardizing and
eCounsel project will move the application to a supported version and fix a number of enforcing defensible policy, procedure, process and
bugs in the current solution. The new Production environment was delivered to the control in accordance with amended Federal Rules of
application team. Civil Procedure (FRCP).
The eCounsel solution (Legal Applications
Consolidation) is a national application that provides
matter management and document management
functionality for the legal department.

4
Key Regional Business Accomplishments
Description Benefit

NCAL:
Genetics upgrade was successfully upgraded, converted and migrated from 16 MS Access Genetics applications are now in a secure and reliable
applications to the Shared SQL environment. web based application that meets our recovery
The Evaluation & Management (E&M) Audit project installed a new application server into standards.
NDC to support NCAL Encounter Information Operations. E&M applications are now in a secure and reliable
241 wireless carts went live in San Francisco on 5/16 for KPHC Inpatient Phase 2 web based application that meets our recovery
Cerner national project continues on schedule for NCAL with numerous server installs and standards.
Allows medical providers to utilize Health Connect at
updates.
the bedside, increasing patient safety and care.
Infrastructure upgrades and installations provide the
environments necessary for the Cerner team to meet
their implementation dates.

SCAL:
Regional Courier System (KPEX) went live on 5/13/09. It improves care by providing real- The KPEX project provides a FedEx alternative for
time data tracking of regional laboratory containers/specimens and addresses pharmacy internal intra-site deliveries from SCAL medical centers
chain-of-custody gaps via implementation of electronic signature capture. to regional laboratory or select MOBs and eliminates
the cost of courier cell phones.

ROCs:
McKesson POS system for Pharmacy went live at 8 MAS MOBs: West End, North Capital, The system collects payments and feeds into
Woodlawn, City Plaza, Townson, Annapolis, Silver Spring and Prince Georges. payment tracking and revenue cycle systems.

5
Key Operations Business Accomplishments
Description Benefit

IMG:
Service Oriented Architecture (SOA) data power appliance installations completed in IDC Groundwork prerequisite for enabling the SOA
and SSDC. applications and tools to go-live Q3 2009.
Completed continuous availability KPHC integration brokers server builds in NDC. Enabled testing for NCAL/SCAL continuous availability
program initiative.

Data Center Facilities:


Completed Power Balancing of 15 frames of P-Series Units in High Density areas and 4 This effort has allowed us to increase system capacity
cabinets of Blade Servers in Low Density areas at the Napa Data Center (NDC). This was a in these High and Low density areas, enabling us to add
coordinated effort across multiple Groups and BIOs. Work was completed ahead of schedule additional P-Series servers and Blade servers in these
and without incident or impact. environments.
YTD Data Center Facilities (DCF) has reduced it energy consumption an estimated .81% YTD we have reduced energy consumption an
from last year and is on track to reach its G&O target of a 2% total energy reduction for 2009. estimated 791,498 KWH at an estimated savings of
Current projections have DCF tracking at 2.06% by year end. $71,400. CO2 diverted thus far totals 688,603 lbs.

Network Services:
Managed Workstation Initiative Experience (MWIE) refresh project: Refreshed 24 servers in Prevents outages due to limited disk space on current
the SCAL and 5 servers in NCAL service areas. servers and eliminates End of Service Life (EOSL)
servers from the KP enterprise network.

Supplier Services Management (SSM):


Established Supplier Services Management (SSM) organization under Interim VP Eileen This is the first step in managing the business
McNamara-Raisch and defined the following functional areas: relationship with IBM and the outward face to IBM as
Contract Management, Administration and Change well as continuing to manage the ongoing services
Financial Management, Forecasting, Tracking & Benefits Realization delivered to the corporation
Demand Management Projects & Service Requests & Delivery Acceptance
Service Performance Benchmarking, & Customer Satisfaction
Governance, Process & Communications

6
Key (Mega) Core Projects
Project Current Status Planned Deliveries Status
End of Service Life (EoSL): Retirement and remediation of EoSL Wintel and Unix equipment. Original 1Q 2010: Completion of the
scope of 2094 servers. To date the EoSL program has completed the following: EoSL retirement and
98% (2,608 of 2,652) servers discovered (31 in May), 44 servers remain. remediation program for the
73% (1,921 of 2,652) servers remediated / due diligence completed (80 in May); 731 remain. servers defined to be in
scope.
Decommissioned 878 Servers; 48 Wintel and 1 Unix server in May.
2Q 2009 Projections;
Web middleware team created scripts to reduce the time to create WAS environments by
Remediations =250
approximately 40-50 hours versus doing the task manually. This can be used for all efforts needing WAS
Decommissions = 190
set up, not just EoSL.
2Q actuals: Remediations 234, Decommissions 150 , Total Completed 1,921. Total Completed = 1965

Print Fleet Management: Consolidates the purchases of all printers, copiers, faxes and multi-functional Y/E 2009: Realization of
devices and their associated consumables (less paper), break/fix maintenance, and support services planned annual Cost
under an external services management agreement to achieve improved device availability and Reduction Benefit. R
substantial cost reductions. Maintenance Conversion
Received funding and began planning for optimization of SCAL pilot at Woodland Hills Medical Center. scheduled for 8/1/2009
Inventory and data gathering completed at 20% of KP CA facilities. ROC inventories scheduled
Completed the GA data collection pilot. to be complete by 7/30/2009
Completed the ROC inventory and pilot optimization planning.
Continued re-planning the PFM Program structure, funding, and strategy to fit new criteria.

Telecom Expense Management (TEM): Implement TEM Wireless Self Service Portal and Wireline
Portal for Order Desk. 2009 target of reduction target of $2.1 million.
Completed the pilot and reported issues with eProcurement for mobile devices.
Loaded all AT&T invoices into EMS and began processing.
Loading remaining Telco invoices.
Submitted more than 50 claims to Telco vendors
Drafted support and admin guide
Closed out findings from last security audit

7
Key (Mega) Core Projects
Project Current Status Planned Deliveries Status

KP.Organize: Maintaining and sustaining the existing KP.Org legacy platform June:
Initiated an ITCAM (APACHE) monitoring proof of concept which is progressing ahead of schedule Complete Imperva/DMZ
Conducted analysis of Imperva/DMZ remediation; DMZ redesign is a prerequisite requirement remediation analysis
Initiated evaluation of Dual Data Center implementation Draft KP.org availability
measurement report

Irvine Data Center (IDC) - Circuit Consolidation Project: Consolidates existing circuits to fewer Phase 1 Scheduled for
PMM/PDU Pole positions. This will enable us to more efficiently utilize existing circuits and provide us 6/1-6/2
with the ability to expand our circuit capacity and accommodate future equipment commissioning at IDC. Phase 2 Scheduled for
This will mitigate the need to purchase additional pole position installations at premium cost from Savvis in 6/8-6/9
the future.

Corona Data Center (CDC) - UPS A & B Replacement Project: This work effort will replace the Mission ITAC to review 6/8/2009
Critical and obsolete UPS A & B system that provides uninterruptible power to our critical production CAC review scheduled for
systems. This End of Life work effort will mitigate current risks associated limited/unavailable parts and 8/17/09 pending ITAC
service availability. approval
Completed SBAR and Business Case to be submitted for Review by ITAC June 8, 2009

Configuration Management Data Base (CMDB) Phase 1: Establish Platform Credentials; install Y/E 2009: Deploy Platform
uCMDB, Application Dependency and Inventory Discovery Tools; Foundational Discovery of Napa & Credentials, CMDB
Corona CI's, Application Fingerprinting of KP.org, MyChart and CBORD; Integrate Remedy & Asset Center Application Discovery Tools, R
CMDB development on hold due to Hewlett Packard (HP) Services inability to deliver a design and Application Fingerprinting.
document that meets our specified requirements. Both parties have escalated concerns over lack of Deploy approved
progress and have been unable to reach agreement on content. Recent efforts to resolve differences Configuration Management
were unsuccessful. Procurement has been engaged to assess contract agreement termination options. Policy and Processes.
Inventory scanning (DDMi Project) for Intel devices is progressing as planned. However, in lieu of an
available CMDB, data is being sent directly to Asset Center.
Inventory scanning (DDMi project) has not begun in any region due to lack of required credentials.
Security Services estimates capability to support this requirement via a utility will be available in 3 6
months.

8
Key (Mega) Core Projects
Project Current Status Planned Deliveries Status

Innovation: June/July
Glycemic Control Algorithm Calculator (Innovator: Christine Olinghouse, RN): Project funded and Delivery of Psych Outcomes
undergoing kickoff. POC development in progress to automate manual calculation of insulin levels using Iteration 2
newly approved insulin infusion chart and java driven calculator. Completion of TeleDerm
FastAccess Radiant (Innovator: Dr. Daniel Navarro): Project will use SensibleVision's facial recognition development.
software to provide secure and fast login to Windows/Active Directory and KPHC's Radiant module. MWI Prepare Solution design, set
and NeoRad workstations in scope. May's accomplishments include: Securing MWI, NeoRad up of work stations, complete
workstations, MS SQL Server for POC, Radiant Hyperspace Environment set up, obtaining licenses and sizing and EA review for Fast
cameras, identifying engineering and technical support resources. Access Radiant project.
Psych Outcomes (Innovator: Dr. John Peters): Project automates patient self-assessment survey and Secure Hospital Capacity
provide real-time clinician's reporting toolkit. May's accomplishments include delivery of web-based GRID Funding and kickoff the
application, open source survey management tool, and real-time clinician reporting toolkit. project.
TeleDerm (Innovator: Dr. Yan Chow): National tele-dermatology platform project. Platform will provide Secure funding and kickoff 3
image handling and storage, communication and notification mechanisms between PCP and new projects with the
Dermatologists, and KPHC integration. May's accomplishments include ongoing development on web innovators.
based application and KPHC integration, preparation for regional leadership presentations.
Hospital Capacity GRID (Innovator: Peggy Sugar) POC completed on 4/27. Innovator applied for
Bridge funding in May to update functionality based on stakeholder feedback and improve UI.

9
Key (Mega) Investment Projects
Project Current Status Planned Deliveries Status

CarePoint: Deliver CarePoint 2.0 integrated with KPHC & KP.ORG, and Medicare Diagnosis June/July:
Refresh Infrastructure
Expanded Use Case definition underway. Revised initial delivery of CarePoint 2.0 requirements by architecture (design,
6/30/09 physical solution, costs)
necessary to support the
implementation of the
completed Use Cases.
Final analysis and
recommendations by 7/09
to solve current production
latency issues.

Citrix Upgrade: Complete KPHC Citrix 4.5 Host Builds on 1590 servers, complete Citrix 10.2 Client Q2 and Q3:
Upgrade to 192,991 Managed Workstations Completed the ICA 10.2
Client Upgraded a total of 21,000 workstation clients throughout the month, bringing cumulative client upgrades for
remaining 3% or
total to 213k or 97% of plan. approximately 6K
Server - Completed the CO Region and Exempla migration of the 4.5 upgraded servers on 5/26, workstations.
OH region 4.5 migration on 5/28. Completed SCAL migration (San Diego LMG) on 5/29. Developing Completed migration of
new server build imaging capability that could shorten project duration and pull all 4.5 migrations NW Radiant Radiology
back into 2009. Identified and provisioned 3 servers for NW to accommodate audio device driver users from Citrix Server
upgrades for Radiant Radiology (digital dictation and transcription). Completed installation of 25 3.0 to 4.5
Migrated servers for
blades in SSDC for dev/test environments for GA and MA.
NCAL-Central LMG

Corona Data Center (CDC) BMS Upgrade/Replacement Project: This project replaces an Scoping Phase 5%
outdated Building Maintenance System (BMS) that monitors & controls critical electrical & Complete
mechanical systems. A failure of the BMS could potentially take the cooling system off-line and Kickoff Meeting held with
impact cooling to critical production systems. Infrastructure Factor
Business case prepared. SBAR and Business
Case to be submitted
upon completion of project
Scope

10
Key Core and Investment Project Issues / Risks & Mitigation Plans
Issues / Risks Mitigation Plans
Citrix Upgrade: Citrix Upgrade:
Client: Double log in, a second set of verification credentials before Register key change implemented to disable pre-fetch resolving
being granted access to KPHC. issue.

End of Service Life: End of Service Life:


Delays in implementing required infrastructure capacity Creating itemized list of items needed in all data centers, escalating
No MQ Series Shared Service in the strategic data centers to Elizabeth Burneko to manage the work, and special ordering
Obtaining approval to order new EOSL frames for needed EOSL
missing equipment needed to meet the capacity needed.
capacity in yellow status. Timeframe to get new frames fully installed Create MQ Series capacity for EOSL requirements on EOSL

and VIO servers set up is significant, the sooner ordered the better acquired frames.
Analysis showed no internal capacity available to meet need.
Currently developing list of which apps/servers that will migrate to
each frame to submit in order to obtain approval

Health Plans: Health Plans:


Fort Worth Consolidated Service Center Plan testing shows a Working with IBM to identify a new long term solution and develop
latency between data centers making the recommended solution detail testing and deployment plan by July.
impractical.

Telecom Expense Management: Telecom Expense Management:


Vendors are not acknowledging our claims. For example, AT&T has Using KP legal with the vendors who delay issuing the credits.
acknowledged 1 of our 17 claims.

Print Fleet Management: Print Fleet Management:


Benefits not delivered to plan due to insufficient stakeholder buy-in, Transition PFM program to Procurement and Supply and revise
cost over-runs, contract compliance and inaccurate inventories. plan.

Configuration Management Data Base (CMDB): Configuration Management Data Base (CMDB):
CMDB development on hold due to Hewlett Packard (HP) Services Escalated concerns over lack of progress and inability to reach
inability to deliver a design document that meets our specified agreement on content to management. Procurement has been
requirements. engaged to assess contract agreement termination options.
Inventory scanning (DDMi project) has not begun in any region due Interim manual solution carries extreme risk and is not considered a
to lack of required credentials. viable option. Security Services estimates capability to support this
requirement via a utility will be available in 3 6 months. 11
Key Projects: IT Infrastructure Strategy Program (ITIS)

12
Key Projects: IT Infrastructure Strategy Program (ITIS)

13
Key Projects: IT Infrastructure Strategy Program (ITIS)

14
Key Projects: IT Infrastructure Strategy Program (ITIS)

15
Key Projects: IT Infrastructure Strategy Program (ITIS)

16

You might also like