ENGINE Server Hardware Management and Monitoring Michel Stoecklin - SIM Project Pilot. SIM Beta 5 Novartis Implementation Regional participation Tests Plan Team Members.
ENGINE Server Hardware Management and Monitoring Michel Stoecklin - SIM Project Pilot. SIM Beta 5 Novartis Implementation Regional participation Tests Plan Team Members.
ENGINE Server Hardware Management and Monitoring Michel Stoecklin - SIM Project Pilot. SIM Beta 5 Novartis Implementation Regional participation Tests Plan Team Members.
Michel Stoecklin 1.0 The Unified Infrastructure Management Training Session 1 Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 2 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Agenda Introduction
Presentation
SIM Demo
Dedicated Scripts / Log files
Q/A Session Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 3 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Presentation contents
Why monitoring? How does it works? Keys benefits Current situation Project goal SIM Beta 5 Novartis Implementation Regional participation Tests Plan Team Members Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 4 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Why Monitoring?
In the current ENGINE environment, there is no more Global concept about Server Hardware Management and Monitoring like Insight Manager Console under GEM.
To pro-actively change the component before the failure occurs
Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 5 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! How does it works? Client Web browser ENGINE Desktop or Laptop Central Management server (SIM Server) Web Server Core Plug-in Web Server Instrumentation Managed ENGINE Server Graphical user interface (GUI) via web browser Secure access using the SSL protocol. No java required. RSC Members with full right to add site and maintenance (with script provided by GCC) Site or Server Administrators with limited right on their servers. SNMP protocol HTTPS protocol HTTPS protocol (SIM on port 50000) HTTPS protocol (SMH on port 2381) SQL Server Store information Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 6 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! How does it works? (Alert via e-mail) The server phchbs-s3000 has a disk drive failure HP Management agent detects this failure and sends a SNMP trap to the SIM Server
Systems Insight Manager receives this trap and sends an e-mail to the person responsible of this server Mr. Stoecklin receives the e-mail and repairs this server 1 2 3 4 On local node SNMP Trap Gateway Novartis (mail.novartis.com) Run to rescue his server Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 7 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Key Benefits Send Page Send E-mail Launch Script Send important event information to the right place at the right time Windows- Events received via SNMP Forward Alert Database Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 8 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Key Benefits
Detect potential hardware failures before they result in server downtime. Reduce time and effort associated with discovering, identifying, and collecting configuration data. Regional based (Save cost in Maintenance) Each local Administrator will see his Servers using the Internet Explorer browser. No SNMP changes are needed on currently installed ENGINE Servers. Regional reporting functionality Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 9 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Current Situation In the current ENGINE environment: There are no Global standards about Server Hardware Management and Monitoring in comparison to Insight Manager Console in GEM, A lot of different solutions are currently in place. Since the beginning of Engine Servers deployment, the SNMP Service and according settings as been implemented in our unattended installation process in order to guarantee a smooth integration of any future monitoring tool. Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 10 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Current Situation To secure the SNMP Protocol, The Option Accept SNMP Packets from these hosts is fullfilled by the following settings: Global_Console_01.novartis.net (for global monitoring purpose) 127.0.0.1 (local agent requirements) PHCHZZ_Mgt_Console_01.fa.novartis.net (local console for each site)
The local console for each site depends on the site code and the domain. In result, one site could implement several local console alias pointing on the same monitoring console (e.g. CHBS for Basel, Switzerland).
Server Alias ahchbs-s2001.eu.novartis.net AHCHBS_Mgt_Console_01.eu.novartis.net gpchbs-s3008.eu.novartis.net GPCHBS_Mgt_Console_01.eu.novartis.net phchbs-s1515.eu.novartis.net PHCHBS_Mgt_Console_01.eu.novartis.net phchbs-s3019.la.novartis.net PHCHBS_Mgt_Console_01.la.novartis.net phchbs-s3017.jp.novartis.net PHCHBS_Mgt_Console_01.jp.novartis.net phchbs-s3018.ap.novartis.net PHCHBS_Mgt_Console_01.ap.novartis.net Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 11 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Current Situation on Engine Servers Since the beginning of Engine Servers deployment, all Management Agents were available for installation using a Netinstall package.
The following versions were/are available: - 5.41 (retired) - 6.40 (retired) - 7.10 (retired) - 7.30 (New standard)
Since the last Engine Build, all Management Agents are installed by default on all Engine Servers (W2K/W2K3) based on Compaq/HP Proliant Hardware.
Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 12 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Project goal
The goal of this project is to define a Global Servers Management and Monitoring Standard for ENGINE Servers based on Systems Insight Manager from HP.
The main scope is to be able to manage and monitor the Worldwide Engine Servers Hardware Infrastructure based on HP Servers: Engine Servers, Engine Remote Insight Boards. Fin MS Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 13 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Site Local Console DNS Alias is allocated to the regional SIM Server. Alias list: PHCHBS_Local_Console_01.eu.novartis.net, CHCHNY_Local_Console_01.eu.novartis.net, PHDENU_Local_Console_01.eu.novartis.net, PHFRRU_Local_Console_01.eu.novartis.net,
SIM Beta 5 Novartis Implementation Systems Insight Manager na la eu ap jp 1 Global Management Server for reporting purpose novartis.net 5 Regions = 5 Management and Monitoring Servers, 5 SQL Servers (MOM) MOM Server or dedicated SQL Server CHBS Local Site Admin Monitor local Servers using IE browser CHLO CHST SNMP Protocol Each site has the default snmp settings and dns names allowing SIM server to monitor ENGINE Servers with HP Hardware Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 14 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation
Regional SIM Server will be managed by each Regional Service Center, and will collect all regional Engine Server Hardware information. The minimum requirement is one server in each region for the SIM Server.
The SQL DB for each SIM Server can be hosted on the following regional MOM SQL Server (for cost saving): Phsgsg-s3033.ap.novartis.net Phchbs-s3081.eu.novartis.net Phjpto-s3002.jp.novartis.net Phbrsp-s3030.la.novartis.net Phuseh-s3062.na.novartis.net Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 15 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation Proliant DL380G4 3.60GHz-2M Dual Processor 4 GB RAM 2 x 36.4 GB HDD (for System) For test purpose (pilot), a server with less capacity can be used. SIM Server Proliant DL380G4 3.6 GHz-2M 2P 4 Gb SDRAM 400 MHz RAID 1 configuration with two 36.4 Gb Hard drives for Operating System (Windows 2000 Server) using internal 6i SCSI Array Controller (channel 2) Dual Gigabit On-board With HPL RPS and DVD/CD-RW Combo Regional SIM Server Sizing for production phase Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 16 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation Alert Functionalities:
According to the questionnaire, two alerts will be provided by the Global Competence Center (template):
E-mail SMS Each site administrator will ask the RSC to receive e- mail when a trap fulfill his expectation. Each site administrator will ask the RSC to receive SMS when a trap fulfill his expectation. Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 17 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation Systems Insight Manager is tuned to implement ENGINE servers and RIB based on Active Directory. The next slide SIM Beta 5 Installation and Maintenance explain our implementation:
A first installation using an IQ (and common settings) Script to automate process and maintenance.
For each site, we use Active Directory to get information:
Server name and role.
Site Administrator (member of Admins_<Site Code>_A) can manage all ENGINE server and rib within his site.
Server Administrator (member of Admins_<Server Name>_A) can manage his ENGINE server and rib within his site.
Systems Insight Manager Beta 5 will be used for pilot region in order to provide a final version with Region and Site requirements (with documentation). Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 18 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation Requirements for the regional SIM Server :
The server must be an ENGINE server up and running with Windows 2003 SP1 (Standard Edition) with a RIB Board (correctly configured)
Ensure you have the HP SIM 5.0 software and the script files. (Source: \\phchzz-w00002\SIM$ ,execute Copy SIM Locally.bat after mapping the drive)
Ensure the SYS_MONITOR_RegionCode account has administrator rights for the Systems Insight Manager Server
You must have the password of the SYS_MONITOR_RegionCode account.
Ensure you have a SQL Server 2000 SP3 or later with Database Creators Right for SYS_MONITOR_RegionCode (temporary) and full right on the Database created for SYS_MONITOR_RegionCode (ad vitam) after the installation (Database name: Insight_v50)
Active Directory Read Right for SYS_MONITOR _RegionCode (Member of Pre-Windows 2000 Compatible Access in all domain)
The regional SIM Server must be registered in order to communicate with the SMTP backbone => Ticket to M&GW
Email address created in the GDDB for the Regional SIM Server email sender
Workstation with ENGINE 2.2 or later
Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 19 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation SIM Beta 5 Installation and Maintenance The installation will be done with an IQ and administration will be done with scripts detailed in Regional Manual (coming soon) provided by the Global Competence Center. The server must be a Generic ENGINE Server. Installation of Systems Insight Manager Requirements: ENGINE Server and SQL Server (MOM or Dedicaced) Initial settings E-mail server, SNMP, RSC Members Initial Site Configuration Site configuration Site Maintenance Apply changes automatically 1 2 3 4 Installation of Systems Insight Manager For each site added in Systems Insight Manager Use I.Q. : SIM Server installation.doc Use Region Manual : Region Manual.doc Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 20 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation 1/ Installation of Systems Insight Manager 2/ Initial settings The installation will be done with an IQ (including initial settings) to configure Systems Insight Manager with a regional Novartis customisation. Installation of Systems Insight Manager Requirements: ENGINE Server and SQL Server (MOM or Dedicated) 1 Initial settings E-mail server (SMTP), SNMP, RSC Members 2 Installation on an ENGINE Server Generic Server sizing up to 5000 nodes: Proliant DL380G4 3.6GHz-2M, Dual processors, 4Gb RAM SQL Server: MOM or dedicated server (sql server 2000 running on windows 2000 sp4) The RSC member installer will be the primary administrator Common settings for Systems Insight Manager: SMTP mail server gateway (mail.novartis.com), RSC Members administrators of Systems Insight Manager, task running automatically in Systems Insight Manager, special menu for Novartis administrators, toolbox for site administrators ... Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 21 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation 3/ Initial Site Configuration To add a new site in Systems Insight Manager, the Global Competence Center provides a tool to add automatically a site. We will describe the process: RSC manual configuration and script automatic configuration (all manual steps will be describe in a Regional Manual). Initial Site Configuration Site configuration 3 Set (or move) the right DNS alias <Organizational Unit><Country Code><Site Code>_Mgt_Console_01 (or 02).<DOMAIN> to point to the regional SIM Server (e.g. PHDENU_Mgt_Console_01.eu.novartis.net) and wait until the change takes effect.
If this alias is not set, SIM cant recognize and cant get traps from the server and will only do a ping request.
Select the correct menu (Novartis -> add site), select the SIM Server and write the site name.
Scan all subnets within the site to get ENGINE servers TCP/IP. Scan Active Directory to get ENGINE Servers. Compare AD-Subnet reply and add ENGINE Servers and RIB responding to ping Create Servers Groups and link with site administrators (members of Admins_<Site Code>_A) Link local administrators with servers (members of Admins_<Server Name>_A) Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 22 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation 4/ Site Maintenance
One tool is provided to maintain Systems Insight Manager and will do the following tasks (Novartis -> Maintenance Site): - Add new ENGINE servers and RIB - Refresh user rights (erase users authorization for the site and create a new and up to date administration rights for the site.) Site Maintenance Apply changes automatically 4 You have to schedule this task for each site (or region), depending on your requirements.
The maintenance will only erase user authorization for the site and will not change any other authorization. Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 23 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! SIM Beta 5 Novartis Implementation RSC Manual administration
The RSC will be in charge of the Systems Insight Manager manual task. It will include: Add a site and schedule the maintenance and three polling tasks for this site (Data Collection, Device Identification, Hardware Status Polling) Create alert for Site Administrators.
The RSC will be in charge of the Systems Insight Manager Server itself:
Adding plug-ing for specific regional requirements Adding Non-Engine Server for specific monitoring Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 24 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Regional participation For the pilot starting now, the following requirements are needed: An ENGINE Server with RIB Board configured, 3~5 sites with different size (users and servers), Participate actively, Plan integration of sites, Train site administrators Provide feedback to us (Tracking bug)
All members of this project will have access to the pilot interface and will participate in meeting and training sessions.
NB: Please make sure that you use the right server sizing when going to production/final phase.
Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 25 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Test Plan Software currently used for the Tests: Proliant Support Pack 7.3 SIM 5.0 Beta Add. Features: LDAP Authentication (SMH, RIB) RIB Trap config SMTP Alerts Other (tbd)
Final release will be based on: Proliant Support Pack 7.3 SIM 5.0 final version Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 26 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Test Plan 2-3 days Bug tracking Centra Session for open questions and formation Production phase Systems Insight Manager final version 2-3 weeks Starting in august Please send any feedback or question to:
- Anthony Wolf (anthony.wolf@novartis.com)
- Michel Stoecklin (michel.stoecklin@novartis.com) Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 27 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Documentation I.Q. : installation process and initialization.
Regional manual: Systems Insight Manager administration for Regional Administrators.
Site manual: Systems Insight Manager administration for Site Administrators.
FS-DS: Functional specification and Design specification.
Architecture: explain the architecture of Systems Insight Manager in our ENGINE domain.
Template for Site Administrator: to ask a new/modified/deleted alert Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 28 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Demonstration and Log files created by Novartis scripts Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 29 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Train yourself One test server is running and will be available for the next two weeks.
Server address: https://phchzz-sd118.fa.novartis.net:50000
Name Domain\User Name
Stu Yeh (AP) APNET\YEHST1 Fabio Groppo (LA) LANET\GROPPFA1 Mark Knouse (NA) NANET\KNOUSMA1 Jasper Findlay (NA) NANET\FINDLJA1 Ken Wu (JP) JPNET\WUKE1 Thomas Remy (EU) EUNET\REMYTH1 Erich Ganz (EU) EUNET\GANZER2
The password is the windows password. Project Member have full right on this Systems Insight Manager Server. Have fun playing with it
NB: Dont destroy it in the first hour Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 30 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Questions about the presentation ? Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 31 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Team Members Sponsor: Jean-Marie Rieth Project Manager: Michel Stoecklin Project Members: Anthony Wolf (GCC) Stu Yeh (AP) Fabio Groppo (LA) Mark Knouse (NA) Jasper Findlay (NA) Ken Wu (JP) Thomas Remy (EU) Erich Ganz (EU) Project Reviewer: Frdric Passeron (HP) Author: Michel Stoecklin File: SIM Project Pilot.ppt Page 32 Date: June 28, 2005 Disclaimer: these slides are not intended to be used as working instructions! Team Members Sponsor Jean-Marie RIETH Project Manager Michel Stoecklin Project Members - Anthony Wolf (GCC) - Thomas Remy (EU) - Erich Ganz (EU) - Mark Knouse (NA) - Jasper Findlay (NA) - Fabio Groppo (LA) - Stu Yeh (AP) - Ken Wu (JP) Quality Manager Roland Eichner Acceptance Team - Claude Fuchs Project Reviewer Frdric Passeron (HP)