Professional Documents
Culture Documents
Deployment Guide Series: IBM Tivoli Composite Application Manager for Web Resources V6.2
Manage Web application server resource performance Extensive deployment and usage scenarios Solution development guide included
ibm.com/redbooks
International Technical Support Organization Deployment Guide Series: ITCAM for Web Resources V6.2 January 2008
SG24-7485-00
Note: Before using this information and the product it supports, read the information in Notices on page vii.
First Edition (January 2008) This edition applies to Version 6, Release 2, Modification 0 of IBM Tivoli Composite Application Manager for Web Resources (product number 5724-S32).
Copyright International Business Machines Corporation 2008. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
Contents
Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix The team that wrote this book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix Become a published author . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x Comments welcome. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x Part 1. Planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 Chapter 1. Solution introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.1 Application server monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.2 ITCAM for Web Resources features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.3 ITCAM for Web Resources value propositions . . . . . . . . . . . . . . . . . . . . . . 5 1.4 Architecture and interconnection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.4.1 J2EE and WebSphere data collectors . . . . . . . . . . . . . . . . . . . . . . . . 6 1.4.2 Tivoli Enterprise Monitoring Agent . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Chapter 2. Solution environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.1 Hardware prerequisites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2.2 Software prerequisites. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.2.1 WebSphere agent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 2.2.2 J2EE agents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 2.2.3 Web server agents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 2.3 Sizing consideration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 2.4 Typical deployment environments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 2.4.1 Demonstration or proof of concept . . . . . . . . . . . . . . . . . . . . . . . . . . 20 2.4.2 Small and medium environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 2.4.3 Large and very large environment . . . . . . . . . . . . . . . . . . . . . . . . . . 22 Chapter 3. Project planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 3.1 Required skills . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 3.2 Solution description and assumptions. . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 3.3 Task breakdown . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 3.3.1 Project kick off. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 3.3.2 Environment preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 3.3.3 IBM Tivoli Monitoring setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 3.3.4 Application support files installation . . . . . . . . . . . . . . . . . . . . . . . . . 28 3.3.5 Agents and data collectors setup . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
iii
3.3.6 Customizing the product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 3.3.7 Demonstrating the solution and skill transfer . . . . . . . . . . . . . . . . . . 29 Part 2. Deployment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Chapter 4. Installation and configuration . . . . . . . . . . . . . . . . . . . . . . . . . . 33 4.1 Installation overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 4.2 Installing application support files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 4.3 Installing the Tivoli Enterprise Monitoring Agent . . . . . . . . . . . . . . . . . . . . 44 4.4 Installing the data collector . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 4.4.1 Setting up the application server . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54 4.4.2 Installing the base data collector version 6.1 . . . . . . . . . . . . . . . . . . 54 4.4.3 Applying Fix Pack 1 and interim Fix 4 . . . . . . . . . . . . . . . . . . . . . . . . 61 4.4.4 Configuring data collectors in the application servers . . . . . . . . . . . . 62 4.5 Verifying the installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Chapter 5. Scenarios. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 5.1 Usage scenario overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 5.2 Using the workspaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 5.3 Defining application health and baseline. . . . . . . . . . . . . . . . . . . . . . . . . . 84 5.4 Working with situations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90 Chapter 6. Troubleshooting hints and tips . . . . . . . . . . . . . . . . . . . . . . . . 101 6.1 IBM Tivoli Monitoring logging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102 6.2 ITCAM for Web Resources logs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102 Part 3. Appendixes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105 Appendix A. The Trader application . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107 Application components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108 Front-end J2EE Web application . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109 Back end implementation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112 Back end J2EE server. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112 Software requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113 Installation procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113 Initial setup for the demonstration server . . . . . . . . . . . . . . . . . . . . . . . . . 114 DB2 database creation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 WebSphere server installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 WebSphere client installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115 Appendix B. Sample statement of work . . . . . . . . . . . . . . . . . . . . . . . . . . 117 ITCAM for Web Resources implementation service. . . . . . . . . . . . . . . . . . . . 118 Executive summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118 Solution description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118 Assumptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
iv
Business partner responsibilities. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 Client responsibilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 Staffing estimate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120 Project schedule and milestones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120 Testing methodology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120 Deliverables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120 Completion criteria . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120 Appendix C. Additional material . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121 Using the Web material . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121 System requirements for downloading the Web material . . . . . . . . . . . . . 122 How to use the Web material . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122 Abbreviations and acronyms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123 Related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125 IBM Redbooks publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125 Other publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125 Online resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126 How to get IBM Redbooks publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127 Help from IBM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127 Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
Contents
vi
Notices
This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service. IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A. The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice. Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk. IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental. COPYRIGHT LICENSE: This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs.
vii
Trademarks
The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both: Redbooks (logo) developerWorks z/OS AIX CICS DB2 Universal Database DB2 IBM IMS MVS Netcool OMEGAMON Redbooks System p System x System z Tivoli Enterprise Tivoli WebSphere Workplace
The following terms are trademarks of other companies: SAP NetWeaver, SAP, and SAP logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries. Oracle, JD Edwards, PeopleSoft, Siebel, and TopLink are registered trademarks of Oracle Corporation and/or its affiliates. EJB, Java, Java Naming and Directory Interface, JDBC, JDK, JMX, JSP, JVM, J2EE, J2SE, Solaris, Sun, Sun Java, and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows Server, Windows, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Intel, Itanium, Intel logo, Intel Inside logo, and Intel Centrino logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.
viii
Preface
This book is written as part of the deployment guide series. It provides a step-by-step guide for deploying IBM Tivoli Composite Application Manager (ITCAM) for Web Resources V6.2. This deployment guide will help an IBM Business Partner or service person plan and perform the deployment of the product. The discussion on ITCAM for Web Resources describes product architecture and components, planning and sizing considerations, and guidelines on setting up service engagements. Although the information is highly relevant for larger deployment engagements, it is also suitable for a small deployment system. The extensive deployment and usage scenarios can also help you demonstrate the product.
ix
Manager, IBM Tivoli Identity Manager, Altiris Client Management Suite, BMC Control-M for z/OS, and BMC Control-D for z/OS. He holds a Bachelors degree in Mathematics from Faculdade de Filosofia Cincias e Letras de Santo Andr. He is Tivoli Certified Consultant for Tivoli Storage Manager and IBM Certified Deployment Professional for Tivoli Monitoring V5.1.2. Thanks to the following people for their contributions to this project: Dorothy Wu IBM developerWorks, Silicon Valley Lab Terry Copeland IBM Software Group
Comments welcome
Your comments are important to us! We want our books to be as helpful as possible. Send us your comments about this book or other IBM Redbooks publications in one of the following ways: Use the online Contact us review form found at: ibm.com/redbooks Send your comments in an e-mail to: redbooks@us.ibm.com
Mail your comments to: IBM Corporation, International Technical Support Organization Dept. HYTD Mail Station P099 2455 South Road Poughkeepsie, NY 12601-5400
Preface
xi
xii
Part 1
Part
Planning
This part discusses planning information for deploying IBM Tivoli Composite Application Manager (ITCAM) for Web Resources V6.2.
Chapter 1.
Solution introduction
This chapter introduces the solution based on IBM Tivoli Composite Application Manager (ITCAM) for Web Resources V6.2. This chapter includes the following topics: Application server monitoring on page 4 ITCAM for Web Resources features on page 4 ITCAM for Web Resources value propositions on page 5 Architecture and interconnection on page 5
ITCAM for Web Resources uses Tivoli Enterprise Portal as its primary interface. This allows a common user interface for data and events integration with other Tivoli Enterprise Portal-based solutions from IBM Tivoli Composite Application Manager, IBM Tivoli Monitoring, and IBM Tivoli OMEGAMON to provide comprehensive management of business applications.
The application servers run the data collector, which is a collecting agent that runs in the application server and sends monitoring information, using Tivoli Enterprise Monitoring Agent, to the Tivoli Enterprise Monitoring Server. These data collectors operate independently of each other. Figure 1-1 shows the overall architecture of ITCAM for Web Resources.
The product consists of two main parts: the data collectors and the Tivoli Enterprise Monitoring Agents. A data collector agent runs on each monitored J2EE application servers and communicates with the Tivoli Enterprise Monitoring Agent. The Tivoli Enterprise Monitoring Agent sends the performance information to Tivoli Enterprise Monitoring Server for display on Tivoli Enterprise Portal.
Data collectors are configured as a multi-threaded process. They consist of the following agents: Command agent: The command agent collects requests from other components for information about EJB invocations, database connection pools, thread pools, stack traces, memory analyses, and heap dumps. Event agent: The event agent provides data to the publish servers according to polling frequencies. This data includes system initialization data, application request-level data, and application method-level data. Collector process: The collector provides the monitoring data for Tivoli Enterprise Portal. It collects WebSphere Application Server and other J2EE application server performance metrics. This component communicates with Tivoli Enterprise Monitoring Agent using a TCP/IP port. The data collectors send probes into the application servers to analyze the applications performance. The probes collect monitoring data and feed it to transport routines for Tivoli Enterprise Monitoring Agent. This relieves the processing burden of ITCAM for Web Resources from the application servers as much as possible. The data collectors and probes are not designed to analyze or interpret data. They collect and route such data to Tivoli Enterprise Monitoring Agent. The data sources used by the ITCAM for Web Resources data collector are: JVMTI garbage collection data, method trace, stack trace, CPU time, and heap dump. jJMX system resources. PMI system resources (WebSphere only). OS services, platform CPU, and its environment. Byte Code Instrumentation (BCI) for some classes.
The data collector in the J2EE server runs as a custom service called am. Figure 1-2 shows the WebSphere data collector structure.
WebSphere
JVMTI JMX PMI
BCI
Custom Service am
KYN
To TEMS
Chapter 2.
Solution environment
This chapter discusses the required environment for implementing ITCAM for Web Resources V6.2. The topics are: Hardware prerequisites on page 10 Software prerequisites on page 11 Sizing consideration on page 14 Typical deployment environments on page 20
a. Memory requirement is range based on the processing needs. The low end is for around 100-200 monitoring agents, while the high end is for around 500-1000 monitoring agents. b. The data size of Tivoli Data Warehouse depends on the size of data for each attribute groups. For each attribute groups, you need the number of detailed records per day, the data size per record, and the aggregation policy. See the Tivoli Monitoring Information Center at: http://publib.boulder.ibm.com/infocenter/tivihelp/v15r1/topic/com.ibm. itm.doc/itm_install65.htm#estimate
The hardware requirement for IBM Tivoli Monitoring servers is discussed in detail at: http://publib.boulder.ibm.com/infocenter/tivihelp/v15r1/topic/com.ibm.i tm.doc/itm_install61.htm#hardware
10
For more information about configuring IBM Tivoli Monitoring servers, see Deployment Guide Series: IBM Tivoli Monitoring 6.1, SG24-7188. Specifically for ITCAM for Web Resources, the agents have additional requirements for memory and disk spaces. These additional requirements are on top of any existing hardware requirement for the supported monitored environment. These monitored environments are listed in section 2.2, Software prerequisites on page 11. Table 2-2 lists the minimum and recommended memory and disk requirements.
Table 2-2 Requirements Resource Additional memory Additional disk space (monitoring agent) 100 MB 512 MB 100 MB Additional disk space (data collector) 330 MB 1 GB -
128 MB 512 MB -
For the most up-to-date prerequisites, see the following Information Centers: For WebSphere agents: http://publib.boulder.ibm.com/tividd/td/ITCAMWRWAS/prereq62/en_US/HT ML/itcam6.html For J2EE agents: http://publib.boulder.ibm.com/tividd/td/ITCAMWRJ2/prereq62/en_US/HTM L/itcam6.html For Web server agents: http://publib.boulder.ibm.com/tividd/td/ITCAMWRWServers/prereq62/en_ US/HTML/itcam6.html
11
12
AIX 5.2 or 5.3 Solaris 8, Solaris 9 cluster, and Solaris 10 HP-UX 11.iv1 32-bit on PA-RISC platform HP-UX 11.iv2 (32-bit and 64-bit) on PA-RISC and Itanium RHEL 4.0 and 5.0 on System x and System p SLES 9 and SLES 10 on System x and System p Note: For operating system specific requirements and J2EE application server levels and Java Runtime Environment versions, see the prerequisites page at: http://publib.boulder.ibm.com/tividd/td/ITCAMWRJ2/prereq62/en_US/HTM L/itcam6.html The following J2EE container servers are supported: SAP NetWeaver 04 SR1 Oracle 9i Application Server R2 (9.0.3) - 32bit only Oracle 10i Application Server R2 (10.1.2) - 32bit only J2SE (standalone Java applications) WebLogic Server 8.1 SP5 (32-bit only) WebLogic Server 9.1 (64-bit support for only AMD64 and EM64/T) JBoss Application Server 3.2.7 JBoss Application Server 4.0.3 SP1 TomCat 5.0.28 TomCat 5.5.12
Microsoft Internet Information Server Web Server 6.0 on Windows Server 2003 (Standard) SP1 Sun Java System Web Server 6.1 on the following operating systems: Windows Server 2003 (Standard) AIX 5.2 (32-bit and 64-bit) Solaris 9 (32-bit and 64-bit) must apply SP6 on the Web server
13
HP-UX 11iv1 (32-bit and 64-bit), only for PA-RISC and Itanium 2
KYNPREV KYNAPSST KYNLOGANAL KYNAPSRV KYNCONTNR KYNEJB KYNCNTROP KYNAPP KYNSERVLT KYNTRANS KYNCACHE KYNCACHT KYNJ2C KYNSERVS KYNTHRDP
WebSphere Agent Events Application Server Status Log Analysis Application Server EJB Containers Enterprise Java Beans Container Object Pools Web applications Servlets and JSPs Container Transactions Dynamic Cache Dynamic Cache Templates J2C Connection Pools Servlet Sessions Thread Pools
1 record for each product event. These records are written when problems occur. 1 record per interval per server instance 1 record per interval for each entry written into the application server log stream or file 1 record per interval per application server 1 record per interval per application server, plus 1 record per interval per EJB container 1 record per interval for each EJB method 1 record per interval per application server, plus 1 record per interval per EJB container 1 record per interval per Web application 1 record per interval per servlet 1 record per interval per application server plus 1 record per interval per EJB container 1 record per cache per cycle 1 record per cache template per cycle 1 record per J2EE connection pool per cycle 1 record per servlet session per interval 1 record per thread pool per interval
14
Table name
Object name
Size in bytes 592 632 732 616 656 1468 1240 1156 852 976 1096 1388
Recording frequency
KYNWLMCL KYNWLMSR KYNGCACT KYNGCAF KYNGCCYC KYNREQUEST KYNREQSEL KYNDATAS KYNJMSSUM KYNREQHIS KYNDBCONP KYNDCMSG
Workload Management Client Workload Management Server Garbage Collection Analysis Allocation Failure Garbage Collection Cycle Request Analysis Selected Request Datasources JMS Summary Request times and rates DB Connection Pools Data Collector (DC) Messages WebSphere Distribution and Consistency Services (DCS) Stack High Availability Manager Web Services Gateway
1 record per Workload Management (WLM) client per interval 1 record per WLM server per interval 1 record per interval per application server 1 record per interval for each allocation failure block 1 record per garbage-collection cycle per interval 1 record per interval for each workload in each application server 1 record per interval for each workload degradation in each application server 1 record per interval per data source in each application server 1 record per interval per MQ queue in each application server 1 record per interval per WebSphere Application Server 1 record per datasource per interval plus 1 record per application server per interval 1 record per each entry written into DC log message file 1 record per DCS stack per interval plus 1 record per application server per interval 1 record per application server per interval 1 record per Web Services Gateway per interval plus 1 record per application server per interval
KYNDCSSTK
1032
KYNHAMGMT KYNWEBSGW
724 968
15
Table name
Object name
Size in bytes 1004 980 1000 1220 1504 1004 972 1040 1752
Recording frequency
Web Services Alarm Manager Scheduler Client Communications Durable Subscriptions Messaging Engine Communications Messaging Engines Queue Service Component Elements Service Components Topic Spaces WMQ Client Link Communications WMQ Link Communications Workplace Mail Service Workplace Mail Queues Workplace Mail IMAP/POP Portal Summary Portal Page Summary
1 record per Web Service per interval plus 1 record per application server per interval 1 record per Work Manager per interval plus 1 record per application server per interval 1 record per Scheduler per interval plus 1 record per application server per interval 1 record per application server per interval 1 record per Durable Subscription per interval 1 record per application server per interval 1 record per Messaging Engine per interval plus 1 record per application server per interval 1 record per Queue per interval 1 record per Service Component Element per interval plus 1 record per application server per interval 1 record per Service Component plus 1 record per application server 1 record per Topic Space per interval 1 record per application server per interval 1 record per application server per interval 1 record per application server per interval 1 record per Mail Queue per interval 1 record per protocol (IMAP/POP) per interval 1 record per application server per interval 1 record per Portal Page per interval plus 1 record per application server
16
Table name
Object name
Recording frequency
Portlet Summary Application Health Status Application Monitoring Configuration Requests Monitoring Configuration Baseline
1 record per portlet per interval plus 1 record per application server 1 record per interval per application for each application server Not historical table Not historical table Not historical table
17
Table name KYJGCCYC KYJJCACP KYJJDKJVM KYJJDKMEM KYJJDKOS KYJJDKTHR KYJJMSSUM KYJJTARES KYJLOGANAL KYJPREV KYJREQHIS KYJREQSEL KYJREQUEST KYJRQMONCF KYJSDBCON KYJSEJB KYJSERVLT KYJSJTASUM
Object name Garbage Collection Cycle - J2EE JCA Connection Pools J2EE JDK - JVM JDK - Memory JDK - Operation System JDK - Threading JMS Summary - J2EE JTA Resources - J2EE Log Analysis - J2EE J2EE Agent Events Request times and rates - J2EE Selected Request J2EE Request Analysis J2EE Requests Monitoring Configuration DB Connection Pools NetWeaver Enterprise Java Bean Service - NetWeaver Servlets and JSPs J2EE JTA Summary NetWeaver
Size 784 1016 1732 724 1484 1224 960 960 1068 704 976 1368 1184 n/a 972 1152 972 708
Recording frequency 1 record per garbage collection cycle per interval 1 record per JSR77 JCA resource per interval plus 1 record per application server 1 record per interval for each application server 1 record per interval for each application server 1 record per interval for each application server 1 record per interval for each application server 1 record per interval per MQ queue in each application server 1 record per JSR 77 JTA Resource per interval plus 1 record per application server 1 record per interval for each entry written into the application server log stream or file 1 record for each product event. These records are written when problems occur. 1 record per interval per J2EE server 1 record per interval for each workload degradation in each application server 1 record per interval for each workload in each application server Not historical table 1 record per DB connection pool per interval plus 1 record per application server 1 record per EJB per interval plus 1 record per application server 1 record per interval per servlet 1 record per application server per interval
18
Object name Web Container NetWeaver Web applications J2EE J2EE Connector Connection Pools WebLogic JDBC Connection Pools - WebLogic Enterprise Java Beans - WebLogic Enterprise Java Bean Components WebLogic JMS Sessions WebLogic Java Transaction Service - WebLogic Servlets and JSPs WebLogic Web Applications WebLogic
Recording frequency 1 record per application server per interval 1 record per interval per Web application 1 record per J2C connection pool per interval plus 1 record per application server 1 record per JDBC connection pool per interval plus 1 record per application server 1 record per EJB per interval plus 1 record per EJB component, plus 1 record per application server 1 record per EJB component per interval plus 1 record per application server 1 record per JMS session per interval plus 1 record per application server 1 record per application server per interval 1 record per Servlet or JSP per interval plus 1 record per Web Application, plus 1 record per application server 1 record per Web Application per interval plus 1 record per application server
KYJWLDBCON KYJWLEJB
900 1176
KYJWLEJBC
968
KYJWLWEBAP
1296
Table 2-5 lists the sizing list for Web server agents.
Table 2-5 Historical data sizing information for Web server agent Table name KHTAWEBSR KHTAWEBST KHTEVNT KHTIWEBSR KHTIWEBST Object name Apache Web server Apache Web sites Web Servers Agent Events Web server Web sites Size 1056 984 616 928 1528 Recording frequency 1 per interval per server 1 per interval per site Depends on messages count from Tivoli Enterprise Monitoring Agent (TEMA) 1 per interval per server 1 per interval per site
19
Object name Sun Web server Sun Web sites Web Servers status
Recording frequency 1 per interval per server 1 per interval per site 1 per interval
20
DB2 Data Warehouse Monitoring Server Portal Server Warehouse Proxy Sumarization and Pruning
TEMA
TEMA
TEMA
TEMA
The configuration in Figure 2-1 consists of: A single server running DB2 Universal Database for Tivoli Data Warehouse and Tivoli Enterprise Portal Server database, End-user Response Time Dashboard agent, Tivoli Enterprise Monitoring Server, Tivoli Enterprise Portal Server, and Warehouse Proxy. The Summarization and Pruning agent is not configured because the system is not around for a long period of time. Various agents, such Tivoli Enterprise Monitoring Agent (TEMA), running on application server machines to monitor application server performance.
21
Remote TEMS
Remote TEMS
Remote TEMS
TEMA
TEMA
TEMA
TEMA
TEMA
TEMA
The small and medium environment shown in Figure 2-2 includes: A specialized hub Tivoli Enterprise Monitoring Server and Tivoli Enterprise Portal Server. A separate machine for handling Tivoli Data Warehouse with Warehouse Proxy, Summarization and Pruning Agent. Remote Tivoli Enterprise Monitoring Server handling agent communication from different sites, instead of directly from the hub Tivoli Enterprise Monitoring Server.
22
DB2 database
Portal Server
Remote TEMS
Remote TEMS
Remote TEMS
TEMA
TEMA
TEMA
TEMA
TEMA
TEMA
In Figure 2-3, the configuration includes: Separate servers for: Tivoli Data Warehouse database Hub Tivoli Enterprise Monitoring Server (2 servers) Tivoli Enterprise Portal Server Warehouse proxy and Summarization and Pruning agent
23
24
Chapter 3.
Project planning
This chapter discusses project planning information to help you deploy ITCAM for Web Resources V6.2. The topics are: Required skills on page 26 Solution description and assumptions on page 26 Task breakdown on page 27
25
26
27
For IBM Tivoli Monitoring, you must install the following components: Tivoli Enterprise Monitoring Server Tivoli Enterprise Portal Server Warehouse Proxy Summarization and Pruning Agent (not needed for demonstration or proof of concept installation) For more information, see Deployment Guide Series: IBM Tivoli Monitoring 6.1, SG24-7188.
28
Remote deployment of agent using the operating system agent that is already installed. Or, if there is no other option, you can also run the GUI installation wizard on the machine.
29
30
Part 2
Part
Deployment
This part describes scenarios related to the actual deployment and usage of ITCAM for Web Resources V6.2.
31
32
Chapter 4.
33
34
srv177
WebSphere Application Server ITCAM for Web Resource data collector ITCAM for Web Resource WebSphere TEMA
srv178
Tivoli Enterprise Monitoring Server Tivoli Enterprise Portal Server Tivoli Enterprise Portal
35
3. Click Next on the Welcome window. 4. ITCAM for Web Resources requires a specific version of IBM GSKit and IBM Java. Verify if the required versions of IBM GSKit and IBM JAVA are installed and click Next, as shown in Figure 4-2.
5. Click Accept on the software license agreement. 6. In the Select Features window (Figure 4-3 on page 37), uncheck Tivoli Enterprise Monitoring Agents because you are not installing the agent on this server, just the application support files, expand and check Tivoli Enterprise Monitoring Server, Tivoli Enterprise Portal Server, and Tivoli Enterprise Portal Desktop Client. Click Next.
36
7. The agent deployment windows opens as shown in Figure 4-4 on page 38. IBM Tivoli Monitoring provides the ability to deploy resource monitoring across your environment from the monitoring server. Assuming you already have the Operating System monitoring agent on the server, you can remotely deploy and configure monitoring agents. Put a check for Monitoring Agent for WebSphere to add the agent to the deployment depot and click Next.
37
38
8. After the application support files installation is complete, a configuration window is displayed with all the components you just selected for configuration. Click Next as shown in Figure 4-5.
39
9. The Tivoli Enterprise Portal configuration starts. Select the host name of the machine where Tivoli Enterprise Portal Server resides. Click Next as shown in Figure 4-6.
10.The next steps configure application support files for Tivoli Enterprise Monitoring Server: a. Ensure the communication protocol to Tivoli Enterprise Monitoring Server are correct and click OK, as shown in Figure 4-7 on page 41.
40
b. Set the parameters for the communication protocol. For the IP.PIPE: protocol, provide the host name and port of the Tivoli Enterprise Monitoring Server. Click OK as shown in Figure 4-8.
c. Specify the location of the monitoring server as shown in Figure 4-9 on page 42 and click OK.
41
d. Select the application support file to add. The Tivoli Enterprise Monitoring Server windows opens. This window lists the application support packages that you selected in Step 7. Click OK to begin configuring Tivoli Enterprise Monitoring Server using the SQL files listed on this window, as shown in Figure 4-10.
e. Figure 4-11 shows that the application support addition has been completed with return code of 0. Click Next.
42
11.The next steps configure the agent defaults connection to the Tivoli Enterprise Monitoring Server: a. Specify the default communication protocol for the agent to communicate with Tivoli Enterprise Monitoring Server and click OK, as shown in Figure 4-12.
b. Define the communications parameters between the agents and Tivoli Enterprise Monitoring Server and click OK, as shown in Figure 4-13.
43
12.Figure 4-14 shows that the installation has been completed. Click Finish.
44
Agent or IBM Tivoli Composite Application Manager for J2EE Tivoli Enterprise Monitoring Agent. 1. Run setup.exe from the WINDOWS sub directory of the installation media. 2. Click Next on the Welcome window as shown in Figure 4-15.
45
3. Accept the product prerequisite as shown in Figure 4-16 and click Next.
46
4. ITCAM for Web Resources requires a specific version of IBM GSKit and IBM Java. Verify if the required versions of IBM GSKit and IBM JAVA are installed and click Next, as shown in Figure 4-17.
47
48
7. In the Select Features window (Figure 4-19), check only the Tivoli Enterprise Monitoring Agent option. Click Next.
49
8. The installation summary dialog is shown in Figure 4-20. Click Next to begin installation.
50
9. After the installation is completed, the configuration options window appears as shown in Figure 4-21.
51
10.From the configuration option dialog, configure the communication protocol defaults to connect to Tivoli Enterprise Monitoring Server, as shown in Figure 4-22.
52
11.The WebSphere agent configuration dialogs is a tabbed window shown in Figure 4-23. You can accept all the defaults and click OK.
53
4. Section 4.4.4, Configuring data collectors in the application servers on page 62 describes how to configure the data collector after all the required patches are installed.
54
2. From the Install Products link, select the Install Data Collector for ITCAM for WebSphere V6.1. When you click the Quick Launch column, this invokes the setup_DC_w32.exe from the path specified in the list. Make sure you have the correct directory. This launches the GUI installation program for the data collector as shown in Figure 4-25 on page 56. Click Next on the welcome dialog.
55
56
3. In the software license agreement dialog (Figure 4-26), accept the license agreement and click Next.
57
4. Specify the installation directory for the data collector, as shown in Figure 4-27. We use the path C:\IBM\itcam\WebSphere\DC. Click Next. This path is created if it does not exist.
58
5. The next dialog in Figure 4-28 allows you to save a response file. This is an excellent way of recording an installation script for a silent install. We save the response file in C:\ITCAMWR file. Click Next. Note: If you install the data collector to the current machine, a response file is only generated if the GUI installation completes successfully.
59
6. A window displays the summary information about the data collector installation, as shown in Figure 4-29. Click Install to begin the installation.
60
7. In the dialog for launching the Configuration Tools, select the option to defer the launching of the configuration tool as shown in Figure 4-30.
8. Click Next to continue. A successful completion of the installation is displayed. Click Finish. See section 4.4.4, Configuring data collectors in the application servers on page 62 for the data collector configuration.
61
2. Click the icon under the column labeled Quick Launch. This launches the installation program for the fix pack for the data collector. Now launch the 6.1.0-TIV-ITCAMfWAS_MP-FP0001 installation. 3. Run the installation for 6.1.0.1-TIV-ITCAMfWAS_MP-IF0004. 4. If Terminal Services are enabled on a Windows 2000 or Windows 2003 server, run the following command: change user /execute
62
directory. Run the data collectors Configuration Tool for each application server instance you want to configure: 1. Browse the installation directory for the data collector and change to the config_dc sub directory. 2. Run config_dc.bat. Figure 4-32 shows the Welcome window for the Configuration Tool. Click Next.
63
3. Select Configure servers for data collection, as shown in Figure 4-33. Click Next.
64
4. For ITCAM for Web Resources, only configure the data collector for displaying data on the Tivoli Enterprise Portal interface. The application management interface is provided if you use either IBM Tivoli Composite Application Manager for WebSphere or IBM Tivoli Composite Application Manager for J2EE. See Figure 4-34. Click Next.
65
5. In Figure 4-35, specify the fully qualified host name and port for the Tivoli Enterprise Monitoring Agent. This dialog checks whether the Tivoli Enterprise Monitoring Agent is available or not. You can still continue installing the data collector, even if the Tivoli Enterprise Monitoring Agent is not available at this time. We use the default values. Click Next. Note: If you need to change these values, the configuration is recorded in the $DC_home/runtimes/<ver>.<node>.<server>/*.kwjdc.properties file.
66
6. A window indicating a selected IP address for the data collector displays as shown in Figure 4-36. This window appears when you have multiple network cards and need to adjust the ports for an enabled firewall. This dialog is not used for ITCAM for Web Resources. Use the default information here. The communication parameter is performed by the Tivoli Enterprise Monitoring Agent to the Tivoli Enterprise Monitoring Server. Click Next.
67
7. Figure 4-37 shows the application server selection. In our case, we are installing this to a standard WebSphere Application Server. Click Next.
68
8. The installation wizard searches for installations of that type of application server and then displays a list as shown in Figure 4-38. Select the application server that the data collector will monitor and click Next. Note: For WebSphere Application Server V6: If there are several existing profiles for the installed application server, make sure the selected profile is the one that contains the application server you are instrumenting.
69
9. Figure 4-39 shows information about the selected application server. Confirm the information and click Next.
70
10.The installation wizard communicates to the administration application of the application server. For the Network Deployment installation, this connects to the deployment manager instance. In Figure 4-40, specify the correct host name and port that are used for the administration application. Click Next.
71
11.The installation wizard connects to the administration application and displays a tree of the application server as shown in Figure 4-41. Select the servers and click Next.
72
12.Figure 4-42 allows you to save a response file for performing a silent install for other data collectors. This is useful for deploying a large number of data collector with minimal interaction with the machines. Click Next.
13.The Configuration Tool applies the configuration to the data collector, then a panel indicating the results of the configuration displays, as shown in Figure 4-43 on page 74.
73
74
Verify that the appropriate agent and workspaces are shown in Tivoli Enterprise Portal. The sample workspace that we have for srv177 is shown in Figure 4-45.
75
76
Chapter 5.
Scenarios
This chapter describes how to use ITCAM for Web Resources. It discusses the following topics: Usage scenario overview on page 78 Using the workspaces on page 78 Defining application health and baseline on page 84 Working with situations on page 90
77
srv177
WebSphere Application Server ITCAM for Web Resource data collector ITCAM for Web Resource WebSphere TEMA
srv178
Tivoli Enterprise Monitoring Server Tivoli Enterprise Portal Server Tivoli Enterprise Portal
We use the following two servers: The monitored application server in srv177 The IBM Tivoli Monitoring server in srv178 This chapter is divided into the following sections: Section 5.2, Using the workspaces on page 78 describes the available workspaces that come with ITCAM for Web Resources. Section 5.3, Defining application health and baseline on page 84 discusses defining a generic application health and defining a baseline for this health indicator. Section 5.4, Working with situations on page 90 provides a scenario for event-based monitoring.
78
The workspace is structured by the agent host and then each application server nodes. Individual workspaces that collect certain performance information are available under the application server node. See Figure 5-2.
Lets evaluate these workspaces: The primary agent workspace contains all situation events from the agent and the health summary of the application servers that it monitors. Figure 5-3 on page 80 shows an example of this workspace.
Chapter 5. Scenarios
79
The application server summary workspace provides a summary of the important metrics of the application server. This workspace is shown in Figure 5-4 on page 81.
80
Under the application servers, there is a set of workspaces: Application health Request analysis Garbage collection analysis Log analysis Pool analysis Data source JMS summary Web application EJB containers DB connection pool J2C connection pool Thread pool Cache analysis
Chapter 5. Scenarios
81
We do not cover all of these workspaces. The following are a few examples of the workspaces: Request analysis workspace shown in Figure 5-5.
82
The log analysis workspace summarizes WebSphere errors and exceptions and ITCAM for Web Resources data collector messages in the WebSphere log. Figure 5-6 shows the workspace.
Chapter 5. Scenarios
83
Web application workspace that lists the available Web application and its performance is shown in Figure 5-7.
84
The health is calculated against an internally stored baseline threshold. This baseline process uses mathematical and statistical method to automatically calculate the threshold based on response time information that is collected over a period of time. The baseline data collection is usually a long running activity that can last for hours or days. Note: The recommended period to create a baseline is when the application is running under a typical load. The performance of the application under this load is considered good. Deviation from this performance indicates a degrading health of the application. The following procedure creates an application baseline: 1. Open Tivoli Enterprise Portal and select the application server you want to work on. Open the application health workspace. 2. From the Application Health Summary table, select and right-click one of the application names as shown Figure 5-9.
3. Select Selected Application - Configuration and Application Request Configuration window opens as shown in Figure 5-10 on page 86.
Chapter 5. Scenarios
85
4. In the application request configuration workspace, select the request type you want to define and right-click. Select Take Action Select as shown in Figure 5-11 on page 87.
86
5. In the take action dialog in Figure 5-12, select the Start_Baselining action.
Chapter 5. Scenarios
87
6. Enter the arguments as shown in Figure 5-13. Some of the values have been prefilled from the application that you selected. Click OK.
7. Back in the Take Action window, click OK to invoke the action. The arguments and destination system have been preselected based on your invocation context.
8. When the command has been invoked successfully, a completion message appears as shown in Figure 5-15 on page 89. Click OK.
88
9. Perform some transactions on the application and the you can invoke the Stop_Baselining action using the same mechanism. 10.You can start getting the result on the application health workspace.
Application configuration
The application configuration: Displays information about all requests monitored for a given application. Displays baselining status. Provides a table and bar chart views to report the essential configuration properties associated with monitored request: Request ID (correlates with other requests IDs reported throughout the product). Parameters for auto-thresholding. Actual thresholds values (assigned automatically or customized by the user). Uses the Take Action function, user can control monitoring, baseline, and thresholds configuration. Provides a link to the request configuration workspace where you can visualize baseline data or threshold settings with more detail.
Request baselining
The product collects and keeps the baseline data for each application request: Baseline data is collected in prolonged intervals (for days, weeks or months). Baseline is a statistical distribution of application requests response times. Baseline is used to facilitate the auto-thresholding feature of the product: Assigns fair and bad response time thresholds for each application request.
Chapter 5. Scenarios
89
Additionally assigns each tier (client, application, or backend) the share (in percent) from the whole application request delay time. At runtime the fair or bad response time thresholds are used to determine the overall health status for the request. The share percent is used to determine which tier contributes more to a delayed request and brings up the users focus for that request.
The request baseline workspace provides table and bar charts to bring the baseline distribution stats and threshold settings for a request in the same views.
90
a negative number and erroneously fire a situation that specified a negative number as shown in Figure 5-16 and Figure 5-16.
Chapter 5. Scenarios
91
WASAppHealthFair: This situation fires when TEMA detects an application running at a fair health level. It has an automated response to drop the monitoring level to L2 and the sampling rate to 2%. WASAppHealthBad: This situation fires when TEMA detects an application running at a fair health level. It has an automated response to drop the monitoring level to L2 and the sampling rate to 10%. Table 5-1 describes all situations from the situation editor.
Table 5-1 Predefines situations-description and formulas Situation WASWebApplicationError Description Monitors the status of the WebSphere servers error log and issues a critical condition when an error occurs. Monitors the error count for servlets and JSPs invoked by a WebSphere Application Server application and issues a critical condition when the count becomes nonzero. Monitors the thread timeout count and issues a critical condition when the timeout count is greater than zero. Monitors the WebSphere Application Servers rollback count and issues a critical alert when the count becomes nonzero. Formulas If Web_Applications.Error_Count is greater than 0, then the situation WASWebApplicationError is true. If Servlets_JSPs.Error_Count is greater than 0, then the situation WASServletsJSPsError is true.
WASServletsJSPsError
WASDBConnectionPoolTh readTimeout
If DB_Connection_Pools.Threads_Timed_O ut is greater than 0, then the situation WASDBConPoolThreadTimeOut is true. If Container_Transactions.Global_Transacti ons_Rolled_Back is greater than 0, or Container_Transactions.Local_Transactio ns_Rolled_Back is greater than 0, or Container_Transactions.Transactions_Roll ed_Back is greater than 0, then the situation WASContainerTransactionRollBack is true.
WASContainerTransaction Rollback
92
Situation WASError
Description Monitors the error severity for a single WebSphere Application Server and issues a critical condition when that severity is greater than 21. Monitors the connection between the ITCAM for WebSphere Data Collector running in an application server and the ITCAM for Web Resources - WebSphere Agent TEMA to ensure the monitoring agent is connected and issues a critical condition when it is not. Monitors the heap allocation status and issues a critical condition when the heap space is exhausted. Monitors the average request response time and issues a critical condition when that time exceeds two seconds. Monitors the percentage of the CPU being consumed and issues a critical condition when that time exceeds 80%. Monitors the percentage of time being spent by the garage collector and issues a critical condition when that time exceeds 80%. Monitors the average usage time of all threads, and issues a critical condition when that time exceeds 80%.
Formulas If Log_Analysis.Severity is greater than 21, then the situation WASError is true.
WASNotConnected
WASOutofHeapSpace
If Allocation_Failure.Heap_Status equals 1, then the situation WASOutofHeapSpace is true. If Request_Times_and_Rates.Average_Re quest_Response_Time is greater than 2000, then the situation WASHighResponseTime is true. If Application_Server.CPU_Used_Percent is greater than 80, then the situation WASHighCPUPercentUsed is true. If Garbage_Collection_Analysis.Real_Time _Percent is greater than 80, then the situation WASHighGCTimePercent is true. If Thread_Pools.Percent_of_Time_Pool_at_ Max is greater than 80, then the situation WASThreadPoolPercentMaxed is true.
WASHighResponseTime
WASHighCPUPercentUse d
WASHighGCTimePercent
WASThreadPoolPercentM axed
Chapter 5. Scenarios
93
Situation WASAppDiscovered
Description Monitors WebSphere applications deployed in the application server and issues an informational alert when a new application is discovered. The TEMA checks for new applications each time when it connects to the data collector or when an application is deployed when the data collector is already active. Monitors the overall application health and issues an informational alert when application health is good. Monitors the overall application health and issues a warning alert when application health is fair. Monitors the overall application health and issues a critical alert when the application health is bad. Monitors the portal page response time and issues a critical alert when the average request response time is higher than 2 seconds. Monitors the portlet response time and issues a critical alert when the average request response time is higher than 2 seconds.
WASAppHealthGood
If Application_Health_Status.Application_H ealth equals 1, then the situation WASAppHealthGood is true. If Application_Health_Status.Application_H ealth equals 2, then the situation WASAppHealthFair is true. If Application_Health_Status.Web_Tier_Hea lth equals 3, then the situation WASAppHealthBad is true. If Portal_Page_Summary.Average_Respons e_Time is greater than 2000, then the situation WASPortalPageResponseTime is true. If Portlet_Summary.Average_Response_Ti me is greater than 2000, then the situation WASPortletResponseTime is true.
WASAppHealthFair
WASAppHealthBad
WASPortalPageResponse Time
WASPortletResponseTime
Defining situations
Situations are defined using the situation editor that is invoked using the button from Tivoli Enterprise Portal workspace. To open Tivoli Enterprise Portal Server, type http://hostname:1920/ in your browser as shown in Figure 5-17 on page 95.
94
Tivoli Enterprise Portal is the common user interface for real-time information and historical data collected by Tivoli Enterprise Monitoring Server. Products from the various Tivoli families integrate with it to provide a flexible and customizable repository and linked information.
Chapter 5. Scenarios
95
From the situation editor main window, we create a new situation by right-clicking the appropriate category and selecting Create New as shown in Figure 5-18.
96
If you want to create another situation from the list of situation editor, right-click the appropriate situation you want and select Create Another as shown in Figure 5-19.
Chapter 5. Scenarios
97
When the Create Situation window opens, as shown in Figure 5-20, enter the name. and click Ok.
98
The next window lets you select the attribute group and attributes that you want to use for the situation as shown in Figure 5-22. Select the attributes that you want to evaluate.
Chapter 5. Scenarios
99
When the attributes have been selected, click OK to see the situation formula definition. You must specify your condition here and select the distribution list on the next tab. The distribution list represents the Tivoli Enterprise Monitoring Agent that the situation will run on, as shown in Figure 5-23.
100
Chapter 6.
101
102
<ITM_home>\TMAITM6\logs\*.log Data collector log files, located in the Tivoli common directory (C:\Program Files\ibm\tivoli\common or /var/ibm/tivoli/common): $common_dir\CYN\logs\trace-dc-native.log $common_dir\CYN\logs\msg-dc-native.log $common_dir\CYN\<platfrom.node.server>\trace-dc-native.log $common_dir\CYN\<platform.node.server>\msg-dc-native.log
WebSphere Application Server SystemOut.log and SystemErr.log files in $WAS_HOME/profiles/<profile>/logs/<server>. This section discusses various log and trace settings for ITCAM for Web Resources: You can set Tivoli Enterprise Monitoring Agent Java trace levels the file kynjlog.properties or kyjjlog.properties. Set the following parameters: TEMA.trc.itcam.level=DEBUG_MIN TEMA.trc.itcam.websphere.level=DEBUG_MID You can find the data collector trace under the runtime directory of the data collector installation path in the cynlogging.properties file. The following are for setting basic traces for Tivoli Enterprise Monitoring Agent interface: CYN.trc.temadc.level=DEBUG_MID CYN.trc.jmxconnector.level=DEBUG_MIN Table 6-1 lists possible debug and trace levels in Tivoli Enterprise Monitoring Agent.
Table 6-1 Trace Levels of TEMA Level Minimum (DEBUG_MIN) Description Displays interactions with external interfaces, such as processes, DC, file, take action commands, ITM. In addition, state changes are recorded. Also included are the startup versions and configurations being used by the TEMA. Displays method entry or exit. This level of debugging is extensive and should not be run for an extended period of time. Displays logic flow and important loops in the code. This level of debugging might be excessive and should not be run for an extended period of time.
Medium (DEBUG_MID)
Maximum (DEBUG_MAX)
103
104
Part 3
Part
Appendixes
105
106
Appendix A.
107
Application components
The Trader application is a multi-components composite application that runs on heterogeneous platforms and in an execution environment. It is a simple stock trading application that allows the user to list companies, get a quote, and trade stocks of the listed companies. Figure A-1 shows the Trader application conceptual interface.
DB2
Trader DB2
You can view the Trader application as having a three-layer (three tiers) structure: The Trader application for this book has a Web interface. It connects to the server application that provides the business logic. The connection to the server applications are based on Web services calls. The server application uses DB2 for its data storage. The application is a J2EE-based application that serves as Web services providers. The back end data storage for this book is a DB2 database. The DB2 database can reside on the same or different server.
108
We discuss the components in the following sections: Front-end J2EE Web application on page 109 Back end implementation on page 112 Back end J2EE server on page 112
Note: The DB2, IMS, and CICS radio check boxes shown in Figure A-2 are not normally available to users. They are included in our sample application to highlight possible back-end systems. Similarly, a typical application does not select a target host, but this is shown here as part of our lab environment.
109
ListCompanyServlet (Figure A-3): Invokes the back end ListCompany Web services.
110
BuySellServlet: Invokes either the Buy or Sell Web services. LogoutServlet: Clears up the session bean. We provides three types of enterprise application archive (ear) files for the client interface: TraderClientEAR: This ear file runs the TraderClientWeb application that provides the basic Trader application functionality. TraderClientMemEAR: This ear file runs the TraderClientMem application that has a memory leak in the logic for testing a memory leak situation. TraderClientLckEAR: This ear file runs the TraderClientLck application that has a lock problem injected for testing dead lock situation.
111
COMPANY
Company Name Stock price Price history 7 days Commission
CUSTOMER
Customer Name Company name Stock owned
List company
GetQuote
Buy/Sell Stock
The back end system is implemented in DB2. The DB2 implementation is represented in two tables: the CUSTOMER table and the COMPANY table.
112
Software requirements
This section discusses the software required for running the Trader application. We use the following software for running the Trader components. Other versions of the software are acceptable. Figure A-6 shows the detailed configuration of the Trader application.
The detailed software levels of each components are: TraderClient.ear, TraderClientMem.ear, TraderClientLck.ear TraderDBSvc.ear DB2 databases
Installation procedure
This section discusses the guideline for installing the Trader application in our environment. Perform the installation based on additional material. See Appendix C, Additional material on page 121 on how to get access to the additional material. The installation is discussed in the following sections: DB2 database creation on page 114 WebSphere server installation on page 114
113
114
2. Modify the WebSphere variables for DB2_UNIVERSAL_JDBC_NATIVEPATH and DB2_UNIVERSAL_JDBC_DRIVERPATH to point to the DB2 installation directories. 3. Create the JDBC data source for the Trader database. The JNDI name is jdbc/Trader. 4. Create an JAAS authentication user to access the database. Make sure you map the JDBC data source to use the authentication method. 5. Create a virtual host that matches the default port for the ServerSvc application server. 6. Install C:\Temp\applear\TraderDBSvc.ear to the ServerSvc. Make sure you map the Web module to the appropriate virtual host that you defined. 7. Save the configuration and restart the application server.
115
116
Appendix B.
117
Executive summary
The ITCAM for Web Resources implementation service monitors the Web resources performance using the Tivoli Enterprise Portal. The display allows a proactive anticipation of an impending performance problem. The monitoring collects the individual application performance. The implementation of ITCAM for Web Resources starts at <a designated date> for two weeks. At the end of this period, <your name or companys name> will present the implementation highlight, including: Current application server performance summary. Application highlight, such as load profile and transaction rate. Performance highlights, such as potential bottleneck, excessive errors, and deadlock. Environment tuning recommendations.
Solution description
In the ITCAM for Web Resources implementation service, you implement IBM Tivoli Monitoring environment to host the ITCAM for Web Resources V6.2 environment. ITCAM for Web Resources data collectors will be installed on <the clients name> production servers for assessment. The data collector mainly runs in level 1 monitoring, which has limited impact on your servers. Lab testing shows a typical increase of 2%-3% of CPU usage for the J2EE application server. The solution assumes that the IBM Tivoli Monitoring server connection to the data collectors do not go through a firewall. After implementation, performance information is collected into Tivoli Data Warehouse for analysis and presentation. <Your name or companys name> will analyze the collected performance information and possibly perform monitoring with additional detail as needed. The analysis is performed dynamically and does not need a restart of the application servers.
118
Assumptions
Assumptions for this statement of work are: Number of data collectors to be configured Transaction rate of each application server Transaction mix of each application server Note: Insert any additional assumptions about specific performance or transaction problems for the client.
Client responsibilities
This section describes the clients responsibilities for IBM or Business Partners: Designate a representative who will be the focal point for all communication with IBM or Business Partner. The representative will have the authority to act on the clients behalf. Designate operations personnel to work with IBM or Business Partner as appropriate. Provide all required Web site content in digital form, as specified by IBM or Business Partner. Provide all product data in a format as requested. Provide all data and information required for implementation. Provide suitable workspace with telephone access for the services specialists while working on the client premises. Provide user IDs, passwords, and IP addresses as required, enabling IBM or Business Partner to perform the service. Provide information to allow estimates on current and future system workload and performance expectations.
119
Staffing estimate
The project will be performed with one ITCAM for Web Resources specialist, who will be on site as required by the project schedule. The project is estimated to be performed within two weeks.
ID 1 2 3
Task Name Plan the solution Implement the solution Close the engagement
Duration
19 20
3d 8d 2d
Testing methodology
The solution is demonstrated using workspaces and events generated by ITCAM for Web Resources within the Tivoli Enterprise Portal. The monitoring shows critical events for the list of applications, such as: Response time Transaction rate Deadlock problem Memory usage
Deliverables
The project deliverables are: ITCAM for Web Resources workspaces and events Performance assessment and recommendation presentation by <your name or companys name>
Completion criteria
Completion criteria for this project are: Acceptance of performance findings and recommendations All deliverables have been received by the client All testing performed successfully
120
Appendix C.
Additional material
The Web material associated with this book is available in softcopy on the Internet from the IBM Redbooks publications Web server at: ftp://www.redbooks.ibm.com/redbooks/SG247485 Alternatively, you can go to the IBM Redbooks publications Web site at: ibm.com/redbooks Select Additional materials and open the directory that corresponds with the IBM Redbooks publications form number, SG247485.
This file contains the following files: File name Trader.zip WASear.zip Description Zipped database source WebSphere ear files
121
122
123
124
Related publications
The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this book.
Other publications
These publications are also relevant as further information sources: IBM Tivoli Composite Application Manager for Web Resources publications: IBM Tivoli Composite Application Manager for Web Resources: J2EE Data Collector Installation Guide, GC23-6179 IBM Tivoli Composite Application Manager for Web Resources: WebSphere Distributed Data Collector Installation Guide, GC23-6180 IBM Tivoli Composite Application Manager for Web Resources: J2EE Agent Installation Guide, GC23-6181 IBM Tivoli Composite Application Manager for Web Resources: WebSphere Agent Installation Guide, GC23-6182 IBM Tivoli Composite Application Manager for Web Resources: Web Servers Agent Installation Guide, GC23-6183 IBM Tivoli Composite Application Manager for Web Resources: Community Edition Data Collector Installation Guide, GC23-6184 IBM Tivoli Composite Application Manager for Web Resources: Quick Start Guide, GC23-6185
125
IBM Tivoli Composite Application Manager for Web Resources: J2EE Agent Problem Determination Guide, GI11-8160 IBM Tivoli Composite Application Manager for Web Resources: WebSphere Agent Problem Determination Guide, GI11-8161 IBM Tivoli Composite Application Manager for Web Resources: Web Servers Agent Problem Determination Guide, GI11-8162 IBM Tivoli Monitoring publications: Exploring IBM Tivoli Monitoring, SC32-1803 IBM Tivoli Monitoring Administrator's Guide, SC32-9408 IBM Tivoli Monitoring: Configuring IBM Tivoli Enterprise Monitoring Server on z/OS, SC32-9463 IBM Tivoli Monitoring Installation and Setup Guide, GC32-9407 IBM Tivoli Monitoring Problem Determination Guide, GC32-9458 IBM Tivoli Monitoring User's Guide, SC32-9409 IBM Tivoli Monitoring: Upgrading from Tivoli Distributed Monitoring, GC32-9462 IBM Tivoli Universal Agent API and Command Programming Reference Guide, SC32-9461 IBM Tivoli Monitoring Universal Agent User's Guide, SC32-9459 Introducing IBM Tivoli Monitoring, GI11-4071
Online resources
These Web sites are also relevant as further information sources: ITCAM for Web Resources Web page: http://www-306.ibm.com/software/tivoli/products/composite-applicatio n-mgr-web-resources/index.html ITCAM for Web Resources product manuals: http://publib.boulder.ibm.com/infocenter/tivihelp/v3r1/index.jsp?top ic=/com.ibm.itcamwas_wr.doc_6.2/welcome.htm
126
Related publications
127
128
Index
Numerics
520188088CaptionFigColumn 8 installation task 28 WebSphere 8 data collector installation 53 data sources 7 data warehouse tables 14 db2 command 114 db2cmd command 114 db2move command 114 debug and trace 103 deployment large environment 22 medium scale 21 proof of concept 20 deployment configuration 20 disk requirement 10
A
am 8 application environment 4 application server resource analysis 4 application support files 28 installation process 35 installation task 28
B
back-end system 112 BCI 7 Byte Code Instrumentaiton, see BCI
E
EAR 84 enterprise application archive, see EAR environment 20 environment preparation 27 error statistics 4 event agent 7
C
cmwras1.log 102 collector process 7 command agent 7 commands config_dc.bat 63 db2 114 db2cmd 114 db2move 114 launchpad.cmd 54 netstat 74 setup.exe 35, 45 setup_DC_w32.exe 55 config_dc 63 config_dc.bat command 63 CPU usage 4 custom service 8
G
garbage collection data 7
H
hardware requirement 10
I
IBM Tivoli Monitoring installation 27 level 11 log files 102 workspace 78 install_plugin_trace.log 102 ITCAM for Web Resources architecture 5 customization task 29 data collector installation 53 disk requirement 11
D
data collector 67 command agent 7 configuration task 28 data sources 7 event agent 7
129
features 4 hardware requirement 10 installation overview 34 interconnection 5 J2EE agents 12 log files 101 memory requirement 11 monitoring agent 44 skills 26 software requirement 11 value propositions 5 Web servers requirements 13 WebSphere agent requirement 12 ITCAM for WebSphere data collector 6
N
native system services 6 netstat command 74
P
performance management 4 Performance Monitoring Infrastructure, see PMI PMI 4 processor speeds 10 project initiation 27
J
J2EE agents 12 J2EE application problems 4 Java Management eXtension, see JMX Java Virtual Machines, see JVM JMX 4 system resources 7 JVM 4
R
Redbooks publications Web site 127 Contact us x required skill 26 resource analysis 4
S
sample deployment environment 34 sample statement of work 117 setup.exe command 35, 45 setup_DC_w32.exe command 55 SFU 74 single processor 10 sizing data warehouse 14 skill pre-requisites 26 skill transfer 29 software requirement 11 solution demonstration task 29 Summarization and Pruning agent 23 supported J2EE agents 12
K
kcj.log 102 kcjras1.log 102 kfwras1.log 102 kick off 27 kyjjlog.properties 103 kyj-tema-*.log 102 kynjlog.properties 103 kyn-tema-*.log 102
L
large environment 22 launch pad 54 launchpad.cmd command 54 log files 101
T
Tivoli common directory 103 Tivoli Data Warehouse 23 Tivoli Enterprise Monitoring Agent 6 Tivoli Enterprise Portal 5 trace_install_plugin.trc 102 trace-dc-native.log 103 Trader application 113 BuySellServlet 111 company database 112 customer 112
M
memory requirement 10 memory usage 4 method trace 7 Microsoft Services for UNIX, see SFU monitoring agent
130
customer database 112 GetQuotesServlet 111 ListCompanyServlet 110 login.html 109 LogoutServlet 111 trader.zip file 114
W
Warehouse proxy 23 Web application performance management 4 Web server 13 monitoring 8 Web server sessions 4 WebSphere custom service 8 workspace 78
Index
131
132
Back cover
Deployment Guide Series: IBM Tivoli Composite Application Manager for Web Resources V6.2
Manage Web application server resource performance Extensive deployment and usage scenarios Solution development guide included
This book is written as part of the deployment guide series. It provides a step-by-step guide for deploying IBM Tivoli Composite Application Manager (ITCAM) for Web Resources V6.2. This deployment guide will help an IBM Business Partner or service person plan and perform the deployment of the product. The discussion on ITCAM for Web Resources describes product architecture and components, planning and sizing considerations, and guidelines on setting up service engagements. Although the information is highly relevant for larger deployment engagements, it is also suitable for a small deployment system. The extensive deployment and usage scenarios can also help you demonstrate the product.
BUILDING TECHNICAL INFORMATION BASED ON PRACTICAL EXPERIENCE IBM Redbooks are developed by the IBM International Technical Support Organization. Experts from IBM, Customers and Partners from around the world create timely technical information based on realistic scenarios. Specific recommendations are provided to help you implement IT solutions more effectively in your environment.