Professional Documents
Culture Documents
FEATURE
TDWI RESEARCH
Challenges to Operational BI
pAgE 36
TDWI is proud to offer you our new, topically focused What Works in Enterprise Busi-
ness Intelligence. This collection of customer success stories and expert perspectives
provides a resource for better understanding the tools, technologies, and methods that
are central to enterprise business intelligence. To help you make your way through the www.tdwi.org
many powerful case studies and lessons from the experts articles, we have arranged
general manager Rich Zbylut
them into specific categories: enterprise business intelligence, search BI, open source director of research Wayne Eckerson
BI, data governance, performance management, and predictive analytics. director of marketing Michelle Johnson
art director Deirdre Hoffman
Whats inside? editorial director Denelle Hanlon
production manager Jennifer Agee
production editor Susan Stoddard
case studies
graphic designer Bill Grimmer
The goal of What Works is to provide snapshots of the most innovative business intel-
ligence and data warehousing implementations in the industry today. The case studies
included in this volume demonstrate the power of enterprise business intelligence
technologies and solutions for industries ranging from banking to pharmaceuticals to
president & ceo Neal Vitale
online ticket sales.
cFo Richard Vitale
executive Vice president Michael J. Valenti
lessons from the experts resources
What Works also includes articles from leading experts in the services, software, and managing director Dick Blouin
hardware vendor communities. These lessons feature perspectives about enterprise managing director Ellen Romanow
business intelligence best practices and trends. Vp, Financial William H. Burgin
planning & analysis
Vp, Finance & Christopher M. Coates
q&a with the experts administration
Our Q&A section provides answers from these same experts to the enterprise business Vp, audience marketing Abraham Langer
& web operations
intelligence questions they hear most often, complemented by insight from an inde-
Vp, information Erik Lindgren
pendent consultant. technology
Vp, print & online Mary Ann Paniccia
production
feature article
chairman of the Board Jeffrey S. Klein
Our feature article comes from Wayne Eckerson of TDWI Research. In The Myth of
Self-Service BI, he explores the myths and realities of managing your own data ware-
Reaching the staff: Editors can be reached via e-mail, telephone,
house. or mail. To e-mail a member of the staff, use the persons first initial
followed by their full last name @1105media.com.
We hope you enjoy this collection of case studies, best practices, and expert insight Reprints: For editorial and advertising reprints of 100 copies or more,
and digital (Web-based) reprints, contact PARS International at
that are all focused on enterprise business intelligence. We look forward to your com- 1105reprints@parsintl.com or 212.221.9595, or visit
www.magreprints.com/quickquote.asp
ments; if there is anything we can do to make this publication more valuable to you,
List rentals: This publications subscriber list, as well as other lists
please let us know. Please join me in thanking the companies that have shared their from 1105 Media, Inc., is available for rental. For more information,
stories and successes, their technology insights, and the lessons they have learned. please contact our list manager, Merit Direct. Phone: 914.368.1000;
e-mail: 1105media@meritdirect.com; Web: www.meritdirect.com
2007 by 1105 Media, Inc. All rights reserved. Reproductions in whole
or part prohibited except by written permission. Mail requests to
Permissions Editor, c/o What Works In EBI, 1201 Monster Road SW,
Ste. 250, Renton, WA 98057. The information in this magazine has not
undergone any formal testing by 1105 Media, Inc., and is distributed
without any warranty expressed or implied. Implementation or use of
any information contained herein is the readers sole responsibility.
Denelle Hanlon While the information has been reviewed for accuracy, there is no
guarantee that the same or similar results may be achieved in all envi-
Editorial Director, What Works in Enterprise Business Intelligence ronments. Technical inaccuracies may result from printing errors, new
TDWI developments in the industry, and/or changes or enhancements
to either hardware or software components. Printed in the USA.
dhanlon@tdwi.org
TDWI is a trademark of 1105 Media, Inc. Other product and company
names mentioned herein may be trademarks and/or registered trade-
marks of their respective companies.
Table of Contents
OpEn sOurcE Bi
FEATURE
42 open source Bi: does it fit into Your Bi environment?
2 The myth of Self-Service BI
Wayne W. Eckerson, Director, TDWI Research 43 enterprise Business intelligence: making the case and Keeping
the promise
An exploration into the myths and realities of
managing your own data warehouse. 44 why open source was the Bi suite of choice for Ziprealty
30 alvion scales data analytics and distribution 48 issues that influence Bi solutions for sap
33 cpm implementation challenges and lessons learned 63 Best practices awards 2007
76 about tdwi
sEarch Bi
77 tdwi partner members
40 university of utah, university health care: Bi tips that drive
user adoption and increase roi
liberating it? business users create their own custom reports using end userori-
Remember D-Day? That was the day in June 1944 when Allied ented query and reporting tools running against a data warehouse.
troops stormed the beaches of Normandy to liberate Europe from IT steps aside as an intermediary between users and the data and
the Nazi occupation. But there is another D-Day, one that is less gives users what theyve demanded for years: complete and unfet-
well known but yet significant in its own right. That was the day tered access to data without IT interference. All that IT needs to do
in 1990 that data warehousing came to life. This is the day that is set up the data warehouse and provide query and reporting tools.
information technology (IT) managers celebrate with gratitude and It can then focus on more value-added activities, such as develop-
fondness. (Or at least they should!) ing new applications.
At the time, data warehouses promised to liberate IT from the Data warehousing created a win-win situation in which business
drudgery of creating custom reports. Previously, the IT department users gained direct access to data and IT managers eliminated the
was swamped. It couldnt keep pace with the demand for custom need to create custom reportsor at least that was how it was sup-
development and was slowly drowning in a backlog of requests, a posed to work.
good portion of which were for custom versions of corporate reports.
(Alas, things havent changed much for some organizations where IT downsides of self-service Bi
groups are still bogged down with requests for custom reports.) Unfortunately, as many organizations have discovered the hard
way, self-service BI is a myth and doesnt translate well to reality.
Admittedly, IT was cautious at first about creating redundant Although the concept is valid, implementation is misguided. The
data storesa data warehousing prerequisite and a long-time IT result is reporting chaos.
taboo emanating from the days of expensive disk storage. Once IT
realized it could offload a huge portion of its work to end users, One cause of the chaos is that organizations, keen to empower
however, it began to evangelize the benefits of data warehousing to users with data warehouses and BI tools, go overboard. They give
the business. Soon enough, data warehousing and its successor, users too much responsibility for generating the information and
business intelligence, became a clarion call for IT and a booming reports they need to do their jobs. In reality, most users dont want
career opportunity as well. this responsibility, and its not part of their job descriptions. It takes
too much time, and users often make mistakes and get frustrated.
The heart and soul of data warehousing, at least to an IT profes- If they do get training, users usually forget how to use the tool by
sional, is the notion of self-service reporting or self-service BI. Here, the time they need to create a report. Consequently, they either stop
CLIENT / SERVER
IT
Report Report Design Tools / SQL
Developer
Customers / Suppliers
WEB
using the tool or call IT to create the report for them. The organiza- tations of self-service BI. Rather than ricochet back to the days of
tion then finds itself exactly where it was before it spent hundreds of canned reporting, most organizations seek to balance self-service
thousands, if not millions, of dollars on its DW/BI program. BI with tailored delivery of information to casual users.
For example, the human resources department in one large organi- mapping Users to Tools. In order to achieve this balance, orga-
zation I worked with discovered that it had 26,000 different reports nizations realize they need to better understand the information
serving 450 active users out of a potential of 3,500. Most of the requirements of their users and provide them with tools and reports
reports were variations on a couple of themes, and most hadnt that are optimally suited to their needs. In essence, they need to
been used in months or years, but they were still sucking up disk investigate what users want to achieve from a business perspec-
space and cluttering report folders. The majority of the 3,500 tive before they ask what kind of information or tool they need.
employees who could benefit from the BI infrastructure found the Are they trying to reduce supply chain costs while increasing qual-
tools difficult to use or couldnt find the right report in the directory. ity by implementing a supplier rating program? Are they trying to
maximize call center productivity by tracking call times and sales
There is another, more deleterious, downside to reporting chaos volumes? Knowing their ultimate business goals focuses the discus-
than lack of usage and BI tool shelfware. It occurs when the small sion of BI tools on the right level.
percentage of users who do employ the new tools dont define key
metrics, accounts, and terms in a consistent fashion. This makes After such investigation, most organizations discover that 80
it impossible for executives to get a harmonious view of business percent of their users consume reports or information views cre-
activity, and they may unwittingly make critical decisions based on ated by the remaining 20 percent. The 80 percent of information
inaccurate information. consumersor casual users, as I call themconsist of execu-
tives, managers, front-line workers, customers, and suppliers. The
Another problem is that overambitious business users may submit remaining 20 percent are information producers, comprising busi-
costly, long-running queries, which bog down query performance ness analysts, power users, and IT developers. (See Figure 1.)
for all other users. When result sets take a painfully long time to
return, business users accustomed to split-second response times There are numerous subcategories within each of these groups,
for Google queries stop using the BI tools altogether. Whats ironic varying from one organization to the next depending on the makeup
is that most of these network-clogging, runaway queries are usually of their user populations. Once organizations segment their user
unnecessary; users typically need only a fraction of the data that base, they can map each segment to one or more BI tools that
they include in their queries. meet their information requirements. This type of evaluation helps
maximize BI usage and minimize BI shelfware.
the pendulum swings
When organizations first deploy data warehouses and BI tools, they Be aware, however, that individuals often play multiple roles. A
embrace BI self-service with an exuberance bordering on delirium. power user who creates custom views for colleagues in the mar-
Once afflicted with report chaos, however, they recognize the limi- keting department may be a casual user when viewing human
resources information or corporate financial data. Typically, you comprising a representative group of business users and IT profes-
need to arm users with a variety of tools or logins to access differ- sionals from a single domain or multiple domains (depending on
ent reports and sets of BI functionality. the organizational structure and DW architecture), reviews requests
for new reports or modifications. The committee determines
Tools Selection Process. As simple as it sounds, many organiza- whether any of the existing reports can meet the need or if an
tions skip the step of mapping users to tools. What usually happens extension or new report is required.
is that information producers hijack the tool selection process and
pick BI products that are suited to them but not to the majority of Effecting Change. Of course, you dont want to kill requests by
users. To avoid this problem, populate the BI tools selection team committee, so before you implement the governance process, you
with a cross-section of users from multiple areas and listen carefully need to work hard and fast to develop the standard interactive
to their feedback. Remember, there is no tool that meets the needs reports so that 80 percent of the users can get 80 percent of the
of all users, so youll need to invest in a suite of tools. Fortunately, information they need from them. Then, you need to shut down the
the BI market has matured to the point where leading BI vendors older, ad hoc reporting systems. This can be politically sensitive, so
now offer a comprehensive suite of integrated BI tools built largely you must be cautious.
on a single, integrated architecture (or so they claim).
Some organizations are fortunate enough to have a CEO or CFO
it-driven standard reports issue a mandate that the new standard reports will be the basis for
Once you catalog users and assign tools, you need to create a lim- all future decisions. If youre really lucky, theyll enforce this man-
ited set of standard, interactive reports. These reports are geared date by using the reports themselves and scolding subordinates
to information consumers, the 80 percent of your employees who who present information created in ad hoc, nonstandard ways. Less
require periodic access to information. The remaining 20 percent fortunate organizations need to tread carefully, persuading groups
of business analysts, power users, and developers can continue and managers that the new reports contain more accurate and
to use their ad hoc tools to perform deep analysis and exploration comprehensive data than their existing reporting solutions. While
of data. many groups will convert, others will hold out for a long time, even
if the BI team refuses to support the system with upgrades, plat-
A well-designed interactive report can replace dozens, if not form support, or help desk services.
hundreds, of existing reports. Each report typically focuses on a
specific domain and contains about 20 dimensions and 12 metrics. Power Users. Remember, exceptions are the rule. Give information
These standard reports are broad without being overwhelming producers unfettered access to data and allow them to acquire
because they present a simple, intuitive interface that makes it easy the BI tools they wantbecause theyll acquire what they want
for users to apply filters to navigate and analyze the predefined data whether you allow them to or not. In other words, self-service BI
set. Once users navigate to a particularly useful view of information, makes sense for power users, but not for everyone else. Make sure
they can subscribe to that view so its available with fresh data the the power users create reports only for themselves, not the general
next time they open their reporting tool. audience. If they come up with a view of data that can help execu-
tives and managers make better decisions, then that viewalong
These standard interactive reports usually take the form of a dash- with data set and information tools required to produce itneeds to
board, scorecard, or parameterized report that enables users to be adopted by the report governance committee and moved into a
change a predefined view by selecting filters from a pick list or global report library for all to access.
other graphical mechanism. As a result, these reports often give
users the impression that they performing ad hoc queries against conclusion
all the data when, in reality, their access is circumscribed by a In adolescence, we swing wildly from one passion to another, car-
predefined set of metrics, attributes, and filters. The BI team needs ried away by the newness and potential of our object of interest. In
to monitor usage and examine which elements are being used and adulthood, we learn that there is a price to pay for our excesses,
which arent and perform periodic selective pruning to keep the and we seek to find balance amidst the extremes.
reports relevant and fresh.
In the world of BI, organizations often are carried away with the
Report Governance. Guess who needs to create these standard notion of self-service empowerment and fall prey to reporting
interactive reports? Yes, its the IT department or its successor in chaos. To remedy this situation, organizations need to achieve bal-
this space, the BI team. But unlike in the days of old, the BI team ance between self-service BI for a select few and tailored delivery
does not serve as a custom report development shop. Its role is of information for the majority. This will give organizations a stronger
to examine global requirements, create a library of standard inter- foundation upon which to leverage information for insights and
active reports, and establish a governance process for adding, business gain.
deleting, and modifying the reports. A governance committee,
To help you make your way through EntErprisE BusinEss pErfOrmancE managEmEnt
the many powerful case studies intElligEncE pages 5257
pages 617, 2535
and lessons from the experts Performance management uses business
articles in What Works in Enterprise business intelligence involves intelligence tools to monitor and manage prog-
deploying query, reporting, and analysis ress toward achieving strategic objectives and
Enterprise Business Intelligence, capabilities to all employees who can goals represented in budgets and other plans.
we have arranged them into specific benefit from them as well as to customers
and suppliers.
categories: Enterprise Business p r E D i c t i v E a n a ly t i c s
Intelligence, Search BI, Open pages 5862
sEarch Bi
Source BI, Data Governance, pages 4041 Predictive analytics uses analytical models
Performance management, and based on statistical and machine-learning
BI search applies keyword search capabilities algorithms to describe or predict patterns
Predictive Analytics. What do to structured data and BI reports, making it within large volumes of data to help companies
these terms mean, and how do possible for users to find reports, generate better anticipate events and behavior.
queries, and find related analyses with a
they apply to your organization? simplified user interface.
OpEn sOurcE Bi
pages 4245
D ata g O v E r n a n c E
pages 4647
c a s E s t u Dy
StubHub Scales to
Explosive Growth
Commentary by Rob Singer
Director of Business Intelligence, StubHub and no visibility into the dynamics of its Web meet the objectives and stretch investment
site. (It had no Web analytics function.) in the initiative. Combining open source
technology with best-of-breed software tools
summary Because of the two-gigabyte storage limit from Business Objects, Oracle, Omniture,
StubHub, a rapidly growing online market- for Access databases, StubHub constantly and SAS, StubHub used a phased approach
place, had limited visibility into current data, pruned the database to make room for new to deploy an extensible BI/DW infrastructure,
customers, and business drivers, which data, reducing the richness of its data in the leading to the following measurable results:
threatened the long-term survival of the busi- process. By June 2005, StubHub devoted
ness. The root of these problems was an an average of 16 hours a week to loading the 1. By moving from Access and Excel to
inadequate technology infrastructure, but data warehouse, refreshing the pivot tables, Oracle and Business Objects, StubHub
StubHub did not have the resources to make and notifying employees via e-mail when migrated to a best practices model for
an expensive overhaul to address its IT needs. refreshed reports were ready. With delayed data warehousing and report distribution
and static reporting, StubHub had minimal that reduced data latency and switched
Faced with these challenges, StubHub understanding of its customers, it competi- from a manual, weekly data refresh to an
invested in a business intelligence (BI) and tors, or its key business drivers, and decision automated nightly data refresh. Migrating
data warehouse (DW) initiative, using limited making was based on gut feel instead of to the automated environment, StubHub
resources. The StubHub BI/DW initiative being data driven. Clearly, it had to make cut costs through staff reduction, result-
emphasized investing in specific technologies significant changesfast. ing in $150,000 in annual savings.
to empower end users and to free up existing 2. Creating a marketing allocation report
staff resources, reusing existing technology StubHub assembled a steering committee (called NORAD) that calculates key mar-
investments, and employing open source and a business intelligence team to assess keting performance metrics, such as cost
technologies where possible. requirements, evaluate options, and ulti- per order (CPO). NORAD merges trans-
mately build a scalable BI/DW infrastructure actional data with several external data
With a total budget of $750,000 (42 percent that could support StubHubs explosive feeds to associate transactions with the
staff, 42 percent new licenses, and 16 per- growth and contribute to business value. marketing channels that drove them. The
cent training), and ongoing maintenance of Composed of executives, BI professionals, report enables StubHub to understand
less than $100,000, StubHub realized $22.4 and end users from different disciplines at the dynamics of its numerous marketing
million in savings in 2006directly attrib- StubHub, the steering committee established channels and enables the marketing team
uted to returns from improved processes key goals, which included: to optimize its marketing spend on a daily
and reduced staff. Additional savings sprang basis. In 2006, NORAD reduced CPO by
from enhanced reporting capabilities, giving 1. Creating a scalable and extensible IT 33 percenta savings of $15.6 million.
StubHub executives and end users invaluable infrastructure to enable dynamic report- 3. The new infrastructure permitted the
insight into current data, customer behavior, ing, provide access to rich current and development of a daily report that tracks
and key business drivers. historical data, and reduce data latency. each StubHub sellers dropped-order
2. Providing actionable customer insights, to rate. These dropped orderswhere a
Business impact include defining key customer segments, seller is unable to provide the purchased
StubHub is an online marketplace where fans quantifying customer lifetime value, and ticketsnegatively affect customer sat-
buy and sell tickets for live events. Since its creating customer behavioral profiles. isfaction and increase operational costs
founding in 2000, it experienced triple-digit 3. Providing tools to maximize site conver- by creating significant customer service
year-over-year growth, becoming a market sion rates, marketing effectiveness, and activity. Reducing StubHubs overall
leader and putting strains on its existing customer loyalty. dropped-order rate was a key strategic
information management infrastructure. 4. Identifying key business drivers and priority for 2006. Using the daily report,
defining key company metrics. which includes alerts to the customer
Through mid-2005, StubHubs business intelli- service team, enabled StubHub to work
gence function relied entirely upon a Microsoft The team also needed to accomplish these proactively with sellers to improve their
Access databasethe source for about 40 goals using creative approaches and leverag- performance, and resulted in a decrease
Microsoft Excel pivot tables residing in a ing existing resources wherever possible. It in its dropped-order rate by 31 percent
shared network file directory. The company developed a detailed roadmap and project saving $600,000 in costs. Using the
had minimal insight into customer behavior plan with clear, measurable milestones to report to monitor dropped orders and
alerting the customer service team to that enables dynamic reporting and provides milestones with minimal external depen-
potential problem areas has enabled rapid access to current and historical performance dencies (to maximize success rates)
problem resolution and, ultimately, a sig- data. StubHub now has a 360-degree view of Using an ROI-driven approach for project
nificant increase in customer satisfaction the customer, company-wide dissemination prioritization
4. StubHub continually monitors Web site of critical company data, and the quantifica- Running in parallel environments until
activity using Omniture. With its real-time tion and monitoring of key company metrics. core functionality and reports are fully
reporting capabilities, Omniture enables migrated and fully tested
StubHub to make ongoing changes The new database and reporting environment Adhering to industry-standard best
to its Web site, which increased the was developed and deployed in eight months practices, including using a traditional
site-conversion rate of 8.5 percent in (six months of coding, two months of parallel star-schema data model, a software
2006resulting in $5.4 million in addi- testing). StubHub completed phases one and development lifecycle methodology, and
tional revenue. two of its enterprise reporting goals, migrat- data quality techniques
5. StubHub moved from an exclusively ing key Excel pivot tables to Business Objects Delivering quick wins with key reports
push-based reporting environment, reports, delivering sandboxes for scalability, to demonstrate and reinforce value to the
where BI analysts developed all the and producing value-added reports, such as organization
reports, to a push-pull environment, the marketing allocation report. Another key Adhering to a 12-month rollout and three-
where end users are more empow- achievement was StubHubs standardization of year strategic plan for implementation
ered. End users, including marketing, terms, including the definition of all metrics.
business development, finance, and innovation
customer service, now access more StubHub now continuously maintains a rolling StubHub, like many midmarket companies, is
than 300 customizable standard two-year roadmap to build on the platform focused on keeping costs as low as possible,
reports. Further, StubHub established and continue driving business value through and the team needed to find innovative ways
sandboxeshighly interactive subject- actionable intelligence. The next phases to achieve an enterprise-class implementa-
area reportsthat business owners include the deployment of Business Objects tion on a limited budget. The team used
use to tailor reports to fit their own Dashboard Manager to monitor StubHubs key novel approaches to that goal, including:
business needs. Because StubHubs performance indicators. The dashboards will
business users can answer their own give executives focused, efficient delivery of Using open-source, on-demand, and
questions, StubHubs BI analysts could mission-critical data. The long-term roadmap free/bundled software for its commodity
focus on answering strategic business includes enhancing operational reporting technology needs so that it could focus
questions. In 2006, they were able to capabilities; StubHub is building the founda- its limited software expenditures on
quantify customer lifetime value, identify tion for providing business activity monitoring, value-added and best-of-breed tools
key customer segments, and develop balanced scorecards, and predictive analytics. Extensive use of sandboxes, minimizing
high-impact reports like NORAD and the BI headcount and enabling the BI team to
dropped-order report. relevance focus on delivering value-added projects
6. Executives and business users now have StubHub leveraged industry best practices Repurposing hardware to reduce capital
visibility into key company drivers. They that can be adopted easily by similar organi- expenditures further
are engaged with the data and constantly zations. These practices include: Collaborating with partner groups to
respond to customer and competitive create new reports and functionality to
activity. With greater understanding of cus- Obtaining executive buy-in upfront by ensure that the BI team does not build
tomer buying patterns, StubHub is able to securing an executive sponsor and imple- anything that goes to waste. All partici-
anticipate demand and deploy changes to menting a proof of concept pants understand the value of what is
its marketplace in near real time to accom- Assembling a cross-functional team to built and are taught how to use it, result-
modate market-changing events. ensure full organizational buy-in and to ing in organizational buy-in and a high
provide an appropriate enterprisewide adoption rate. l
maturity perspective that aligns deliverables with
StubHub achieved all objectives of its BI business goals StubHubs innovative solution received a 2007
Best Practices Award from TDWI (see page 63).
initiative: It successfully replaced its failing Developing a detailed project plan that
Access database with a stable, scalable, includes a phased approach and clear
and extensible data warehouse environment
Business Value
projects successful. In particular,
By Timo Elliott organizations must consciously
Senior Director, Strategic Marketing, invest in wider, simpler access
Business Objects
for the other 85%the non-
Information
expert users.
Infrastructure
Its hard to think of an IT initiative that has BI Projects
as much potential to add value to todays
information-rich organizations as enter-
prise business intelligence (BI). Although Limit the number of self-service users Making information actionable by embed-
individual BI projects typically are very suc- ding BI directly into operational systems
cessful, many organizations stumble on Moving from a series of successful BI at the point of decision
their journey from initial project successes projects to enterprisewide BI deployments
to enterprisewide deployments. According involves changing some of the habits that This information infrastructure approach
to a recent Economist study, fewer than one made the initial projects successful. In par- puts the right framework in place for a
in 10 executives consider that they receive ticular, organizations must consciously invest culture of information use and fact-based
information when they need it, and fully 56 in wider, simpler access for the other 85 decision making. It fosters a spiral of
percent are concerned about making poor percentthe nonexpert users. increasing numbers of employees accessing,
choices because of faulty, inaccurate, or analyzing, and sharing dataand improving
incomplete data. Todays organizations should look to the operational performance.
success of Web 2.0-inspired initiatives
enterprise Bi success requires collaborative, Web-based communities such Supporting this information infrastructure
relearning some Key skills as Flickr, MySpace, and Facebook. Rather typically requires organizational and technol-
Just as Tiger Woods decided that he needed than focusing on advanced functionality, ogy changes. Some form of BI competency
to relearn his swing in order to take his these organizations start out with simple, center is essential, tasked with the optimal
game to the next level, organizations must useful functionalitymaking it easy to sign use of information across the organization as
reconsider some of the basics of their BI up, participate, and collaborate within the whole. One key task of the BI competency
deployments in order to move to enterprise community. Only after these organizations center is to standardize the BI products used
BI. In BI, just as in golf, some of the skills establish a community comfortable with the in the organizationfavoring easy-to-use,
and approaches typically associated with ini- basics do they implement more sophisticated Web-based systems that have the openness,
tial individual successes may actually hinder features and applications. breadth, and integration necessary to support
success at the enterprise BI level. the variety of environments, applications, and
implementing an information profiles that exist throughout the organization.
Individual BI projects typically focus on infrastructure
expert users who work with high-value infor- Enterprise BI success requires an approach conclusion
mation. This is a great place to start, but similar to the easy-to-use Web 2.0 models. Enterprise BI projects often fail because the
its easy to overdeliver to a small number of After several key successful projects are in majority of business users have little or no
vocal, technical users (generally estimated to place, progressive companies start filling in a connection with the BI system. Organizations
be 15 percent of the potential user popula- broad foundation of information use through- should invest in an information infrastruc-
tion), and miss the greater value of a broad out their organizations with the following ture that provides simple access to basic
deployment to less technically savvy users. elements: information for all usersnot just the BI
If experts are the only people using your BI expertsbefore attempting to implement
system, the temptation is to: A systems approach to data quality more complex systems. l
and monitoring
Fix problems such as data quality in a For free white papers on this topic, download
The Benefits of Business Intelligence
patchwork, ad hoc way Simpler data access for a broader range of
Standardization or Making a Strategic
users (and greater investment in training) Business Intelligence ChoiceA Checklist,
Tolerate poor ease of use and a confusing or click here for more information about
Business Objects.
variety of different systems An emphasis on collaboration and discus-
sion around data
c a s E s t u Dy
U.S. Defense
Commissary Agency
Enriches EDW with
Integration of XML
Data from Point-of-
Sale Systems
Commentary by Stan Ferguson
Chief, Data Management Division, DeCA
the Business In late 2006, DeCA began rolling out the first Be rapidly adapted to seamlessly inte-
The Defense Commissary Agency (DeCA) phase of a two-year, $200 million upgrade to grate XML/XSD and complex flat file data
supplies more than 12 million U.S. military POS systems at its 263 commissaries. Aging
customers with groceries, meats, and pro- NCR-based POS terminals and supporting Simultaneously integrate disparate data
duce at 263 commissaries around the world. software would be replaced by an IBM hard- from both legacy and new POS systems
Based in Fort Lee, Virginia, with more than ware and software package that DeCA called
18,000 employees, DeCA sold $5.41 billion CARTS (Commissary Advanced Resale Trans- Support greater load frequency and
in goods in 2006 at a 5 percent surcharge action System). The CARTS system offers reduce commissary restock time
over cost, saving customers more than 30 touch-screen and self-service checkout, as
percent over commercial prices. DeCA takes well as greater efficiency and reliability. the solution
customer satisfaction seriously, as dem- DeCA first selected PowerCenter in 2000 for
onstrated by a 4.61 satisfaction rating by CARTS also introduced a challenge for the its near-universal access to data, codeless
customers on a five-point scale. data integration processes that drove POS development environment, and flexibility for
information to the EDW. DeCA would need to future growth. By implementing PowerCenter
the challenge adapt its warehouse integration architecture for data warehousing, DeCA IT personnel
An enterprise data warehouse (EDW) is to accommodate XML/XSD data from the new and data integration experts from Claraview,
central to DeCAs strategic objective of cost- POS systems, while simultaneously integrating a Virginia-based consultancy specializing in
effective customer service. Throughout the flat file data from legacy POS systems. business intelligence, were knowledgeable
2000s, DeCA has expanded the warehouse in its capabilities. After due diligence, DeCA
that it uses to collect and track data gener- In the past, PowerCenter had sourced and decided that PowerCenter was ideally suited
ated by point-of-sale (POS) systems from delivered uncomplicated flat files generated to help it transition to the XML/XSD and com-
commissaries in the U.S. and around the by the POS terminals to the EDW. CARTS plex flat file processing required by CARTS.
world. DeCA uses the Informatica Power would use complex XML files based on an
Center platform to source POS data and industry standard XSD (XML Schema Defi- Initially, we had concerns over the data
channel it to a Teradata-based EDW. nition) as well as complex flat files derived integration challenges that arose as we
from the transaction data files. Naturally, looked at phasing in our new POS system,
With the EDW, hundreds of DeCA regional, this introduced new complications and chal- said Stan Ferguson, chief, data manage-
zone, and store managers have improved lenges on how the data would be integrated ment division, DeCA. But Informatica
customer service and product offerings into the warehouse. PowerCenter has let us quickly adapt our
by analyzing sales by time and geography, infrastructure to handle complex file data
promotion effectiveness, product affin- In addition, DeCA envisioned moving to a integration with our EDW with no disruption
ity, checkout time, and other dimensions. more real-time system by which POS data to our core business processes.
Importantly, the EDW also supplies data to loads to the warehouse would occur incre-
DeCAs computer-assisted ordering system mentally throughout the day, rather than PowerCenters support for complex files such
to help ensure that products customers want once a night. DeCA needed a data integra- as XML/XSD and complex flat files meant
are in stock. tion solution that could: that DeCA could readily access and integrate
continued on page 10
c a s E s t u Dy
Redefining EDW:
Data Integration
Requirements for
Enterprise Data
applications in a flexible manner as part accelerates the time to market for new
Warehousing of a service-oriented architecture (SOA). projects, at lower implementation costs
EDW must also provide relevant business and risk.
By Judy Ko
Senior Director, Product Management, context for the data, so that the consum-
Informatica Corporation ers of the data are able to interpret it in a architectural considerations
meaningful way. One of the critical considerations for deploy-
ing EDW is creating an architecture that can
Data warehousing was once a siloed activ- TRuSTED, cERTIfIABly AccuRATE DATA support the data requirements of all types
ity dedicated to business intelligence and EDW must equip organizations to manage of applications. To succeed in achieving
reporting at a departmental or business unit data quality in a metric-driven, program- enterprisewide visibility, businesses need a
level. Over the last five years, however, the matic fashion. Maintaining data integrity seamless mechanism for users to access
brisk pace of change coupled with grow- and security across extended teams operational data in various transactional sys-
ing regulatory requirements has forced data throughout the data integration lifecycle tems and analytic data in data warehousing
warehousing into a mission-critical, opera- is required to meet regulatory compliance environments through a single abstraction
tional role. Meanwhile, technologies have and governance objectives. To ensure layer. This mechanism is data services.
matured to the point where they can support confidence in the validity of enterprise
these enterprise requirements. data, information as well as data flows By taking a service-oriented approach, IT is
and relationships must be auditable able to reuse data access, transformation,
Data warehousing has now evolved into a and traceable. and quality logic across multiple environ-
strategic, enterprisewide initiative that sup- ments, reducing the time to implement new
ports multiple business applications. An analytics functionality. IT is also able to lever-
To live up to its potential, enterprise
enterprise data warehouse is a common data age this same infrastructure to make the
foundation that provides any and all data for data warehousing must function data in warehouses relevant and available for
business needs across applications and divi- operational purposes, such as single-view
atop a data integration platform
sions. Enterprise data warehousing (EDW) is applications for improved customer service.
the process of designing, building, and man- that powers an ongoing lifecycle
aging an enterprise data warehouse to meet Finally, the data services infrastructure is
of data access, discovery, quality,
the requirements of consuming applications. able to support users who require data at
integration, and delivery from varying levels of latencybatch, real time,
Key capabilities of enterprise data virtually any system. and near real time. As business processes
warehousing evolve and businesses move from traditional
To live up to its potential, enterprise data decision-support systems to more operational
warehousing must function atop a data EnTERpRISE-clASS DEploymEnT READInESS decision making that requires operational
integration platform that powers an ongoing EDW must enable organizations to deliver business intelligence, the ability to support
lifecycle of data access, discovery, quality, data with scalability and high perfor- these varying latencies through an enterprise
integration, and delivery from virtually any mance, matched to the varying needs of data warehouse environment built on a data
system. Key capabilities that characterize an each business application. Adaptability services infrastructure has become a critical
enterprise data warehouse include: and flexibility in selecting appropriate factor for success. l
data integration methods within the EDW
BuSInESS RElEVAnT DATA AcRoSS is also critical to optimizing performance For free white papers on this topic, download
Redefining Enterprise Data Warehousing
ThE EnTERpRISE and costs. Real-time availability of data
(EDW): The Imperative for Taking Your Data
EDW must allow organizations to access, to front-line staff as well as executives Warehousing Practice Enterprise-Wide or
discover, and integrate data from virtually increases operational agility and on-the- Making Data Work: Addressing Data Quality
at the Enterprise Level, or click here for more
any business system, in any format. It ground intelligence. Finally, gathering
information about Informatica.
should deliver data throughout an enter- skilled resources and best practices
prise via data services to support multiple within an Integration competency center
c a s E s t u Dy
Alpharma
Pharmaceuticals
cal and ad hoc reporting capabilities needed
LLC: Improving to meet reporting needs. We also were
unable to track the sales performance of the reporting capabilities against this data.
Pharmaceutical companys flagship products and other sales Biltmore provides this hosted Web-based
initiatives efficiently. The Alpharma Pharma- solution to Alpharma, enabling the phar-
Sales and Marketing ceuticals sales group was unable to target maceutical company to analyze pre- and
the right prescribers or measure the impact post-marketing campaign data, prescribing
Effectiveness of our marketing initiatives in a timely fash- habits of target doctors, sales representative
ion. Alpharma Pharmaceuticals also wanted effectiveness, and product performance.
Commentary by Freddie Hannibal
Director of Sales Operations, Alpharma pharmaceutical data to be made available
Pharmaceuticals LLC more quickly to our user community. With the Biltmore-MicroStrategy solu-
tion, Alpharma Pharmaceuticals receives
We chose Biltmores BI solution a monthly briefing book that includes a
Alpharma Inc. is a global specialty pharma- wide variety of valuable reports customized
ceutical company with leadership positions
My Vital Signs Rx, anchored by the for each user across the organization. For
in products for humans and animals in more MicroStrategy platform, to provide example, an analyst accesses a report that
than 60 countries. Alpharma Inc., through lists prescribers and alerts decision makers
ad hoc query and reporting capabilities.
its subsidiary Alpharma Pharmaceuticals of upward or downward prescribing patterns.
LLC, has a growing, branded pharmaceutical With the Biltmore-MicroStrategy The vice president of sales accesses execu-
franchise in the chronic pain market with its solution, more than 200 users are tive dashboards that provide a pulse of the
morphine-based extended release Kadian business with one click to follow new product
product. In addition, Alpharma Inc. is among able to access dashboards, perform introductions and sales trends of existing
the worlds leading producers of several spe- analytics, and run intuitive reports, products. A district manager analyzes the
cialty pharmaceutical-grade bulk antibiotics success of a marketing campaign and learns
thereby improving Alpharmas sales
and is internationally recognized as a leading who is performing above or below goal.
provider of pharmaceutical products for poul- and marketing effectiveness.
try and livestock. Field users receive personalized briefing
Freddie Hannibal, Alpharma Pharmaceuticals LLC
books containing information about their
Biltmore Technologies offers My Vital Signs specific geography. Internal users receive
Rx, a hosted sales and marketing data Alpharma Pharmaceuticals conducted an personalized briefing books and can also
warehouse solution designed specifically for extensive review of pharmaceutical report- access and execute ad hoc queries via a
small to midsize pharmaceutical and bio- ing applications and found that Biltmore robust reporting library.
tech companies that lack the business and Technologies solution exceeded all of our
technical expertise to support their own data user requirements. We chose Biltmores BI results
warehouses. With My Vital Signs Rx, which solution, My Vital Signs Rx, anchored by the Alpharma Pharmaceuticals LLC has a single
is anchored by MicroStrategys business MicroStrategy platform, to provide ad hoc data source for all sales and marketing
intelligence software, pharmaceutical and query and reporting capabilities to the field business-critical reporting to support key
biotech companies are able to monitor new sales force, sales operations, sales and mar- business strategies, including the manage-
product introductions and track the sales keting managers, market research analysts, ment of its continued business growth. Users
performance of existing products, analyze the and executives. With the Biltmore-MicroStrat- are empowered with easier access to consis-
success of marketing campaigns, and deter- egy solution, more than 200 users are able tent and accurate data in a more complete
mine sales force and targeting effectiveness. to access dashboards, perform analytics, and and timely fashion, with the MicroStrategy
run intuitive reports, thereby improving Alp- platform enabling greater ad hoc querying
challenge harmas sales and marketing effectiveness. and analytical capabilities. Users can analyze
Alpharma Pharmaceuticals LLC was chal- data directly against the data warehouse for
lenged with finding a better BI reporting solution analysis and decision making that was not
solution and empowering the sales represen- Biltmore integrated Alpharma Pharma- possible before. The result: more precise
tatives in the field with the right information ceuticals sales force automation data and analysis of prescriber targets, more effective
at the right time. Our previous BI solution its syndicated data and partnered with call plans, and more focused sales and
lacked the robust and sophisticated analyti- MicroStrategy to leverage its analytical and marketing campaigns. l
Every CIO who has invested in a data mart limited success. The subtleties of report like bookmarking a useful Web site, and can
or data warehouse faces a daunting problem design and the mechanics of design inter- then access it directly in the future. In this
of report development backlog. Even though faces limit this solution to only power users. way, users can create new report designs as
BI projects start off with modest report- Even then, 1,000 power users would need a natural part of their investigative process
ing requirements of 20 reports for the HR to create 1,900 reports each to satisfy all without ever having to learn how to design a
department and 15 reports for Finance, the realistic demands. report. Whats more, users can share those
report requests quickly balloon well beyond newly created report designs with other
this initial set. It seems as if every report The more practical answer lies in a lesson people without fear of exposing inappropriate
inspires the user to request two more related learned from the Internet where almost one data, because the ROLAP system automati-
reports to help answer questions raised in billion people browse and find information cally applies personalized security filters to
the original report. without becoming Internet programmers. every report regardless of how that report
While HTTP, search, and browsing works for was created or by whom.
To provide an idea of how serious this prob- Internet documents, a different technology
lem is, consider the vast number of reports is needed for surfing through the data ware- With ROLAP enabled self-service report-
that can be generated from even a modest house. That technology is relational online ing capabilities, such as object prompting
size data mart. Imagine a data mart with analytical processing (ROLAP). ROLAP and drill anywhere, users are empowered to
the following: allows a handful of reports to deliver the design their own reports exactly to their spec-
same analytic range as thousands of tradi- ifications. Streamlining the reporting process
5 dimensions tional reports using two powerful features enables any business user, not just power
unique to ROLAP: object prompting and users, to efficiently access the data they need
10 attributes per dimension drill anywhere. to manage their area of the business. l
10 metric areas Object prompting allows users to freely select For a free white paper on this topic, download
Enterprise Business Intelligence: Improving
any attributes and metrics to appear on a
Corporate Performance Through Integrated
20 specific metrics in each area report each time they run the report. Once Reporting, Analysis, and Monitoring, or click here
a user selects initial attributes and metrics for more information about MicroStrategy.
If we assume that all users will only ask for and runs the report, he or she can drill down
one simple uniform report structure con- anywhere within the multi-dimensionally
taining two attributes and two metrics, and modeled warehouse and, thus, successively
consider all the potential combinations and surf through combinations of data using
variations of data in the data mart, it would simple right mouse click actions.
require a staggering 1.9 million different
reports to show all the useful combinations of In this unique model of self-service, users
the data. (This even assumes that not all attri- see new combinations of data that might
butes need to be combined with all metrics.) have never been explicitly designed before,
because the ROLAP system can dynami-
The traditional response to this problem cally assemble any combination of attributes
proffered by BI vendors is to encourage on the fly. Once a user finds a useful new
users to design their own reports using self- combination of data, they can save that
service. However, this strategy has only had combination as a newly created report, just
c a s E s t u Dy
Pitney Bowes
Improves Total Cost
of Ownership with
Enterprise Business
Intelligence
Commentary by William Duffy
Data Warehouse Project Manager, Pitney Bowes Inc.
to a salesperson, need a repair on a piece of helping us deliver the best possible service
equipment, or need to talk to someone about said Duffy.
Pitney Bowes is a mailstream technology a bill, Duffy said. Managing all that informa-
company that helps organizations worldwide tion is a huge challenge. So Pitney Bowes Oracle business intelligence provides laser-
manage the flow of information, mail, docu- sought continuity and compatibility with its like visibility into the performance of every
ments, and packages through its integrated CRM solution and broader IT infrastructure, sales rep, Duffy said. We can better under-
mail, messaging, and document manage- which includes several Oracle databases in stand how agents are spending their time
ment solutions. Its 35,000 employees deliver its data warehouse environment. Oracle is and whats not working. Oracles business
technology, service, and innovation to more our primary database platform, with well over intelligence is key to our success in manag-
than two million customers worldwide. It 600 different production databases installed. ing key performance indicators in call center
operates four call centers and employs 1,250 We are running Oracle Real Application productivity, field service organization, and
sales associates and 1,500 field service rep- Clusters in some of our high availability envi- effective campaigns.
resentatives in North America alone. ronments, Duffy said.
On the marketing side, Duffy noted, Our
Pitney Bowes turned to Oracle for a compre- biggest challenge was creating campaigns
With Oracles business intelligence
hensive business intelligence (BI) solution and using the data effectively to understand
that not only brought cohesiveness and solution, we were able to deliver the buying and service behaviors of the cus-
greater analytical capabilities to its sales and tomer. Now analytic dashboards drive every
more than 400 reports to a large
marketing operations, but would also work in important customer retention campaign,
the context of Pitney Bowes multifaceted IT organization with just one person including identifying and targeting customers
infrastructure. Our technology requirement with expiring leases. By enabling marketing
now thats cost effective.
spans more than 10 legacy systems deployed to segment customers, we can ensure that
on different technologies, said William Duffy, William Duffy, Pitney Bowes Inc. we call the right customers at the right time
data warehouse project manager at Pitney so we can retain those customers and gener-
Bowes Inc. Oracle Business Intelligence ate new business.
Enterprise Edition was one of the few BI tools Pitney Bowes needed to enable its sales
capable of meeting the challenge. representatives to associate each customer Taking advantage of the prebuilt Oracle BI
inquiry with a type of accountlarge or applications, Pitney Bowes was able to reduce
Over the past few years, Pitney Bowes has smallto ensure they were providing the the total cost of ownership of its BI infrastruc-
been on a nonstop growth trajectory, fueled appropriate level of service. Its Oracle solu- ture and also integrate BI into its business
by a string of acquisitions and a worldwide tion now allows each representative to processes. Because the solution is based on
push to expand its service operations. To immediately access all information on a hot-pluggable architecture, the company
ensure that all customersnew or oldre- each customer. can get insight from its legacy systems and
ceive fast, appropriate services and offerings, third-party solutions and analyze information
the company launched a program called We needed a business intelligence solu- from historical and real-time data sources.
The Power of One in 2002, which sought tion that would provide all customer-facing
to provide customers with a consistent expe- associates with the same customer informa- Other benefits achieved include enhanced
rience across all business units. tion in real time so they understand who the sales productivity through better customer
customer isregardless of the customers insight, increased responsiveness of sales
Pitney Bowes receives approximately 30,000 location, history, and time with Pitney Bowes. associates, leading to greater customer satis-
customer calls daily. On any given day, each We also wanted to be able to analyze pro- faction, and improved marketing effectiveness
of those customers has the potential to speak ductivity and performance, which is key to with better segmentation and targeting. l
Todays Enterprise
Business Intelligence
By Jos Villacs
Director, Business Intelligence Product Marketing,
Oracle Corporation
Business intelligence (BI) continues to evolve Thats why were embedding BI technology information technology, desktop operation
and become even more strategic, both within in the processes that our employees use all and maintenance, center communications,
organizations systems infrastructure and as the time. Our strategy involves delivering BI test utility operations, environmental safety,
part of the daily working tools used by decision information at the point of contactideally industrial health, and quality assurance,
makers. One of the main characteristics of at the exact moment that its needed. (See among other performance indicators.
enterprise BI today is greater, all-encompass- Radiating Intelligence, David Baum, Oracle
ing insight into business operations and the Magazine, March/April 2007.) British Telecom is one of the worlds largest
individual contribution of business processes providers of telecommunications solutions,
in the overall performance of the business. The concept of providing employees with a with operations in 170 countries. More
complete view of their investors is not new; than 10,000 users in various divisions rely
This concept of pervasive BI is marked by the but its easier said than done if youre not on Oracle technology to analyze customer
delivery of intuitive, role-based intelligence to using state-of-the-art BI technology. behavior, develop customer demand, and
senior management and front-line employees streamline financial planning processes by
alike, not only providing insight about their Enterprise BI technology is adopting an enterprise approach to measur-
functional area, but also about the organiza- ing performance.
tions performance and how they contribute marked by its capability to integrate
to it. This is based on a set of uniform defini- with diverse and dispersed sources Enterprise BI technology is also marked by
tions recognized and agreed upon throughout its capability to integrate with diverse and
the organization and also used by a variety of of information throughout the dispersed sources of information through-
financial and operational systems leveraging organization. out the organization. This is referred to as
service-oriented architectures (SOA). hot-pluggable, meaning that BI imple-
mentations must be open and modular.
Consider TIAA-CREF, a national financial Its not just about sales metrics or service The goal is to allow companies to use and
services organization with more than $414 metrics, Zimmer continues. Its also about easily leverage their existing data sources,
billion in combined assets under manage- cause and effect. When you can connect middleware technologies, and other systems
ment (3/31/07) and the leading provider marketing, service, and sales, you start to see regardless of environments and state of
of retirement services in the academic, relationships that werent obvious before. implementation maturity.
research, medical, and cultural fields. It has
more than 1,500 call center agents serving Another characteristic of todays enterprise BI In summary, the three key characteristics of
3.2 million individual investors, and 600 field is organizations recognition that the technol- enterprise BI today are: 1) it should provide
agents serving institutional investors. ogy goes beyond a particular type of query, a comprehensive view of enterprise perfor-
reporting, or analytics tool typically delivering mance; 2) it should be pervasive; and 3) it
TIAA-CREF embeds Oracle BI capabilities siloed information. Enterprise BI is a compre- should help extend the value of existing tech-
within its customer relationship management hensive portfolio of technologies, involving nological investments. l
(CRM) applications to improve front-line financial performance management, opera-
sales, support, and case management. This tional intelligence, transactional applications, For a free white paper on this topic, download
Business Intelligence and Service Oriented
way it enables call center agents to quickly and data repositories.
Architectures, or click here for more
identify particular situations, notify key people information about Oracle.
to take action, and trigger workflows that start For example, at the Arnold Air Force Base,
or change a related business process. Arnold Engineering Development Centerthe
nations largest complex of flight simulation
Most people dont have time to search test facilitiesuses Oracle BI technology
for problems and opportunities by look- to help monitor center-wide activities. This
ing through daily reports, explains Kurt includes operational maintenance of a wide
Zimmer, vice president of CRM Delivery. variety of unique aerospace test facilities,
c a s E s t u Dy
Information as a
Service Delivers
Consistent Information
for Business versions of key reference, customer, and initiative and enables them to respond more
vendor information. Executives worried that quickly to market needs and more rapidly
Intelligence the lack of consistent data could affect certifi- identify new opportunities.
cation and legal reporting processes as well as
Commentary by Sean T. Crowley
Market Management, IBM Information Integration the overall accuracy of decision making based For example, with IBM Information Server
Solutions, IBM Software Group on their business intelligence applications. software, the IT staff has created more than
100 reusable integration objects and inter-
information as a service faces to enable the collection, integration,
For any retailer, sustaining growth requires To enable change and gain greater value and transformation of data. These compo-
ongoing innovation. At one of North Ameri- from its raw business data, company execu- nents can be plugged into new applications
cas largest retailers, enriching category and tives focused their IT teams on creating to enable them to share information with any
item planning and streamlining product intro- information services that could be readily of the companys database subsystems and
ductions help the company get new products available to any process, person, and appli- existing applications.
to market more quickly. Real-time visibility to cation as needed.
sales and order status, in-store kiosks, and As a result, the company has been able to
service desk enhancements help improve the reduce the time and cost of developing new
The retailer has been able to
customer experience and further differenti- applications and take advantage of existing
ate their brand. New efficiencies in managing reduce its application development legacy applications when creating new Web-
stock and collaborative forecasting and based services.
time dedicated to integration by
replenishment help ensure that the products
customers want are readily available on store up to 85 percent, with integration- cost-effective delivery of accurate,
shelves. In order to succeed in these efforts,
related development requiring timely information
they needed a solid foundation that provides Through the use of IBM Information on
accurate information wherever and whenever between 3 percent and 6 percent Demand technology, the company can now
its needed. deliver information as a service, making it
of developers time.
available to those who need it, when they
complexity hampers progress need it.
However, with multiple disparate applications In order to achieve its desired result, the
and multiple platforms, databases, data entry company leveraged a service-oriented On the IT side, application development and
points, and transaction processing protocols, architecture upon which applications would integration at this company is dramatically
business and IT staff were concerned with be autonomous from information sources faster than the industry average. The retailer
the accessibility and accuracy of information. and would not share any database directly. has been able to reduce its application devel-
Knowledge of interconnections would be opment time dedicated to integration by up
For each new application, developers had removed from both the source application to 85 percent, with integration-related devel-
to write code to share information between and the target data source and would be opment requiring between 3 percent and 6
applications and supporting data sources. stored centrally. percent of developers time.
Even off-the-shelf applications often needed
to be customized. And each time application By looking at information as a service and On the business side, faster development
changes were made or new software versions decoupling it from the actual applications, means faster time to market with new ser-
released, the code would need to be rewritten. the company could simplify operations, more vices and more time available to focus on
These processes were time-consuming and quickly adapt to change, and better leverage higher-value tasks. Additionally, with access
expensive and slowed the companys ability to their existing investments. to real-time data, business staff can gain
sense and respond to market opportunities. greater insight from existing information and
increased responsiveness with reduce the risks that come with using out-
Additionally, different applications often information on demand of-date, inconsistent, or bad information for
pulled and updated data to and from different IBM Information Integration software is at decision making and reporting. l
sources. It meant the existence of multiple the heart of this companys information
Q Gis seems to be deployed Q what exactly is ad hoc query Q how important is metadata
departmentally; can it be a and reporting and how can i for successful data
strategic enterprise resource? use it to improve adoption of my warehousing projects?
Bi solution?
A ESRI has developed its products based A Extremely important. A centralized
on open standards, ensuring a high level A Ad hoc tools allow users to spontane- metadata repository for information
of interoperability across platforms, ously browse, slice and dice, and discover integrationone that supports analysis
databases, development languages, and aggregate intelligence and detail evidence. and active sharing of metadata artifacts
applications. ESRIs GIS applications are This contrasts with more static BI models across a full range of integration activities
engineered to be an integral part of an where subscribers receive reports predeter- and user rolesincreases the trust and
organizations strategic IT infrastructure. mined by power users. understanding of the information. These
Our use of Web standards such as XML, To provide such an application, rel- artifacts include: technical metadata
SOAP, UDDI and WSDL has led to suc- evant datastores (e.g., a data warehouse or about the various sources of informa-
cessful enterprise SOA implementations internal/external sources) are connected to tion; business metadata that describes
where specific location services such as a data cleansing, text analytics, and high- the business meaning and usage of infor-
geocoding, are being used throughout the performance index and query engine. On mation; and operational metadata that
organization. Our support of standard this platform, one or more ad hoc entry describes what happens within the inte-
developer environments including VB, points can be provided (keyword query- gration process. As companies seek to
C++, .NET, and Java has led to integra- ing, dynamically built drill-down trees, gain a more comprehensive viewpoint
tions with all major BI platforms. etc.) to access real-time aggregates and of their information, they need a way to
distribution charts. keep track of how these different sources
With an ad hoc reporting tool, indi- are related and how information is being
A nA ly s t V i e w p oi n t
viduals can view the facts and figures pulled together and presented in report-
To date, most GIS deployments in main- relevant to their tasks, thereby increas- ing and analysis tools.
stream business (outside of specialized ing their performance and effectiveness.
utilities and energy systems, for instance) The combined intuitive simplicity and
A nA ly s t V i e w p oi n t
have focused on specific issues such as direct feedback are proven to dramatically
increase user adoption of BI tools. The need for regulatory compliance is a
store location, customer clustering, and
high-profile business driver that is prompt-
logistics. Lately, however, spatial data is
ing organizations to pay more attention to
increasingly featured in BI dashboards and A nA ly s t V i e w p oi n t
the management of metadata in data ware-
provides business users with a visual means Theoretically, ad hoc query and reporting
housing and operational systems. Leading
of understanding and analyzing information empowers enterprising business users to
metadata management tools feature robust
in a location-based context. Giving users explore data by drilling down, slicing and
lineage tracking, change analysis, and audit-
an opportunity to explore the capabilities of dicing, and conducting what-if analysis. The
ability features that can help organizations
GIS in dashboards is a good way to further dividends can be huge if a user discovers
better account for the iterations and lifecycle
adoption across the enterprise. Partnerships an unrecognized relationship that bears on
of enterprise information at a granular meta-
between GIS and BI vendors have made efficiency or the bottom line. On the other
data level. However, organizations need to
spatial analysis an option for many organiza- hand, organizations need to recognize that
be wary of the risk of architecting metadata
tions, and, interestingly, Web 2.0 sites such extending ad hoc query across a broad user
silos and should strive towards standards-
as frappr.com are helping to put spatial data base can mean that some users will waste
based, extensible metadata models that
more squarely on the map. hours running queries of little business
reduce, rather than add to, complexity in the
value, sometimes merely to satisfy intellec-
data management infrastructure.
tual curiosity. Organizations will profit by a
judicious allocation of ad hoc query capabili-
ties and by monitoring the usage and overall
effectiveness of these analytic tools.
Q what is the role of data Q use of business intelligence and Q how does microsoft plan
integration for enterprise analytics is not new. how have to democratize performance
data warehousing? customers requirements for management?
these decision-support solutions
A A critical consideration for deploying changed in the last few years? A Traditional inhibitors to the broad adop-
enterprise data warehousing is creating tion of performance management have
an architecture that can support the data A The change occurs in two areas: people been high costs associated with implemen-
requirements of all types of applications. and data. Organizations access and ana- tations, complex tools and user interfaces
This is a departure from traditional lyze less than 20 percent of the data they that require costly and time-consuming
thinking, in which the data warehouse collect from their business processes and training for employees, and confusion
was built to support a relatively limited systems. The nontechnical managers, over disparate systems and tools for the
set of reports and analytics, and was operational employees, business partners, various capabilities, including planning,
tightly coupled to the business intelli- and customers demand it, and we have budgeting, forecasting, analytics and
gence application. an opportunity to address the demands scorecarding. Performance management
In contrast, the enterprise data of masses of users. The interface for BI is tools and processes traditionally have
warehousing (EDW) process must func- no longer a complex tool or a manually also been siloed or stovepiped, mean-
tion atop a data integration platform generated spreadsheet; instead, it takes ing that they sit outside the day-to-day
that powers the ongoing lifecycle of data the form of custom applications, dash- business processes of most employees.
access, discovery, quality, integration, and boards, operational scorecards, maps, Office PerformancePoint Server 2007
delivery via data services that can support and data visualization elements. Data was designed to address and eliminate
multiple applications as part of a service- architectures for BI must go beyond the these inhibitors, enabling performance
oriented architecture (SOA). traditional data warehouse and incorpo- management across the enterprise, not
rate operational and third-party data, as just for the CFO and financial analyst.
well as new types of data.
A nA ly s t V i e w p oi n t
Because it spans multiple divisions and A nA ly s t V i e w p oi n t
geographic locations and is aimed at improv- A nA ly s t V i e w p oi n t Giving lower-level employees tools that
Over the past few years, broadened BI encourage contributions to enterprise per-
ing enterprise performance, enterprise data
adoption has given organizations a good formance is a sound idea. The concept of
warehousing puts an even greater premium
read on the insights and value that may be democratizing performance management,
on the quality, consistency, and accuracy of
generated by an effective BI deployment. a key theme in Microsofts rollout of its
data. As a result, the data integration pro-
Now customers are looking to build on PerformancePoint CPM solution, will prompt
cesses that support EDW are arguably the
success in several key areas, including: customer organizations to ask what per-
most important element in the EDW equa-
1) enhancing the business relevance of formance management means for a CFO
tion. Perfecting data integration technologies
data; 2) enabling more proactive decision- versus a call center rep versus other user
and processes for EDW can be a significant
making; 3) tightening real-time BI integration roles. Organizations that extend greater
challenge given the breadth and complexity
with business processes; and 4) improving performance management to lower-level
of enterprise data and the range of disparate
end-user trust in data accuracy. To achieve employees will need to safeguard informa-
source systems. However, organizations that
those objectives, customers are looking for tion access to ensure security of sensitive
sidestep this critical element introduce the
standards-based solutions that integrate in sales, productivity, and other performance-
significant risk of the garbage in, garbage
an SOA and reduce the complexity of siloed related information.
out phenomenon and can undermine the
BI deployments, transitioning towards holistic
value that EDW offers.
enterprise BI systems.
Q whats the best way for Q what can my organization Q what can Bi vendors do to
executives to consume all of gain by integrating business become more customer-centric?
the data needed to manage intelligence technologies with
their businesses? service-oriented architectures A Given the increasing adoption and stra-
(soa)? tegic importance of BI, customers are
A Every day, executives and managers are now expecting greater transparency from
faced with the challenge of reviewing vol- A First, it can gain an understanding of their BI vendors. In many instances,
umes of data to make important business the business performance impact of busi- customers and prospects want access to
decisions. Traditionally, managers would ness processes. Improving business results product documentation, product road-
have to find, run, and review dozens of requires detailed business insight. With- maps, and unfiltered feedback from other
reports and piece together similar data out enough insight into the impact and users, or even trial software for products
among those reports. With the new breed contribution of a business process on over- that they have not purchased. Customers
of dynamic dashboards, information from all performance and goals, it is difficult to shouldnt be afraid to ask for any of these,
a dozen or more reports can be compressed determine what changes should be made and vendors shouldnt hesitate to provide
into one expressive dashboard. Intuitive to improve business performance. them. BI licensing is another area that
on-dashboard controls allow users to flip Second, facilitate business users needs more transparency. Customers hate
rapidly through interrelated information taking actions as a result of insight. When repurchasing products or paying enable-
views without changing focus or context. business users gain insights that flag a ment fees for products they thought they
The dashboard buttons and selectors are business performance issue, the resulting already had paid for.
easy to use, so users dont need training. corrective actions often require invok-
Managers can now find all of the inter- ing a business process. These processes
A nA ly s t V i e w p oi n t
related data in a single dashboard. could now be started directly from the BI
dashboards used to analyze performance, Steady growth in the availability and func-
thereby improving efficiency and agility. tionality of open source BI software is
A nA ly s t V i e w p oi n t
beginning to drive greater customer-centric-
Dashboards and scorecards have emerged
ity in the BI market. Traditional BI vendors
as preferred ways for many executives to A nA ly s t V i e w p oi n t
are having to rethink licensing terms, free
Business intelligence is a natural fit for the
view performance information and quickly
trials, upgrade cycles, and source docu-
service-oriented architecture (SOA). Prop-
find, analyze, and explore the data they
mentation as the number of open source
erly implemented, an SOA can provide a
need to perform their jobs. Which solution
BI providers grows and more enterprises
loosely coupled and extensible environment
is selected will depend on business needs,
explore open source BI as a lower-cost,
in which previously siloed BI applica-
and its worthwhile to understand the subtle
quick-hit alternative to traditional solutions.
tions can interoperatean important step
distinction between the two. Dashboards are
On the technology side, commercial vendors
towards realizing the ideal of enterprise data
geared to inform users what the organization
are challenged to answer increased cus-
warehousing and enterprise performance
is doing. Scorecards emphasize how well
tomer demand for highly flexible, SOA-ready
management. Query and reporting can be
they are doing it by tracking progress against
applications based on open standards that
rendered as services (executing in concert
metrics. Clarifying business objectives for
can be readily embedded in existing sys-
with requisite data integration services)
a dashboard (management) or scorecard
tems. As open source BI continues to evolve,
that readily extend the functional reach
(monitoring) at the start will help your
transparency and flexibility in meeting cus-
of analytics across a broader number of
organization select and deploy the optimal
tomer expectations will be key.
source systems. Start with small, quick-hit
solution for executives to consume and react
projects that deliver high value and build a
to business information.
foundation of modular components and best
practices that can be incrementally extended
across your infrastructure.
Q why is it important to empower Q how can i extract intelligence Q how can i increase user
business users to own and from textual data? scalability in a distributed
manage cpm solutions? analytics environment?
A Text is very different from the conven-
A Businesses change continuously. IT tional, structured data held in customer A A Sybase IQ multiplex configuration pro-
doesnt understand nuances of the data warehouses, but it is rich in con- vides virtually unlimited user scalability.
changes, and the business users cant text. You can mine text (for example, To increase the number of users, add a
implement them. As a result, systems are call center notes or responses to survey Sybase IQ node running on an additional
months behind business requirements. questions) to extract conceptsthe server. Each node can support different
It is important that business users are most important and relevant words and users or manage different reporting or
empowered to react to change and imple- phrases. These concepts, along with query workloads. Nodes can also parti-
ment the changes on their own. This is information on how they are linked tion the user base by service quality, so
most critical for corporate performance to each other and the sentiment (posi- that higher performing nodes can support
management (CPM) solutions. With bud- tive/negative) associated with them, are high value users or applications.
geting or variance analysis reporting, or a effectively structured data. They can Multiplexing enables Sybase IQ to
strategy review, needs of users dynamic be merged with behavioral, descriptive, optimize workloads across multiple serv-
and often ad hoc; it is essential that busi- and attitudinal data to build a holistic ers within a single environment. With one
ness users model and implement changes. customer view for predictive analytics. writer node and multiple reader nodes,
CPM offerings enable the business user to adding additional applications and users
own, model, and maintain the solutions. to a database can be solved simply by
A nA ly s t V i e w p oi n t
This, along with the advantage of integra- adding reader nodes. The impact is mini-
tion with ERP and built-in governance, Vendors have made significant strides in the mal, as nodes do not depend upon or
risk, and compliance (GRC), can help sophistication and functionality of text ana- interfere with each other.
business users implement changes without lytics software in recent years. The how
depending on IT. of text mining will vary by product, but the A nA ly s t V i e w p oi n t
why is common across many organiza- Grid computing environments are gaining
A nA ly s t V i e w p oi n t tions: unstructured and semistructured data attention as viable platforms to enhance
The desirability of business owners using and is necessary for organizations that want to scalability for large-scale data warehousing
managing corporate performance manage- achieve a fully mature view of enterprise as RDBMS, BI, and data integration vendors
ment solutions (CPM) reflects a broader trend performance. TDWI research shows that increasingly add native functionality to take
towards greater business-side involvement in organizations use of unstructured data advantage of multi-node clusters. These
and management of BI systems. Organizations in data warehouses is on the rise, while platforms will feature load balancing algo-
are gravitating toward a more user-centric BI vendors and data warehousing profession- rithms to distribute queries across nodes
model and away from the IT-led, systems-ori- als are working to refine techniques and based on resource utilization (e.g., CPU
ented data management practices of the past. technologies needed to transform it into usage, memory, disk speed), and enable
Achieving this ideal requires greater collabora- structures meaningful to a warehouse or administrators to prioritize task execution
tion between business and IT, with tech-savvy to a reporting tool. based on user role, time of day, short- and
business sponsors who can bridge the gap long-running queries, and other criteria.
between corporate objectives and support- Naturally, diligent trial-and-error application
ing technology. CPM systems are an obvious of performance tuning techniques, partition-
target for business ownership because they ing, and parallel processing can also pay
are near the top of the BI food chain and are significant scalability dividends. Apart from
expected to enable game-changing insights scalability, grid systems offer an opportunity
by putting useful performance management to build in high availability and failover to
information in the hands of executives better ensure system continuity.
and managers.
Syncsort TCS
c a s E s t u Dy
Direct Marketing
Company Gets It
Done Faster with
the Right Tool
Commentary by Lia Szep
Senior Technical Analyst, Syncsort Incorporated
DMCs client base includes major corpora- old process DmExpress old process DmExpress
tions, many of which have databases that Project1:1:processing
project Processing 240240
GB ofgBdata
data Project
project 2: Processing data
2: processing data on
ona mainframe
a mainframe
house data on nearly every individual in the
United States. They store between 250 and
300 million names, addresses, and other being processed, I can strip off the model the development team receives the files on
demographic items, so extracting demo- scores and finish the decile and percentile a Tuesday, and theyre completely done by
graphic data, analytics, profiles, and model processing in less time than it would have Thursday. In addition, DMC benefited from
scores for processing can be a cumbersome taken to get the model scores. With a 98 the products ease of use and Syncsorts
and time-consuming task. percent decrease in elapsed time, DMC technical support. The ease of use has
determined that DMExpress would provide been a tremendous benefit, the senior
the challenge major performance benefits not only here, database developer comments, adding that
With model scores for every individual in but across many other projects. people can proficiently use the application
their system, DMC wanted to run decile and without needing three weeks of training. Also,
percentile processing at both a state and In another project, DMC was processing Syncsorts tech support has been outstand-
national level. With their previous process, data on the mainframe. The project involved ing. From the very startfrom the POCup
after extracting the 240 gigabytes of data importing data to the mainframe, scheduling to my weekly chats, I dont think Ive worked
from their system, it would take another three the job, running the processing, and sending with a technical support group that has been
days to process it. the data to a flat file. All of this would occur as attentive and provided the level of answers
while other processes were running on the that this group has. They are just fantastic. l
the solution mainframe. Because of this overload, the
Syncsort provided DMC with a free proof entire job would take two to three days to
of concept (POC) to demonstrate the ben- complete. Using DMExpress, DMC was able
efits that DMExpress could provide. Using to completely remove the mainframe from the
DMExpress, DMC was able to significantly process and complete the job in 20 minutes.
decrease the elapsed time. We extracted
240 gigabytes of data, stripped off the model conclusion
scores, and ran the processing within 10 Prior to DMExpress, DMC was unable to
hours, explains the senior database devel- run weekly reports because the processing
oper. Now, while names and addresses are itself would take five business days. Now,
When Enterprise
ETL Slows Down
Speed It Up
By Lia Szep
Senior Technical Analyst, Syncsort Incorporated
Many of your BI applications rely on data dont go all out high-performance Join
gathered from your Web site. With 5 giga- Code tweaks are not likely to speed your pro- High-performance join significantly improves
bytes of new Web logs a day, youve been cessing, and new hardware can be a costly the efficiency of preprocessing, retrieval, and
tasked with developing an application for Band-Aid that will eventually fall off. Even updating in a dimensional data warehouse.
Web log processing. Youve done all your costlier would be a complete rip-and-replace. With high-performance join, you can:
homework, chosen the latest and great- Instead, find a cost-effective solution that
est tools, and made your recommendation improves the performance of your current Optimize data preparation
to management. The tools are bought, the tool rather than replaces itjust make sure
development is done, and the project is in it fits the bill. In addition to finding a solution Improve query performance
production; it seems youve made the right that works with your existing ETL, consider
decision. Unfortunately, as hundreds of the following objectives. Reduce the quantity of data that must be
thousands of records turn into millions, and processed in response to a query
then billions, the system grows sluggish and performance
reporting deadlines begin to pass unmet. Perhaps the most important objective will be Speed lookups and application matching
Typically, the next phase of the project to minimize the run time of an application.
begins with the head-scratching ques- No matter what the other aspects of your Retrieve and summarize information more
tion, What was I thinking? and ends with system might be, unless you can minimize efficiently
managements directive to make it work. the time it takes to complete a job, you have
The last thing you want to do is start from no chance of meeting reporting deadlines. Minimize storage and throughput require-
scratchso dont. The key to minimizing run time is a solution ments
that offers powerful aggregation and join
growing pains tools. Reduce elapsed time of changed data
The most likely reason for a processing melt- capture/delta processing
down is exponential data growth. The more high-performance aggregation
successful a company becomes, the more Aggregates are the best way to speed scalability
data it generates. As companies continue to warehouse queries. A query answered from The solution must also be scalable. As com-
be bogged down by data growth, performance base-level data can take hours and involve panies go from gigabytes to terabytes and
bottlenecks create pain points throughout the millions of data records and millions of cal- ultimately petabytes, scalability becomes a
organization. A popular Web site can create culations. With precalculated aggregates, the necessary tool in managing exponential data
billions of clickstream records in a single day. same query can be answered in seconds growth. Other things to consider are ease of
High-volume sales drill down to detailed finan- with just a few records and calculations. use and vendor reputation. If a product is
cial records, increased customer data, and easy to use, it can help control the cost and
additional marketing demographics. High-performance aggregation simplifies time of training staff members. If the solution
the creation, administration, and execution is from a reputable vendor, it is more likely to
Then theres legacy, inventory, billing, etc. of aggregation jobs. It summarizes data have been proven reliable.
This wealth of data often translates to much faster than other aggregation methods
longer processing times, increased costs, such as C programs, SQL statements, or testing
and missed reporting deadlines. When an third-party, multipurpose data warehouse Finally, whatever other options you may be
enterprisewide extract, transform, load (ETL) packages. It provides the flexibility necessary considering, testing the product in your own
solution begins to slow down, the impact is to select the best aggregates for optimizing environment, with your own data, is abso-
felt in everything from daily business transac- query performance. lutely the only way to determine a products
tions to high-level business analytics. performance. Not only must the solution be
Repositories,
Applications
performance pain points global communications company dramatically reduces
processing time
Weekly Monthly
Monthly
Sales by Sales by 7 days
Sales
Rep Product
Payroll 4 days
CRM
ETL Process
Application
DATA WAREHOUSE
Detailed Historical
Legacy Transactions
Application DATA MINING
Other 1 day
Application ONLINE DATA DECISION
WEB LOGS
STORES SUPPORT SYSTEMS
old process DmExpress
the bestit must be the best for you. This is to be shut downfor seven days. This meant closed for an extensive period of time to
also the only way to truly tell if a solution will that every hour could cost the company mil- accommodate the project.
work with your current tools. lions of dollars in lost revenue.
conclusion
real-life example Using the high-performance solution, the Ripping out a sophisticated, undoubtedly
Our customers are often surprised to learn company was able to speed the sorting, expensive, system may not be the solution to
that, rather than replacing their existing ETL, summarization, joining for lookups, and your performance problems. In your search
they can reap more value from it simply by conditional processing and transformation of for a fix, remember that performance is the
supplementing it with a high-performance the data. Five major input files were created, bottom line. Minimized elapsed time, com-
solution. In one instance, a top telecommu- two for a phone number inventory scheme bined with scalability and ease of use, add up
nications company needed to convert and (CTN), and three for a phone inventory to increased performance. Also, in evaluating a
migrate more than one terabyte of telephone scheme (ESM). High-performance join was solutions performance, be sure you can do so
numbers, phone inventory data, and activa- used for the lookups, after which the data in your own environment. This is the only way
tion records from its existing system to a new was processed and transformed to meet the to determine the best solution for you and for
one. This data needed to be converted and companys requirements. your current system.
normalized in the old system first, imple-
menting complex business rules, so that it While the company still used Informatica, If you find the right tool to complement your
could be efficiently used in the new environ- the high-speed solution was able to replace current system, the light at the end of the
ment, consisting of an HP9000 800 Series many of the slow-running processes, which tunnel may end up even brighter than you
with 8 CPUs. cut the overall elapsed time by 88 percent. first expected. l
As a result, the project, which the company
After several dry runs of the more than 100 had anticipated would take one week to
For free white papers on this topic, download
processes using Informatica and C++ to complete with just Informatica and C++, Speeding ETL Processing in Data Warehouses
convert the data to the new application, the was finished in less than 20 hours. Without or Mitigate Business Intelligence Project Risks
company estimated the project would take having to replace their existing system, the with Rule-Based Audits and Proof-of-Concepts,
or click here for more information about
a week to complete. The time factor was of company was saved from a potentially heavy Syncsort Incorporated.
critical importance: during the conversion/ loss of revenue, something that certainly
migration process, all retail stores would have would have happened if the stores had been
c a s E s t u Dy
Large-Scale Retailer
Gains Easy Access to
Historical Data for Big-
Picture Analysis
Commentary by Jesse Fountain
Vice President, Product Marketing, DATAllegro
Business challenge
A recent merger resulted in the company
owning two Teradata systems, each holding
50 terabytes of data. The retailer was strug-
gling to analyze its data across the entire The retailer decided to run benchmarks DATAllegros partitioning, its ability to modify
enterprise. Both systems used Teradata to with a number of leading vendors. For the DSQL to tune highly complex queries, the
support operational workload and traditional proof of concept, the company selected B25 backup unit, and the flexibility of the
data warehousing ad hoc usage. Upgrad- DATAllegro, another data warehouse overall system configuration.
ing Teradata to accommodate the data from (DW) appliance vendor, and two other
both chains into one system was prohibitively well-known, traditional data warehouse In addition, DATAllegros price was less than
expensive. In addition, the high cost of stor- technology vendors to participate. half that of the other vendors, discounts
ing historical data on each system prevented included, without any sacrifice in performance.
analysts from getting a complete picture of the Benchmark
the business. The retailer gave each vendor one years The company can now reduce the amount of
worth of sample data and tasked them with history on Teradata to one or two years and
While the customer didnt feel it was nec- expanding the data to 10 terabytes (enough keep full history (five years or more) on the
essary to merge all the data into one for 24 years of data). Vendors had two DATAllegro DW appliance.
data warehouse, it did need to obtain an weeks to prepare and load the data into their
enterprisewide view of its customer and point- product offerings before the retailer began By purchasing DATAllegro, the customer
of-sale transaction data. Business needs running a broad range of query types, includ- will save hundreds of thousands of dollars
would also benefit from the ability to store ing ad hoc, complex, and long-running. in annual maintenance costs and have a
and query five or more years of data. The more comprehensive view of its current and
company had to decide if it could afford to tangible Benefits future business. l
upgrade Teradata in order to accommodate After analyzing the query speeds, capacities,
all the data it wanted to store in one data and costs of the offerings from each vendor,
warehouse (up to 80 terabytes over time), or the customer selected DATAllegro, believing
if there was a less expensive option that would it would best support its current and future
still provide the necessary performance. needs. Particular areas of strength were
Creating a True
Enterprise Data
Warehouse with
highly specialized grid of servers being pulled Leveraging the grid concept, DATAllegro
Grid-Enabled together to collectively form a DW appliance. could provide a multi-temperature system that
balances performance and cost across the
DW Appliances Taking this view, it is a small step to think periods for which data must be stored. For
of a connected set of DATAllegro systems example, assume that the data warehouse
By Stuart Frost
CEO, DATAllegro as both a grid of appliances and a grid of must store seven years of data for compliance
nodes. Moving or loading data could be done purposes. The most recent quarter (and most
directly between nodes in different appli- frequently requested data) would be placed
Data warehouse installations at large com- ances to maximize parallelism and overall on a very high-performance appliance. Data
panies generally fall into three architectural transfer speeds. from three to 12 months could be stored on
categories: a standard DATAllegro appliance with very
good performance, and data older than one
Leveraging the grid concept,
Centralized enterprise data year would be stored on one of DATAllegros
warehouses (EDW) DATAllegro could provide a multi- archive appliances offering up to 200 TB of
user data storage per rack.
temperature system that balances
Decentralized collections of data
marts (DM) performance and cost across the As fresh data is loaded, older data would be
automatically aged (moved) across the grid.
various periods for which data
Attempts at hub-and-spoke architectures Incoming queries would be automatically
that combine the two must be stored. broken down into the relevant date ranges and
the responses from the appliances collated
While many organizations have obtained into a single result set before being sent back
significant value from their data warehouse solving the hub-and-spoke challenge to the user.
installations, few have been entirely success- Imagine a fairly large appliance acting as the
ful at implementing full-scale enterprise data hub of a set of data mart appliances. The disaster recovery
warehouses. Centralized EDW installations hub would hold detailed data (near real-time The grid concept could also be extended
tend to be extremely expensive and inflex- or batch-loaded) for a number of business across multiple data centers to provide a
ible. Consequently, business units become units or perhaps the entire enterprise. ETL highly effective disaster recovery strategy.
frustrated because the EDW wont meet their tools such as Informatica or SQL scripts Individual appliances could be replicated on
needs at sensible cost and within a reason- could create star schemas. The star schemas a second site and automatically synchronized
able timeframe. Decentralized data marts could then be transferred to the appropriate with node-to-node replication.
often result in many versions of the same data mart(s) via the grid at more than a tera-
data that are difficult to keep consistent byte per minute, depending on the number summary
across the enterprise. While a true hub-and- of nodes in each target appliance. A high-performance hub-and-spoke architec-
spoke architecture would address many of ture that is easily managed and cost effective
these issues, technical limitations with cur- Users would connect to the independent on an enterprise scale is now a practical
rent data warehouse infrastructures have DM appliances as usual for running queries. reality with DATAllegros grid technology.
made them difficult to implement. Each DM would be tuned according to busi- Added benefits include support for multi-
ness needs and sized to handle the required temperature and disaster recovery integrated
a grid of appliances level of performance and concurrency. into the grid. l
DATAllegros DW appliances are generally
used as a data warehousing black box with multi-temperature data warehousing For a free white paper on this topic, download
Using Grid Technology to Build a Hub-and-Spoke
data access from a single point (the control Data warehouse managers are under increas-
Data Warehouse Architecture, or click here for
node). However, the nodes within a ing pressure to store large amounts of more information about DATAllegro.
DATAllegro appliance are actually self-con- historical data at the same time as improv-
tained Ingres database servers. Therefore, ing general query response timeswithout
a DATAllegro appliance could be viewed as a exceeding tight budgets.
c a s E s t u Dy
Alvion Technologies, Inc. provides out- End users of this data typically run queries to 7,500one-third of which are highly
sourced data management services to some and counts to determine optimal selec- complexwhile the number of registered
of the largest marketing data list owners in tion criteria for specific direct marketing users has jumped from 12,000 to 50,000.
the worldnames such as Axiom, Equifax, programs. This means that a typical user The system has scaled easily to these new
Experian, and Dun & Bradstreet. Alvion sits session includes numerous queries, run with levels, thanks to Sybase IQ, which has also
squarely in the crossroads of e-commerce slight variations, to find the strongest candi- supported the overall tremendous growth in
and business intelligence, leveraging their dates for final data selection. As the number data volume via its unique data compression
exclusive technologies, extensive very large of queries a user makes increases, so does capability. With Sybase IQ, disk space sav-
data warehousing (VLDW) expertise, and the need for speed. ings add value, especially considering the
marketing know-how to provide customers cost of the large, high-speed drives required
with fast, reliable marketing data. We use IQ in production because its big- for high-use VLDWs. Plus, the extra drives
gest strength as far as we are concerned are typically used to tune-up database perfor-
Business intelligence is the lifeblood of Alvion those really, really fast counts, said Bojan mance were not needed.
and companies like it. The data they collect, Belovic, database administrator for the
often from multiple sources, must be aggre- Alvion system. The response time is abso- Until now, Alvion divided its data warehouse
gated and analyzed if it is to provide value. lutely the number one reason we are using tasks between queries and order fulfillment.
That requires data warehousing and analytics Sybase IQ. We are talking about an order of Alvion is looking to consolidate all operations
solutions that ensure: magnitude difference. in a single environment, which will mean
increasing the size of the production data-
The capacity to handle increased query base by roughly 100 percent. Amazingly,
Our fast query times are what
demand, especially for ad hoc queries Sybase IQ provides such effective compres-
Access to hundreds or thousands of defines us in this industry. We are sion that the new data will not affect the
simultaneous users systems performance or query speed. How-
building in more complexity with
Reduced data latency, sometimes provid- ever, this change will dramatically improve
ing nearly real-time updating Sybase IQ as the backbone, while Alvions competitive advantage by shortening
The ability to grow with increasing data fulfillment times while maintaining the
maintaining lightning-fast response
data volumes trademark query speeds so appreciated by
Lower hardware, administration and times. Thats going to take us a its customers.
maintenance costs
long way.
No downtime Belovic believes that Sybase IQ is up to that
High levels of security Bojan Belovic, Alvion Technologies task, too.
Alvions customers datasets range up to 190 Our fast query times are what defines us in
million records and 200 attributes. Com- Alvions success in recent years has trans- this industry. We are building in more com-
bined, Alvion manages about a terabyte of lated into significant growth: plexity with Sybase IQ as the backbone, while
data for customers as an outsourcing service. maintaining lightning-fast response times.
Individual customers submit anywhere from More data hosted from new customers Thats going to take us a long way. l
5,000 specialized records of information, Growth in existing customers record
to 120 gigabytes of data. Alvion then runs counts
customer-specific data transformations and Increasing user sophistication and query
uploads it to their production servers for complexity, and overall data mining goals
access by end userswidely distributed Four-fold end-user growth
customers of the original data owners. Data
update cycles vary from daily to annually. Throughout this period, the number of daily
ad hoc queries has increased from 2,000
c a s E s t u Dy
BI at Tata
Teleservices Ltd.
Commentary by Ramanuj Rao
Senior Manager, Business Intelligence, Tata
Teleservices Ltd.
TTSL offers an array of telecom services, daily transactions into intelligent We also put into place a loyalty manage-
including mobile services, wireless desktop information on the fly. This ment program using BIa classic example
phones, public booth telephony, and wire line of operational and business efficiency. This
services. Value-added services include voice information helps our business program revolves around subscriber aging,
portal, roaming, postpaid Internet, three-way functions for predictive and recharges, and demographic patterns.
conferencing, group calling, Wi-Fi Internet, It identifies subscribers per loyalty busi-
USB modem, data cards, calling card ser- proactive approach. It acts as an ness rule and mediates credit values to an
vices, and enterprise services. enabler for TTSL to acquire and Intelligent Network Platform using TIBCO
interface. Loyalty ROI is tracked in BI.
The company was the first service provider retain subscriber values.
in the country to launch an online outlet Ramanuj Rao, Tata Teleservices Ltd. Outgoing barred (OGB) reduction program
offering postpaid mobile connections. It also is a proactive approach for analyzing OGB
launched prepaid wireless desktop phones, customers to take corrective actions with an
public phone booths, new mobile handsets, solution objective to reduce churn. This focuses on
as well as new voice and data services such BI in alignment with business processes identifying key parameters on which OGB
as BREW games, picture messaging, and provides a single version of truth with agreed patterns can be monitored. Using closed
polyphonic ring tones. It also offers inter- definitions of key performance indicators and looping, business takes corrective action to
active applications such as news, cricket, standardization of reports using business achieve reduction in OGB as well as churn.
astrology, etc. metadata. TTSL has partnered with Tata
Consultancy Services (TCS) to develop and technology
on the radar maintain a BI environment. TCS has imple- OLAP and Reporting: Cognos 8.2.4
The formerly government-run telephone mented its telecom model, tBIDs, as the ETL: Oracle Warehouse Builder 10.1.0.4
system in India opened to private players in core solution. Current DW Size: 8 TB l
the 1990s. With liberalization and globaliza-
tion, the telecommunications business is A communication and awareness campaign For a free white paper on this topic, download
5ml of BI for Growing Organizations,
undergoing a major sea change. Telecom plays a major role in synchronizing BI with
or click here for more information about TCS.
activities are flourishing, enhancing the business, which is achieved through road
infrastructure and helping technology pen- shows, newsletters, etc. To meet this need,
etrate Indias diverse society. In the past business intelligence solutions are integrated
two decades, the number of telephone con- with BSS/OSS applications, which help get
nections in India has risen by more than 75 the cluster and correlation across the cap-
tured key performance indicators.
c a s E s t u Dy
CPM Implementation
Challenges and
Lessons Learned
Commentary by Abhijit Niyogi
and Rohit Shrivastav
Tata Consultancy Services external source system datasuch as human TEchnology
resources, revenue, etc.in the future. Thoroughly test and establish an
appropriate and scalable technology
client Business scenario Cognos Planning Solution extracts data from infrastructure
The client is a large publishing corporation the DW and other source systems to facilitate Design and test individual components of
with business interests in education, busi- driver-based detail budgeting and the monthly technology solution to ensure scalability
ness information, and the financial services estimation process, along with medium-range and performance
market. The organization is structured into planning. The Cognos planning system acts
multiple business entities serving different as a source for budget and estimate data to DESIgn AnD BuIlD
niche areas or geographical regions across the DW and existing ERP system. Ensure that design assumptions are
the globe. clearly communicated and reviewed by
Cognos 8 Business Intelligence works on top business owners
The corporations existing business informa- of DW for facilitating Web-based standard- Establish and follow best practices for
tion system is characterized by heavy use of ized reports, business entities, and provides businesses processes and technology
Excel, a stand-alone budgeting and report- ad hoc and self-reporting capabilities to solution
ing solution, no structured workflow for business users.
routing budgets for review and approval, and SuppoRT
a proliferation of reports and offline work- lessons learned Maintain a common pool of knowledge
sheets without any standardization across BuSInESS SponSoRShIp resources and establish a process for
business entities. Define clear vision and establish senior knowledge sharing among onsite and
management sponsorship offshore team
cpm program Create and strongly communicate project Ensure continuity by establishing a core
Primary business objectives of the corporate road map in the organization dedicated team for the project
performance management (CPM) program
are to: TEAm ouTcomES
Provide the right information to the right Include both business and technology Established a reliable foundation of
users at the right time to support better people in working project team, with core data, reporting, and planning
decision making clearly defined roles and responsibilities capabilities. This includes process
Establish a platform to support man- Empower team to make business and improvements, testing technology solu-
agement of metrics/scorecarding and technical decisions tion, and creating an environment within
analytical reporting the organization to leverage, use, and
Provide access to detail-level transac- pRocESS contribute to CPM solution.
tional data as well as integration with Establish business ownership of require- Established a transparent and integrated
other internal and external data sources ments and sign off driver-based budgeting and estimation
to increase the value of the information Manage user expectations and ensure system.
Increase transparency user engagement throughout project Standardized and automated budget
Standardize reporting and planning struc- cycle workflow and approval process.
tures where possible Prepare organization to adapt to business Designed and built a standard set of core
Utilize driver-based planning and budget- process changes and standardization financial reports that can be used across
ing models Create data source ownership and under- business entities.
stand business rules and cleansing logic Designed and deployed self-reporting
The CPM program was based on Cognos Solu- for all data sources capability that is based on preverified
tion on top of a core CPM data warehouse. All Plan for holistic design and staggered centralized data source.
key financial data, including actual, budget, rollout Established data set that can be lever-
and estimate, resides in the DW. The DW Plan for iterative approach for design and aged for developing dashboards and
is designed to integrate other internal and development designing KPIs. l
c a s E s t u Dy
monitor physician deficiencies, for corporate Hospital personnel log into the WebFOCUS a clinical application system that is easy to
education test scoring, and as part of our environment through a secure Web portal sort and summarize with WebFOCUS. Now
open chart review process, Mehyou notes. accessible via any Web browser. Once they that we have the proper reporting tools, we
WebFOCUS helps us tabulate deficiencies, enter the correct department number, they can deliver information to our chief of staff
so physicians always know where they stand. are presented with a graphical environment with confidence.
For example, it tells us which patients are that directs them to the information they
missing documentation, for how long, and need. For example, department managers For example, the hospital uses an Eclipsys
in what areas. WebFOCUS has enabled us can review statements to make sure they Clinical Application System, which gathers
to provide a much more accurate and timely were charged for the correct supplies. Other many types of clinical information, such
report relating to deficiencies. basic information includes pay reports and as periodic vital signs. There are myriad
productivity reports. Users can drill down to data points on each admitted patient, says
Meanwhile, department managers have the details as required, or sort the informa- Mehyou. Ultimately, we hope to use
learned to use WebFOCUS to generate pro- tion by user, pay period, or charge level, WebFOCUS to mine this data.
ductivity reports, extending back several Mehyou says. Everything is protected by
years, which are useful for benchmarking user and role, and the system is fully com- WebFOCUS has paid for itself in measurable
and comparisons. Managers might want pliant with HIPAA requirements governing productivity gains. For example, the labor
to know, for example, how many hours it privacy of information. and delivery department was operating above
took to provide care for a certain number of the 50th percentile in cost-per-delivery, on a
patients, or how many tests they performed it Vital signs national basis. Careful analysis of spending
during a certain period, explains Mehyou. To create this user-friendly reporting envi- patterns helped the hospital reduce these
WebFOCUS allows them to summarize this ronment, Jefferson Regional integrated costs. Were now in the 36th percentile,
information over any time period. It is a very WebFOCUS with a McKesson HBOC clinical thanks to better knowledge of costs, Mehyou
flexible environment. information system on an AS/400 com- says. Thats a 28 percent improvement
puter. WebFOCUS accesses other AS/400 in productivity.
Other reports have been created for diagnosis- packages, such as Payroll, OR, and related
related groups (DRGs)the three-digit codes business functions. These packaged appli- In the face of numerous industry reports that
that describe patient conditions, from heart cations store data in a DB2/400 relational accuse health care organizations of runaway
attacks to hypertension. Reimbursement database, which WebFOCUS can access spending and rising costswith no notice-
rates are often set according to these codes, directly. Other critical information is stored able improvement in quality of carethese
and hospitals get paid a predefined amount in Microsoft SQL Server data marts. We like measurable performance gains are a source
for each DRG. Sometimes a number of the way WebFOCUS can easily combine two of pride for Jefferson Regional. Providing
procedures are bundled into one rate, and or more types of data into the same report, good care is our primary objective, but of
complicated formulas are used, Mehyou says. says Mehyou. For example, we might access course we want to do that within the bounds
Our hospital administrators need to make the AS/400 database to create a sum- of what is reasonable and financially respon-
sure each diagnosis is correct, the charges are mary report for the radiology department, sible, Mehyou concludes. WebFOCUS
justified, and that they are billing appropriately then compare that information to a national gives us the insight we need to create a more
to maximize reimbursements. benchmark, which is derived from a differ- efficient operation. For the amount of money
ent kind of database entirely. WebFOCUS we have spent to purchase and maintain the
Extensive data analysis is performed every combines information on the fly to create a softwareand the ease with which we can
month using many FOCUS and WebFOCUS cohesive presentation. create reportsit is one of the best technol-
reports. Everybody wants to see a different ogy investments the hospital has made. The
slice of the information, continues Mehyou. Eventually, Jefferson Regional would like to cost is minimal, and the return has been
Some people want to see test results. build BI dashboards for managers, senior phenomenal. l
Others are interested in your medical history. managers board members, and other
Still others need to know the length of your constituencies within the hospital. More For a free white paper on this topic, download
Worst Practices in Business Intelligence: Why
visit, review your bill, or perform statistical and more patient data is now maintained
BI Applications Succeed Where BI Tools Fail,
analysis. WebFOCUS makes it easy for these electronicallyeverything from vital signs to or click here for more information about
users to change parameters so they can medications to test results to billing informa- Information Builders.
obtain the information they need. tion, says Mehyou. Much of it is stored in
Operational business intelligence (BI) represents a turning IS youR opERATIonAl BI EnVIRonmEnT ThE SAmE AS youR REgulAR
point in the evolution of BI. Traditionally, BI has been the BI EnVIRonmEnT?
province of technically savvy business analysts who spend
many hours with sophisticated tools analyzing trends and Not sure 10%
patterns in large volumes of historical data to improve the
effectiveness of strategic and tactical decisions. But operational
BI changes this equation: it moves BI out of the back room
No 40% 51% Yes
and embeds it into the fabric of the business, intertwining
it with operational processes and applications that drive
thousands of daily decisions. In essence, operational BI merges
analytical and operational processes into a unified whole.
Figure 1. Based on 225 respondents who have implemented operational BI
In addition, operational BI increases the value of BI by according to TDWIs definition.
delivering information and insights on demand to all
workersfrom the shipping clerk to the CEOso they can professionals to build resilient, highly available systems with
work smarter and faster to achieve critical business objectives. sufficient backup and recovery.
In essence, operational BI delivers the right information to
the right people at the right time so they can take action. In To warehouse or not? The first technical question that
its extreme form, operational BI encapsulates business insights an organization needs to address is whether to use a data
into rules and models that organizations can use to automate warehousing architecture to deliver just-in-time data, or
decisions and responses, eliminating the need for human bypass it altogether. This is the most fundamental question,
intervention. Automating decisions not only streamlines and the hardest to answer.
processes and reduces costs, but also improves service and
gives organizations a competitive advantage in Many architects believe its critical to adapt existing data
the marketplace. warehouses to support operational BI. The big showstopper
is whether you are going to apply the same business rules to
Beyond operational reporting. There are many flavors of integrate, cleanse, and validate operational data streams as the
operational BI, ranging from operational reporting and rest of the data in your data warehouse, says John OBrien, a
process monitoring to composite applications and decision BI consultant and former data warehousing architect. Pulling
automation. While most organizations already support some operational streams out of the data warehousing process
form of operational reporting, many have yet to embrace more undermines data quality and creates divergent data sets that
complex types of operational BI that generate greater business may not reconcile, he claims.
value. Thus, operational BI opens up a new field of endeavor
for BI and gives organizations a chance to reap greater Some disagree. They say that a data warehouse becomes a
dividends from their BI investments. bottleneck if you try to load all data into it that users may
possibly want to query. BI vendors such as Business Objects,
Hyperion, SAS, and InetSoft, which support federated query,
Challenges believe their tools provide an easy, low-cost way to capture
However, operational BI poses several challenges. It stretches real-time data and deliver it to users at the point of need
the architectural boundaries of current BI solutions, forcing with sufficient quality. Likewise, vendors of embedded BI,
BI professionals to rethink the way they design and build event-driven analytic platforms, composite applications, and
systems. Queries must return in seconds rather than minutes in-memory analytics believe their offerings provide the most
or hours, and reports must update dynamically. Operational suitable way to meet high-end operational BI requirements.
BI systems must capture large volumes of data in near real These vendors say that a data warehouse is critical for
time without degrading the performance of existing processes applying historical context to real-time data, but not necessary
and jobs on source or target systems. There is also less time for managing the real-time data itself.
to recover from a server outage, making it imperative for BI
Nevertheless, data warehousing has become a well-established and EII query tools. In practice, most companies use a
IT practice in corporate environments, and few organizations combination of these.
will jettison their DW investments without trying to
adapt the architecture to support just-in-time data and Data storage. Organizations can store acquired data
operational processes. Our survey also shows that about half in a variety of database engines, including one or more
of organizations (51%) run both operational and analytical layers in a data warehousing environment (i.e., staging
reporting from the same environment. Given the high number area, data warehouse, data mart, OLAP cube database),
of survey respondents who equate operational reporting with an ODS, a low-latency database, or an event-driven
operational BI, this indicates that many companies have analytic engine.
moved operational reporting into their data warehousing
environment. (See Figure 1.) Data delivery. To display captured data or data derived
from analytic processes, organizations use custom-built
Organizations that want to deliver just-in-time data via a applications, portals, BI tools, dashboards, composite
data warehousing environment face daunting challenges. The applications, or a combination of these approaches.
rest of this section describes the major challenges involved
in transforming a data warehousing environment to support Some of these technologies support multiple tasks. For
operational BI. instance, BI and EII tools can both acquire and deliver just-
in-time data, and if you consider a report definition a storage
Select the right technology. There are many technologies mechanism, they support all three activities. Likewise,
that BI architects can use to build an operational BI event-driven analytic platforms, working in concert with
environment. These technologies can be classified into messaging backbones (EAI networks, enterprise service
three main categories that correspond to the way data flows buses, publish/subscribe middleware), support all three
through a just-in-time system: activities. This is not surprising, since they are designed
to provide end-to-end support for real-time operational
Data acquisition. Organizations must capture, BI requirements.
transform, and move data from source systems into
the analytical environment on a just-in-time basis. To Our survey shows that organizations use a variety of techniques
do this, organizations can use ETL tools, replication to support operational BI. The most common are ODSs,
tools, changed data capture technologies, messaging followed by more frequent batch loads and changed data
backbones, event-driven streaming engines, and BI capture. (See Figure 2.)
need to upgrade their networks and hardware, and parallelize commit to update streamed messages from a queue into a
key extraction, transformation, and load processes so they can staging area, so updates are never lost if there is a planned or
adequately meet these increased throughput demands and unplanned outage in the database server.
eliminate processing bottlenecks.
Deliver adequate performance. A challenging problem for
Use inserts. To increase ETL throughput, some (but not all) data warehousing designers is ensuring rapid query response
architects recommend inserting new records (i.e., loading times while simultaneously loading or updating a data
data) rather than adding, changing, or deleting existing warehouse and performing other tasks, such as monitoring
records. Avoid updates at all costs, says OBrien. With events, triggering alerts, running backups, and scoring
large data sets, it takes too much time to find the record models. A mixed workload can cause RDBMS performance
and update it. Although this creates lots of duplicate data, to degrade to the point where it blocks incoming queries or
administrators can use SQL DISTINCT and GROUP-BY causes load processes to fail. Achieving adequate performance
statements to identify and delete duplicates, OBrien says. in a mixed workload environment can be a vexing challenge.
OBrien also recommends turning off referential integrity Complicating matters is that most users expect near-
and database logging. Why log inserts if you have the instantaneous response times in an operational BI
original load file? he asks. In addition, there is no reason environment. For example, customer service representatives
to create indexes and aggregations during the ETL process, cant wait more than a few seconds for an integrated view of
since they consume a lot of CPU and slow down the inserts. customer activity and cross-sell offers before their callers get
Like many architects, OBrien now advocates using the impatient and hang up. Most data warehouses arent designed
database to perform these tasks once the data is loaded to support a mixed workload of tactical queries that return
into the data warehouse to exploit the parallelism of the a few rows of data in less than a second along with complex
underlying database. This process is known as extract, load, requests that scan millions of records and take minutes or
and transform (ELT) versus the more traditional extract, hours to process.
transform, and load (ETL).
How do you balance these mixed workloads and maintain
Increase availability and recoverability. In a just-in-time SLAs without causing the system to crash? There are several
data warehousing environment there is little time to recover options, all of which have trade-offs:
from errors, because batch windows are small or nonexistent.
In a real-time system, you have no time to fix problems, Throttle incoming requests in response to heavy system
and messages can start piling up, says OLAP architect loads. You can schedule queries or jobs to only run at
Eric Lofstrom. The best way to avert these problems is to night, or queue or delete them using query governors or
build high-availability systems to drive the acquisition and job managers during periods of heavy load to ensure the
deployment process. These systems parallelize single points of integrity of system updates. This approach obviously wont
failure, run in a clustered environment, support failover and sit well with users, and its the reason companies began
backup processes, and have an offsite backup. building data warehouses in the first place: to provide
the business with a dedicated analytical environment that
Microbatches. To avoid losing data, OBrien recommends would not interfere with operational processes.
using microbatches instead of real-time streaming, since
microbatches provide a buffer with which to recover from Separate analytical and tactical queries and jobs.
a network or server outage. His rule of thumb is to set the Another approach is to off-load tactical queries and
ETL batch cycle three times larger than the time required to predictive scoring jobs to an ODS or specialized data
process the data. If it takes 90 seconds to process a file, then mart and leave the data warehouse to support long-
Ill set the batch cycle to five minutes and have 3.5 minutes of running analytical queries. Here, the ODS contains
sleep time. current transaction data, usually no more than 30 days
worth, stored in third normal form models that reflect
However, other IT practitioners believe it is perfectly safe to operational schemas. The downside of this approach is
stream events into a data warehouse. Lofstrom, for example, that it separates historical and current data into different
recommends logging each message as it comes off a queue, systems, making it difficult for users to view just-in-time
which may slow down the speed of the streaming data, but data in historical context.
prevents the loss of data caused by server outages. If an outage
occurs, Lofstrom recommends loading accumulated messages Leverage RDBMS mixed-workload capabilities. Many
into the warehouse in a single batch job before turning event database management systems (DBMS) have significantly
streaming back on. In other cases, companies use two-phase improved their ability to optimize the performance of
long-running strategic queries, short-running tactical This approach may require you to pause the application
queries, load and update processes, and other types server while the flip takes place so no new requests are
of workloads. Teradata, for example, has made big initiated while the swap occurs, says Justin Langseth,
improvements in its priority scheduler for optimizing CTO of Claraview, a BI consultancy in Reston, VA.
tactical queries, says Dan Graham, marketing manager Many organizations use this insert-and-flip approach.
at Teradata. The priority scheduler is a real-time traffic
cop that always allocates CPU to tactical queries first External real-time cache. Another approach Langseth
to guarantee sub-second response times. It continuously recommends is to load data into an in-memory cache
monitors in-flight tasks and dynamically adjusts CPU outside of the data warehouse. Requests for real-time data
allocation to optimize performance. In addition, are fulfilled from the cache, while queries that require a
administrators can configure and prioritize workloads by combination of real-time and historical data merge the
user groups, types of activity, and other variables. HPs requested data in a set of temporary tables in either the
new Neoview data warehousing platform also boasts data warehouse or real-time cache, depending on which
workload management capabilities. database holds the largest volume of data requested. This
type of just-in-time merging of information requires
An RDBMS that supports mixed-workload processing lets complex SQL and may be challenging for most BI tools
organizations have their cake and eat it, too: they can load to support.
current and historical data into the same database and
optimize performance across all types of queries. Without Summary. There are many challenges involved in
an RDBMS that supports mixed workloads, many implementing operational BI. The challenges discussed
organizations decide to avoid using a data warehouse here deal primarily with transforming a data warehousing
for operational BI. However, not all mixed workload architecture to support just-in-time data delivery. Although
capabilities are created equal, so evaluate your database there are other ways to deliver just-in-time data to support
vendors capabilities carefully. Also, running multiple operational BI, many architects recommend using a data
workloads on a single platform may require hardware warehousing environment to ensure a consistent set of data for
upgrades to maintain adequate performance, so calculate the entire organization. l
these additional costs when deciding whether to use a data
warehouse to support operational requirements.
Avoid contention problems. When user queries and ETL Wayne Eckerson is the director of TDWI Research and author of
processes hit the same table, there is the potential for Performance Dashboards: Measuring, Monitoring, and Managing
one process to block the other and cause query or load Your Business (John Wiley & Sons, 2005). He can be reached at
performance to degrade. Along with mixed workload weckerson@tdwi.org.
requirements, the issue of contention causes many people
to maintain historical and just-in-time data in distinct data This article was excerpted from the full, 30-page report by the
stores. There are three ways to minimize the contention same name. You can download this and other TDWI Research free
problem, but they are not for the fainthearted: of charge at www.tdwi.org/research.
Allow simultaneous reads and writes. If you are The report was sponsored by Business Objects, HP,
inserting rather than updating data, the database wont Oracle/Hyperion, InetSoft, SAS, Sybase, Syncsort Incorporated,
lock the table. The only problem here is that the data and Teradata Corporation.
can be out of sync if the user reads the table before all
the inserts have completed. To avoid confusion, its
imperative to provide users with guidelines for submitting
ad hoc queries against real-time data, and it helps if you
dynamically time-stamp all reports. Its also important to
turn off caching in BI servers, since there is no point in
loading data every hour if the BI tool requests data from
a cache that gets flushed once a day.
c a s E s t u Dy
University of Utah,
University Health Care:
BI Tips that Drive
User Adoption and
Increase ROI
Commentary by Jim Livingston
Director of IT Infrastructure and the Data Resource
Center, University of Utah Health Care
of-concept projects soon confirmed what The biggest driver for us was to empower combine structured and unstructured data
early reviews had indicated: FAST Radar the end user. Now that weve done that, and creates associations between the two.
was exactly what was needed. The final seal weve seen an explosion in usage, says
of approval? When the new BI system was Director of IT Jim Livingston. Previously, the Like most Academic Health Centers, Uni-
demonstrated to end users, it won instant BI tool acquired in 1999 was being used by versity of Utah Health Care has abundant
acceptance. Everybody said, This isnt so five report administrators and perhaps 80 information in text form but it cannot yet
badwe can do this ourselves. Our chief occasional end users. Today, after just nine search the text fields and associate the results
nursing director even said, If I can do it, months, there are 400 active accounts on with the current BI initiatives. With the ability
anyone can do it, recalls Hunter. FAST Radartwo-thirds of them accessing to do so, the center would have a 360-degree
the system 50 times each per month. view of information in one place, saving time
results and providing users with more complete infor-
With FAST Radar on board, University Health The new BI system also allows costs to be mation. It will also enable users to uncover
Care managers are seeing significantly higher tracked more easily. In one case, a million insights that otherwise would go undetected.
ROI numbers than were possible with the dollars of charges in the labor and delivery
centers incumbent technology. One exam- unit have been properly reallocated. The why Fast radar?
ple: today one full-time IT analyst creates BI tools have also helped staff to identify FAST Radar provides actionable informa-
reports for users, down from six previously. that anesthetic costs were not being billed tion at a glance. Its robust browser-based
The new easy-to-use BI system has engaged correctly. FAST has been a phenomenal dashboards and scorecards make it easy for
a broader base of usersfrom facilities success for us, says Hunter. non-expert users to get the facts they need
managers to nurseswhich means they are in real-timeand to act on what they learn.
making better-informed decisions and driving The biggest driver for us was to It is easily scalable: with its open architec-
down costs in many departments. ture, FAST Radar can scale up to match
empower the end user. Now that University Health Cares needs, whether
FAST Radar has given the centers profes- weve done that, weve seen an they involve research data for the teach-
sionals confidence in their dataas well ing staff or patient tracking from the ER to
as control. Its ease of use makes it simple explosion in usage. intensive care. The solution needs minimal IT
for staff to build their own reports (no more Jim Livingston, University Health Care administration; built on the popular Microsoft
spreadsheets needed). The Radar Write Back .NET architecture, FAST Radar provides one
capability lets users update data directly integrated browser-based environment that
to an operational database. Staff also has strategic next steps requires very little ongoing maintenance. And
access to real-time datacritical for tasks Given the success of BI within University it was very easy to implement: FAST Radar
such as utilization planning in Intensive Care, Health Care, the IT group is now evaluating was installed in a matter of hours. l
for instance. Physicians now use browser- the strategic steps needed to apply more
based views of scorecards that track time advanced technology for increased efficiency For a free white paper on this topic, download
Business Intelligence Built on SearchThe
utilization of facilities or schedule variances and effectiveness. Part of the teams evalua-
Adaptive Information Warehouse, or click here
by site. Nurses now control what they are tion includes FAST AIW, a solution in which for more information about FAST.
tasked to manage, ensuring, for example, business intelligence is based on search.
that patient care orders are carried out in a AIW provides two critical features with signifi-
timely manner and monitoring any alerts for cant value to health organizations: advanced
potential adverse event. data cleansing capabilities, and the ability to
Open source software solutions are becom- source solutions can be customized 5. Complete is a relative term. In the case
ing more and more pervasive. Both large and embedded into existing or new of open source solutions, key elements
and small corporations have considered, and applications. such as a semantic layer, dash board-
frequently adopted, open source software as ing, data visualization, and data quality
a component of their overall software imple- 4. Some features are more advanced than components are lacking, while other com-
mentation strategy. Operating systems, data others. If your need is satisfied by these ponents have smaller functional gaps.
bases, source control, IDEs, and Web servers mature features, then open source may
are some of the more common open source be a fit. 6. They are very desktop-centric. While
components. traditional products have evolved to be
heavily Web-centric, these tools are still
While the licensing costs are
It was inevitable that eventually open source very dependent on a rich client to provide
would address data warehousing and low, the TCO (for open source key functionality.
business intelligence solutions. There are
BI solutions) may not be.
currently several open source tools in the The bottom line:
market that address everything from ETL to While open source BI tools have begun to
BI. They claim to provide a complete capa- Some of the challenges and considerations show some promise and will force traditional
bility equivalent to current market leading would include: software vendors to rethink their pricing
solutions. This brief article will address some 1. The current solutions tend to be develop- and strategy, they are still a ways away from
of the pros, challenges, and considerations ment heavy. Many are JAVA-centric, and becoming enterprise solutions. In smaller
for open source as a part of an enterprise will require in-house development skills in organizations support will be a challenge, in
strategy. order to make any real use of the tools. larger organizations the TCO and functionality
may not be there just yet. In considering open
First, lets start with the pros: 2. While the licensing costs are low, the total source, an organization should look at oppor-
1. Open source is relatively inexpensive cost of ownership (TCO) may not be. Given tunities to try it out on a smaller scale, looking
from a licensing perspective. While their development-centric nature, these at specific data mart needs for a potential fit.
more traditional products cost hundreds tools will actually cost more for ongoing Consider your organizations readiness care-
to thousands per seat, open source support than one might initially expect. fully, and if you decide to adopt open source
software can be as inexpensive as free BI, be aware of the trade-offs. l
without support, and certainly much less 3. Open source tool evaluation is more time
than traditional products even when sup- consuming than traditional tool evalua-
port is included. tion. Even getting the vendors to provide
demonstrations of their product can
2. There are open source solutions that prove to be challenging. A free proof of
address a majority of the software contin- concept is most likely out of the question.
uum for DW/BI. The current market seems
to have evolved with multiple consortiums 4. The user interfaces are not nearly as
addressing each aspect of DW/BI. Some robust as traditional software products.
of the software vendors have aggregated This is largely because these tools are
these into end-to-end platforms. still evolving, doing so at the pace of the
consortium. The priorities at this point
3. Component-based design allows them to seem focused on core functionality, not
be retrofit into existing applications. The advanced user interface design.
different subcomponents of the open
Enterprise Business
Intelligence: Making
the Case and Keeping
the Promise
By John Williams
Senior Vice President, National Practice Director,
Collaborative Consulting
It seems these days everyone is embarking rather an enabler, and must be posi-
on an enterprise business intelligence initia- tioned as such. In order for enterprise BI to be suc-
tive. While the catalysts are varied, the basic cessful, you need to consider the
mission statement is the same: Make infor- 2. Dont just settle for consolidation.
mation available across the enterprise in a Many IT groups are in the process of user needs in aggregate and show
consistent and easily accessible manner. consolidating core platforms such as how the new solution will provide
enterprise resource planning and cus-
This seemingly innocuous and laudable mis- tomer relationship management systems. better capability than exists today,
sion statement is fraught with challenges The difference with BI systems is that not just similar capability.
and roadblocks. The firstand perhaps users have heavily customized them to
least obviouschallenge is answering the their own departmental or group needs.
question, Why? Isnt it obvious? Isnt the In order for enterprise BI to be success- of an enterprise BI solution. It is about an
goodness of correct, consistent, and readily ful, you need to consider the user needs enterprise capability to deliver information
available business information enough? Add in aggregate and show how the new in the right for efficiently and with consis-
the equal goodness of a more manageable solution will provide better capability than tency. While this may imply fewer tools, it
technical environment with fewer packages exists today, not just similar capability. does not imply just one or just one set.
and platforms to support, and you certainly
have a compelling case, right? 3. Investigate the reason for the current 6. Clearly identify cost savings.
implementation. Just saying that having fewer tools, envi-
Wrong. Transitioning from the typical depart- Take a closer look at the reasons for ronments, integrations, and platforms will
mental, application-centric, or fragmented BI multiple technologies and fragmented reduce the IT workload is not enough to
environment of today is a nontrivial exercise data, and you may discover things such create a compelling business case. In the
involving resource costs, user tool changes, as department-level funding, lack of near term, this initiative will cost money,
and (in some cases) business process corporate-level drivers, and separate lines not save it.
changes. It requires executive involvement of business as the root cause; these must
and buy-in, and in todays age of closely be considered and addressed before an In such a brief article, we cant cover all
scrutinized IT spending, the usual altruistic enterprise BI initiative can be successful. of the bases; however, if you follow these
arguments just dont wash. Even with buy-in, fundamentals, you should be on your way to
once the spending begins, the business will 4. Create alignment with key business avoiding some of the pitfalls and solidifying
demand to see positive business impact in a organizations. your initiatives opportunity for success. l
reasonable timeframe or the funding will be You need to ensure that the large,
quickly cut off. business-driving organizations needs are For a free white paper on this topic, download
Consolidating the Business Intelligence
satisfied, even if it means compromising
Infrastructure, or click here for more
making the case for enterprise Bi in some of the less core business groups. information about Collaborative Consulting.
in your organization: While not very egalitarian, this is practi-
1. Align directly with business goals. cal and helps ensure that the initiative is
This sounds like an easy thing to accom- adopted and funded by the business.
plish; however, it is more of a challenge
than one might think. It requires a focus 5. Its not about one tool or environment; it
on what the business is trying to achieve is about the right tools and environment.
and alignment with those goals. BI is Many enterprise BI initiatives focus too
almost never the complete solution, but heavily on an enterprise BI tool instead
c a s E s t u Dy
Pleasant Surprises:
Commercial Open
Source BI
By Lance Walter
Vice President of Marketing, Pentaho
c a s E s t u Dy
Mortgage Company
Drives Compliance
with Data Governance
Commentary by Daniel Teachey
Director of Corporate Communications, DataFlux
the Business quality in the hands of business analysts federally mandated reporting is built on
A company that purchases, securitizes, the company turned to DataFlux. high-quality data. Instead of multiple divi-
and invests in the secondary mortgage sions having separate data quality rules, the
markethaving financed, since its incep- the dataFlux solution company now has one source for data gover-
tion, tens of millions of homesfaced a new The company chose DataFlux dfPower nance rules across all applications and data
round of regulatory pressures. Due to recent Studio and the DataFlux Integration Server sources, resulting in a unified, accurate view
increases in scrutiny from regulatory agen- to help it meets its compliance goals. By of corporate data.
cies, it was relying on outmoded technology profiling their data using dfPower Studio, the
and processes to attempt to meet compli- company was able to seek out and correct Putting data quality in the hands of the busi-
ance requirements. This company saw an erroneous or duplicate data to ensure that ness users also allowed the company to
enterprise-wide data governance solution as their data governance initiatives focused on reduce the time needed to implement data
the only real answer to these challenges. the most troublesome data sources. Through quality initiatives. Implementation times went
statistical and numeric range analysis, busi- from months to just a few hours. Because
the challenge ness analysts verified that key metrics, dfPower Studio uses an intuitive interface
Increased scrutiny and new regulatory such as loan-to-value ratios or total unpaid to build rules for data governance efforts,
requirements, such as the Sarbanes-Oxley balances, fell within federally mandated business users could act independently to
(SOX) legislation, have only added to the acceptable ranges. analyze the data and establish real-time
compliance burden for mortgage companies. controls. With business users controlling
Like any financial institution, these organiza- data, the company gained greater flexibility to
With the stakes raised by
tions were already competing in a heavily respond to changes and meet challenges as
regulated industry. Sarbanes-Oxley and other they arose.
legislation, the company needed
Faced with new regulatory challenges, the By making data governance an ongoing part
company found that it did not have either the a more robust, reliable data of its operations, this mortgage company is
technology or processes in place to imple- certain that it has the people, processes,
governance system.
ment a comprehensive data governance and technology in place to be compliant with
program. In the past, separate lines of busi- SOX. Furthermore, because of the adapt-
ness within the company were individually Using dfPower Studio, the companys busi- ability of the DataFlux solution, the company
responsible for their own data quality. Each ness analysts were able to work separately also has the confidence that it will be able to
unit would work directly with the corporate from the IT department to develop their own meet any changing regulatory obligations in
IT division, creating data quality rules, which business rules for data governance. Once the future. l
would then be implemented on each applica- the initial data profiling had been performed,
tion or data source by IT. analysts were able to use dfPower Studio to
transform the findings from the profiling into
This process had a historically slow turn- actionable business rules, then establish
around time, with changes to the rules taking these rules as ongoing data monitoring rou-
weeks or months to be implemented. Plus, tines and deploy them as real-time services
the business analysts who depended on the using the DataFlux Integration Server.
data had very little control over it.
the results
Seeking a system with faster implementa- The company is now much more confident
tion times that could produce more reliable about its quarterly and annual financial
dataand that would place control of data reports because it is confident that its
As companies collect more information about of data governance sophistication within that The final phase, the Governed stage, is
their customers, products, suppliers, inven- enterprise. In the first stage, Undisciplined, where data is unified across data sources
tory, and finances, it becomes more difficult an organization has few defined rules and according to business rules established by
to accurately maintain that information in a policies regarding data quality and data an enterprise data governance team. At this
usable, logical framework. This can severely integration. The same data may exist in final stage of the maturity model, a company
complicate regulatory efforts, because the multiple applications, and redundant data has achieved a sophisticated data strategy
information within applications and databas- is often found in different sources, formats, and framework, and a major culture shift
esdata pertaining to customers, products, and records. has occurred. Instead of treating issues of
employees, suppliers, and financial trans- data quality and data integration as a series
actionsprovides the foundation for audit The danger for Undisciplined companies is of tactical projects, these companies have
reports and various other compliance efforts. the real and constant threat that the underly- a comprehensive program that elevates the
ing data will lead to bad business decisions process of managing business-critical data.
The data management challenges facing that may, in turn, lead to security or com-
todays businesses stem from the way that IT pliance violations. Often, a cataclysmic Although individual applications are still in
systems have evolved. Enterprise data is fre- failure (i.e., failed compliance audit, drastic use by a Governed company, the data that
quently held in disparate applications across decrease in customer satisfaction) shakes the they access comes from a single repository
multiple departments and geographies. To organization out of complacency and leads to that is propagated across the IT infrastruc-
address the spread of data, many companies further progress. ture. This provides the ultimate in control for
implement enterprisewide data governance the enterprise, as all reports and dashboards
programs, which attempt to codify and Data governance is a way to pull from the same pool of information. l
enforce best practices for data management
across the organization. address the challenges posed by For a free white paper on this topic, download
The Data Governance Maturity Model:
an ever-changing IT environment. Establishing the People, Policies and Technology
Data governance encompasses the people, That Manage Enterprise Data, or click here for
processes, and technology that are required more information about DataFlux.
to create a consistent enterprise view of At the next phase, the Reactive stage, a com-
a companys data. By concentrating on pany begins to organize a data governance
the health of the data, organizations can program, either through grassroots efforts
address the lifeblood of their enterprise, or, more likely, through an executive-driven
helping create better data to support any effort fueled by an earlier failure. At the
business initiative. Reactive stage, organizations try to reconcile
the effects of inconsistent, inaccurate, or
the path to data governance unreliable data as bad records are identified.
Like many enterprise initiatives, data gov- Here, the gains are often seen on a depart-
ernance programs often start small before mental or divisional level, but the company is
finding the sponsorship and support needed starting to establish some best practices for
to transcend organizational boundaries. data governance.
Through an established data governance
maturity model, organizations can identify and At the Proactive stage, the data governance
quantify precisely where they areand where program becomes cross-functional and has
they can goto create an environment that explicit executive support. To build a single
delivers and sustains high-quality information. view of a customer, for example, every part of
the organizationsales, marketing, shipping,
The data governance maturity model looks financehas to agree on what attributes
at the technology being utilized, along with make up a customer record.
the people and policies associated with the
governance initiative, to ascertain the level
The issues discussed here quantify the state of BI solutions The SAP-centricity of your BI solution is a matter
for SAP; they also describe the issues you need to consider of degree. In other words, a BI solution for SAP may
before deciding which mix of tools, platforms, approaches, incorporate SAP applications data only, or it may also
professional services, and business sponsorship are appropriate integrate data from other applications (and even non-
to your solution. application sources like syndicated data). The latter
is necessary for a complete view of organizational
performance. In fact, gaining a centralized single
Applications and Data Warehouse version of the truth is one of the reasons organizations
Architecture Issues deploy enterprise data warehouses. The challenge is to
Most of the data that populates data warehouses and reports satisfy both application-specific and enterprise-scope
comes from various types of operational applications, BI requirements.
including those for ERP, CRM, and SCM. Because these are
prominent sources of data that BI is based on, the number Application diversity may lead to BI solution diversity.
and diversity of applications strongly influences the data This may mean deploying both NetWeaver BI and
content and architecture of any BI solution, especially those an enterprise data warehouse (EDW). In most cases,
that involve SAP. NetWeaver BI supports data marts and reports specific to
businesses and processes supported by SAP applications,
SAP users dont only use SAP applications. TDWIs whereas the EDW collates information from many
survey asked, From which vendors has your organization sources for strategic decision making. To reduce the
acquired packaged applications for ERP and other number of solutions, some SAP-centric organizations have
operations? The survey population is dominated by made NetWeaver BI the equivalent of an EDW, while
SAP users, so its not surprising that 71% of respondents others rely on an EDW without any SAP BI products.
report using SAP applications. (See Figure 1.) But many Selecting one of these data warehouse architecturesor a
reported also acquiring applications from Oracle (25%), combination of themis a tough decision for SAP users,
Peoplesoft (24%), Siebel (15%), JD Edwards (12%), and because it affects the cost of BI, completeness of data
so on. Given the numerous vendors selected by survey content, data ownership, and how BI goals are prioritized
respondentsplus home-grown solutionsits safe to (i.e., tactical operations versus strategic planning).
say that most SAP-centric businesses also have significant
non-SAP applications.
SAP 71%
Oracle 25%
Peoplesoft 24%
Siebel 15%
JD Edwards 12%
salesforce.com 4%
Not Any 5%
Other 14%
Figure 1. Based on 476 responses from 278 respondents. Average responses per respondent: 1.7
Is the BI environment for SAP the Whos the primary sponsor for your BI solution for SAP?
same as your enterprise BI Line-of-business managers 44%
environment? Director of IT 25%
Yes 56% Director of Data Warehousing or BI 20%
No 37% Other 11%
Dont know 7%
Figure 2. Based on 172 respondents who are SAp users. Figure 3. Based on 172 respondents who are SAp users.
Figure 4. Based on 278 respondents who use applications from SAp and other vendors.
Organizational Issues The scope of a BI solution for SAP is related to its ownership
TDWI asked of SAP users: Is the BI environment for SAP and sponsorship. (See Figure 3.)
the same as your enterprise BI environment? (See Figure 2.)
Line-of-business managers (44%) commonly sponsor
Enterprise-scope BI. Over half (56%) said yes, which BI solutions for SAP. Line-of-business managers often
suggests that these respondents BI infrastructure is fund, own, and sponsor operational applications, so its
enterprise in scopethat is, it spans the data and BI possible that they have extended this role to also sponsor
needs of many applications and business units, not just application-specific BI. Even so, IT and BI directors
those associated with SAP applications. sponsor BI solutions for SAP just as often (45%).
Application-scope BI. Roughly one-third (37%) said SAP BI sponsorship can also be shared. Several survey
no, suggesting these users have a BI solution that is respondents selected Other and entered comments like
narrowly focused on the data and business processes we use a team approach, no single sponsor. Sponsorship
of SAP applications. Of course, this does not preclude is shared by all businesses where it involves several
them from also having a separate BI solution of stakeholders. Or BI may be sponsored by corporate
enterprise scope. leadership as part of the SAP implementation.
Determining scope is an important BI design decision. Finance departments often sponsor BI, whether for SAP
A BI solution for SAP may be enterprise scope, with SAP- or not. Were reminded of this by survey respondents
specific requirements satisfied by a subset of the solution. who listed their finance organization or its CFO, VPs,
Or it may be application scope, possibly complemented and directors.
by an enterprise-scope BI solution.
Which best describes how you built your BI solution for SAP?
Acquired BI products from SAP and customized them in-house 35%
Acquired BI products from SAP and consultants customized them 30%
Acquired tools from third-party vendors and developed a solution from scratch 16%
Acquired BI products from SAP and use them as is 10%
Other 9%
WhIch BEST DEScRIBES hoW you BuIlT youR BI SoluTIon foR SAp?
Other 9%
Acquired BI products from SAP Acquired BI products from SAP
and use them as is 10% and customized them in-house 35%
Acquired tools from third-party vendors
and developed a solution from scratch 16%
Acquired BI products from SAP
and consultants customized them 30%
Build versus Buy Issues The greater the customization, the greater the difficulty
When it comes to ERP applications and the classic build- of upgrading. Some SAP customers would like to
versus-buy decision, buying is the norm by a long shot, with upgrade from older BW releases to recent NetWeaver
most survey respondents buying and customizing (57%), BI ones, but they feel that customization makes the
followed by those who buy but dont customize much (27%). upgrade too difficult to attempt. Lets all recognize that
(See Figure 4.) By comparison, building an ERP system customization is inevitable with BI products, so upgrades
is rare (9%). This is natural, given the complexity of ERP usually involve development work.
processes and how difficult it would be to build and maintain
an application to automate them. Plus, multiple software Avoiding customization reduces project time and cost.
vendors offer mature ERP systems that are feature-rich, A tried-and-true strategy for a packaged solution is to
robust, and have solid track records. roll out the first phase with little or no customization,
then tailor the solution to organizational requirements in
To quantify the build-versus-buy approaches of BI solutions subsequent phases.
for SAP, TDWIs survey first identified respondents who are
SAP users, then asked them: Which best describes how you We started our implementation of SAP BW in 2002,
built your BI solution for SAP? (See Figure 5.) A whopping working in parallel with the firms implementation of the SAP
75% reported acquiring BI products from SAP, which is a ERP, said Brian Hickie, former VP of Business Intelligence
high penetration of BI products for an applications vendor. at McKesson Pharmaceutical. We only had nine months to
implement the data warehouse, along with considerable ETL
Note that the level of customization varies with SAP jobs and a number of initial analytics and reports. We made
BI products. Relatively few use SAP BI products as is the deadline despite the fact that the SAP ERP configuration
(10%), while most assign in-house personnel (35%) or hire precluded the use of standard business content or standard
consultants (30%) to customize them. Customization has data extractors; the ETL jobs and BW required a considerable
ramifications for packaged solutions: amount of configuration to provide the data to generate
analytics and reports from the ERP and legacy systems.
BI solutions are hard to package. Thats because an
organizations BI data sources, its data models, and its Developing home-grown BI solutions isnt as common as other
report presentations all vary tremendously. However, approaches in Figure 6 (16%). However, other survey questions
if you narrow the scope of the BI solution to specific showed higher rates, and survey respondents who selected
use cases, which SAP NetWeaver BI does by focusing Other entered responses that involve home-grown solutions:
on standard business processes, the breadth of user
requirements is reduced, thereby reducing the difficulties SAP BW and EDWs can coexist peacefully. Some
of packaging a solution that works for multiple user BI solutions for SAP involve both NetWeaver BI
organizations. But BI requirements still vary somewhat, (specifically the BW component) and an independent
even when focused on ERP, so organizations inevitably enterprise data warehouse (EDW). For example,
customize to some degree. one survey respondent said: We both use BW and
extract SAP data into a data warehouse. Another IT professionals when the strategy doesnt consider
reported using BW and an in-house solution based user requirements.
on Oracle and Business Objects, while yet another
said, [We] use SAP BI as an OLAP tool to access a Most mentioned the usual benefits of BI as reasons for
Teradata EDW. implementing a BI solution. Several listed common BI
goals like better decision making or improved corporate
Some BI solutions for SAP are a work in progress. As performance. Others cited specific BI needs such as
one survey respondent put it, Were in transition from a financial reporting, datasets for business analysts, or
legacy custom-developed EDW to SAP BI. operational reporting based on SAP ERP source data.
c a s E s t u Dy
Kelley Blue Book analyzes and publishes its customers could easily use to predict Using these business intelligence products,
data on new and used vehicles. Large buyer trends. Even though that data had the analytics team can analyze data about
automotive manufacturers, as well as indi- the potential to be useful, there was too shoppers who are looking for new vehicles.
vidual car and truck buyers, use the Kelley much of it for manufacturers to make sense
Blue Book Web site to find in-depth pric- of. It was impossible to tell a meaningful Benefits
ing information. The company gathers data story with the data, says Hoffman. Our Kelley Blue Book now has a business intel-
from Web site visits to create trend reports marketing team had all this great information, ligence solution that integrates fully with its
for manufacturers. However, the report- but they didnt have a way to package and existing IT environment, an advantage that
generation process was time-consuming, sell it. They lacked a good software tool to helped the company deploy a new Web
and employees were not able to effectively make that happen. analytics sales report product, called Market
analyze all the data. Watch, in a short amount of time. With the
solution solution, Kelley Blue Book has reduced the
In 2006, Kelley Blue Book implemented a In January 2006, a Kelley Blue Book time it takes sales staff to create reports, has
solution based on Microsoft business intel- employee alerted Hoffman to Microsoft Busi- gained more in-depth analytical capabilities,
ligence technologies. With its new analytical ness Intelligence, a set of fully integrated and can better assist business customers
capabilities, Kelley Blue Book has improved business intelligence technologies that can with targeting their own marketing efforts.
sales staff efficiency and created a com- help reduce the complexity of organizing and Also, because it expects its customer base
pelling new Web analytics product that can distributing information. The new solution, to grow, the company anticipates its rev-
provide its business customers with more which the company implemented that same enues to rise. Other advantages include: full
targeted data for their marketing efforts. The month, gives the Kelley Blue Book analytics integration with existing environment; short
company expects to see its customer base team the ability to quickly and easily col- deployment time for new sales product;
and revenues grow in response. lect targeted data on automotive sales and increased efficiency for sales staff; improved
trends. It includes Microsoft SQL Server analytical capabilities; and more targeted
situation 2005, Microsoft Office Excel 2003, and marketing for business customers
Kelley Blue Book provides vehicle buyers Office PerformancePoint Server 2007 busi-
and sellers with comprehensive information ness intelligence software. Also, because Kelley Blue Book is better able
on new and used cars and trucks. The com- to help its customers with such information,
pany, which currently has 400 employees, Now, Kelley Blue Book employees can it anticipates that its base of customers
publishes up-to-date vehicle pricing and import more than 100,000 rows of Microsoft using Market Watch will grow. Our research
values through its Web site, kbb.com. We Office Excel 2003 data from the Web site revenues are expected to double in 2007,
receive about 12 million unique visitors each into a SQL Server 2005 database each day. compared to 2006. We saw we had a unique
month on the site, says Bruce Hoffman, From there, SQL Server 2005 Integration revenue opportunity, and this solution
manager of business intelligence and data Services moves that data into an online allowed us to address that, says Hoffman. l
management, Kelley Blue Book. analytical processing (OLAP) cube, which
is an arrangement of data in arrays to allow
The company uses specific information for quick analysis. The cube is viewed
gathered from these online visits to generate using PerformancePoint Server 2007 and
reports that it presents to automotive manu- is delivered to sales representatives via a
facturers. However, Kelley Blue Book had dashboard server.
struggled to put the information into a form
c a s E s t u Dy
Spreadsheets in the
Next Generation
By Cate Zovod
Senior Technical Marketing Manager, Actuate
Spreadsheets are a fundamental facilitator This practice allows the organization to organizations to take the appropriate
of the way in which many financial services maintain a single version of the truth and steps to mitigate the risks inherent in
institutions seek to conduct their businesses prevents users from altering the spread- the reporting and analysis performed in
in the 21st century. There is now an accep- sheet and thus the business process. spreadsheets. In order to ensure compli-
tance industrywide that spreadsheets can ance and accommodate the increasing
pose a substantial risk to the success of the 2. Determine a blueprint of what an indi- regulatory scrutiny of spreadsheets in the
business, both in terms of pure profit and vidual spreadsheet looks like and what industry, banks must standardize and rig-
loss and reputation. functions it must incorporate, thus elimi- orously manage the development process.
nating spreadsheet development errors
However, the spreadsheet is ingrained in and validating the data that exists within When spreadsheet processes remain manual
the fabric of the financial services industry, the spreadsheet. and unstructured, the risks in spreadsheet
making it too valuable a tool to eliminate. use remain high. The automation fundamen-
Therefore, banks have focused their attention 3. Distribute scheduled, manufactured tally redefines the concept of spreadsheet
on how best to mitigate these risks and lever- spreadsheets to eliminate spreadsheet risk. Where a repeatable development and
age control across spreadsheets. changes that can occur in the dissemi- distribution process is in place, institutions
nation process, to generate confidence can be confident that they have gained con-
In order to identify best practices that tackle in data quality, and to ensure reports trol of, and confidence in, their spreadsheet
the risks, Lepus Management Consultancy and analyses are received in real time. environments. Adopting these steps will
interviewed practitioners across a range of The timely distribution of spreadsheets help drive compliance with the increasing
tier one and tier two investment banks in also ensures that business processes regulatory scrutiny of spreadsheet use and
order to gain an insight into current industry are not delayed by inefficient distribution strengthen critical business processes. l
practices. Lepus looked at how spreadsheets procedures.
were used across the front, middle, and back For a free white paper on this topic, download
A Paradigm Shift: The Management of
offices throughout these organizations. 4. Centralize spreadsheet processes and
Spreadsheet Use in Financial Services, or
environments to drive accountability and click here for more information about Actuate.
The best practices deliver live business data consistency in the level of control lever-
within a familiar spreadsheet format, with all aged across the business. By leveraging
the formatting, formulae, and graphs intact a centralized server and page-level
and without querying, cutting, pasting, or security, institutions are able to deliver
manual data entry errors. These practices spreadsheets to a defined group of users,
result in instant complete information direct however small or large, in real time.
from source, preformatted and ready to go,
ensuring accuracy, quality, and control. 5. Spreadsheets that access all the neces-
sary data sources provide broader insight
Achieving these benefits can be a reality if and better-integrated information to sup-
organizations are able to follow a series of port decision making.
steps that utilize the existing skills of develop-
ers but introduce automation to ensure the 6. Management of the authorization to
robustness of the process. These steps are create spreadsheets, responsibility for
outlined below: signing off spreadsheets and facilitation
of ongoing monitoring in a live environ-
1. Generate automated, server-based ment are crucial to gaining control. The
spreadsheets that enable complete ver- resulting effect is enhanced transparency
sion control, eliminate human error, and in spreadsheet use.
ensure that the development process
is auditable for compliance purposes. 7. Regulatory pressures, such as Sarbanes-
Oxley, now make it compulsory for
c a s E s t u Dy
Corporate generally unhappy, and resorts to keep- It is important to clarify here what tightly
ing spreadsheets. Corporate finance and integrated means exactly, as integration
Performance IT are generally happy, though, because needs to take place on two fronts. The first
the system provides a consistent solution is a technical integration (see Diagram 1),
Management: that can be easily and cost-effectively where the CPM solution needs to interact
maintained. seamlessly with a customers ERP systems,
Departmental or where the core financials and transactions are
So how can this situation be resolved in a held; data warehousing and BI tools, used for
Corporate? way that meets the detailed needs of the reporting and analysis; and GRC (governance,
individual business, satisfies the corporate risk, and compliance) suite, ensuring compli-
By Ryan Leask
Product Manager, SAP CPM requirements for visibility and consistency, ance and built-in risk sensitivity.
and keeps the TCO low? We are generally
seeing the market answer this question on The second aspect is business process inte-
Sooner or later, everyone faces the same its own, today: vendor standardization. gration. Its not enough for just corporate
conflict when deploying corporate perfor- finance to have a performance management
mance management (CPM) applications: Vendor standardization is happening at a solution. Every department in an organization
how to balance corporate needs against rapid pace. What change Monthlyhas triggered Weekly shouldMonthly
have its own solution, which meets its
Sales Sales by Sales by
departmental requirements. In most orga- this? Perhaps the single biggest factor is Rep individual requirements, yet also seamlessly
Product
nizations, every department wants its own the vendor consolidation taking place in rolls up into a corporate view. For example,
individually customized solution (especially theBilling
CPM market, forcing FINANCEorganizations to SALES MARKETINGdecides to run an additional
if marketing
for budgeting); yet this design inherently Application
look at what systems and/or vendors they campaign to improve sales on a specific prod-
leads to multiple versions of the truth, are now dealing with. Typically, in the past, uct line, it will update its own performance
challenges in combining the figures at a Payroll
each department pursued the best-of-breed management
CRM solution to reflect the increase
ETL Process
Application
corporate level, and total cost of ownership solution that best met its requirements, in expected sales. In an integrated world,
MDM
(TCO) problems (especially when systems while IT departments pursued Detailed Historical that
solutions purchasing (which has its own individual solu-
Legacy Transactions
from multiple vendors are used). integrated
Application with the corporate environment. tion)DATA
wouldMININGnow see thatINDUSTRY
it has a shortfall to
MODELS
With the vendor consolidation in the market, expected sales. Now, imagine this happening
We see organizations generally fit into one of someOthervendors, better known for their inte- corporate-wide across all departments, with
three situations: Application
gration capabilities, are now in possession the data seamlessly rolling up into a corporate
DECISION
WEB LOGS Repositories,
of what was once called a best-of-breed SUPPORT
view and SYSTEMS
the systems all being supported cost-
Applications
They are stuck in spreadsheet hell, with application. What is occurring, therefore, is effectively by IT (see Diagram 1). At least that
no sophisticated CPM systems in place the replacement of isolated departmental is how we at SAP see the Holy Grail for CPM.
(or only deployed to a limited user base). solutions with offerings from a single vendor
All the problems of security, compliance, that touts both best of breed and tightly Find out more at: www.sap.com/solutions/
user error, reconciliation, audit, main- integrated solutions. performancemanagement/. l
tenance, and all the other well-known
spreadsheet issues are being dealt with.
TECHNICAL INTEGRATION BUSINESS PROCESS INTEGRATION
Corporate Performance
Each department has implemented its Management
own CPM solution, but the IT depart-
Corporate
ment is driving to standardize on one P&L
ERP Balance Sheet
vendor. Each individual department is Cash Flow
System
generally happy with its solution, but to
Corporate
have finance/corporate reconciling all the Performance
Expenses Revenues
different formats causes headaches, and Management
c a s E s t u Dy
Innovative Analytics
for Improved
Performance and
Consistent Decision
Processes
Commentary by Steve Trammell
Corporate Alliances, ESRI
the challenge
A major food and beverage provider was
experiencing inconsistent performance from
its new and existing outlets throughout the
U.S. Furthermore, the more competitive envi-
ronment was requiring a more agile approach
to managing real estate assets.
Management suspected that existing BI and Figure 1. If the market area will support another outlet, the user can display a map showing
geographic information systems (GIS) appli- projected revenue potential for various locations.
cations could help solve the problems, but
was unsure how to leverage these assets. areas for each outlet were created based on potential for various locations. (See Figure 1.)
The challenge was to get these disparate actual travel time over the street network as If an underserved location is identified, the
systems working together either to arrive at a opposed to the more traditional ring analysis. user can then add an outlet and conduct a
solution or to determine if additional applica- A further refinement of the trade-area deter- trade-area analysis for the new location. The
tions were needed. mination model accounted for the proximity revenue potential for the new trade area is
of the companys competitors and target cus- then passed back to the BI analysis package,
A consulting firm was engaged to evaluate tomers. This method of modeling trade areas where factors such as acquisition, construc-
the existing applications and suggest pos- is a much more accurate measure of spend- tion, and operations are considered and
sible courses of action. It was determined ing potential than a purely drive-time model. annual net revenue is projected. If the projec-
that updated versions of the BI and GIS tion is favorable, the real estate acquisition
applications were needed, as well as new Utilizing nationwide data and a more sophis- group is notified and tasked with obtaining
GIS functionality and current GIS data. The ticated trade-area model addressed many a site in the newly identified area. Available
consultant brought in the existing BI and GIS of the site performance inconsistencies the sites are run through the trade-area analysis
providers to discuss their current capabilities company experienced using the previous application to validate potential performance.
and to lay out a high-level vision of how the analysis method. These same improvements
clients challenges could be addressed. to existing systems could now be leveraged Benefits
more proactively to manage the companys A more rigorous and repeatable market anal-
the solution entire real estate portfolio using what if ysis methodology gave the company greater
The BI customer analytics application was scenarios. confidence in sales forecasts. The flexible
augmented with data from a new customer and simple-to-use, scenario-based market
survey, resulting in a more accurate cus- For example, if a market area is found to be analysis tool greatly accelerated the site
tomer profile. This customer profile was then underperforming, a new trade-area analy- selection process, resulting in quicker returns
matched to ESRIs Community Tapestry data sis for each outlet is conducted to check on investment for expansion projects.
(demographics and purchasing potential), and individual site performance. Depending on
a nationwide map was generated showing the the outcome of the analysis, the user is The company is now able to react to
distribution of people matching the profile. presented with options for improving the changes in the marketplace much more
areas performance, such as closing, moving, effectively. Developing problems can be miti-
The GIS could then be used to create new remodeling, or adding outlets. If the market gated early to minimize or eliminate losses,
trade areas, and thus revenue potential, area will support another outlet, the user can and newly developing markets can be served
for each outlet across the nation. Trade display a map showing projected revenue more quickly. l
ESRIs geographic information system (GIS) the GIS account manager never inquired
applications had been used for many years about non-GIS related technologies being
Had the GIS or BI account man-
by a major food and beverage provider. GIS used by the company. agers proactively engaged the
was an indispensable part of the decision pro-
cesses in its business. The end users in the It was also obvious that the BI providers had
companys other technology users,
company were satisfied with the functionality never asked the same type of questions of they might have solved the com-
of their GIS applications as well as the support their users at the company. Had the GIS or
they were receiving. Therefore, we were sur- BI account managers proactively engaged the
panys problem sooner and avoided
prised when we were approached by a large companys other technology users, they might the cost of consulting services.
consulting firm to meet with the company to have solved the companys problem sooner
explore potential solutions to an increasingly and avoided the cost of consulting services.
critical challenge they were facing. Now that GIS can be deployed in service-
ESRI has been participating in business oriented architectures (SOA), it is impera-
We also learned at this time that the com- application conferences over the past few tive that account representatives become
pany was using a number of BI applications, years, most notably BI and enterprise con- familiar with their clients entire technology
and the providers of those applications were tent management (ECM) events. Well over landscapes. The ability of SOA to provide
being asked to join the discussions. Our half of the prospects we engaged at these solutions by using services from numerous
account manager was completely unaware events were from organizations that were applications, including GIS, requires that
of the companys challenge, even though he existing ESRI clients. However, many of account managers be cognizant of a wide
was in regular contact with its GIS users. these individuals were either unaware of the variety of technologies. It also requires that
GIS implemented in their organizations or technology providers make information about
In the conversations that followed, it became did not know it could be integrated with other technologies readily available to their
apparent that the existing GIS and BI applica- their departments existing applications. account managers. l
tions could solve parts of the problem, and This indicates that the segregation of
some additional GIS applications could solve applications experienced at the food and For a free white paper on this topic, download
Developing and Deploying an Integrated
the rest. There would also be some GIS and BI beverage company is a common, yet often
Geoenabled SOA Business Solution: A Case
services work necessary to tailor the resulting unacknowledged, problem. Study, or click here for more information
solution to the specific needs of the company. about ESRI.
We have applied the lessons learned from
What was proposed was an integrated these experiences in both our marketing
solution that provided a common point of and sales efforts. Account representatives
interaction with the GIS and BI applications. with domain expertise in application areas
Fortunately, over the past few years GIS has other than GIS, such as BI, are no longer
been integrated with virtually all major BI assigned to accounts based on location,
platforms, so a comprehensive solution could but to accounts where their expertise will be
be built that leveraged many of the com- most useful.
panys existing GIS and BI applications.
Our marketing efforts have spread to publica-
This experience showed us that todays tions and events not targeted at traditional
technology environment requires account GIS markets. The marketing efforts are aimed
managers who are willing to engage their at making the end users of other application
customers in discussions about tech- platforms aware of GIS so they begin asking
nologies that may fall outside the account about GIS resources already being used in
managers area of expertise. In this case, their organizations.
c a s E s t u Dy
Cablecom Reduces
Churn with the Help of
Predictive Analytics
Commentary by Federico Cesconi
Head of Customer Insight and Retention,
Cablecom GmbH
situation
Cablecom GmbH is Switzerlands largest cable
network operator. Broadcasting to 1.6 million
homes across the country, Cablecom offers
customers cable television, broadband Inter-
net, and mobile and fixed-network telephony.
Enhance Enterprise
BI to Drive Business
Growth with Predictive
Analytics
By Colin Shearer
Senior Vice President, Market Strategy, SPSS Inc.
Stories abound of the business improvements companies start with the most easily accessi- to allow a transaction based on a models
and impressive return on investment that ble datatypically, descriptive/demographic estimate of customer credit risk. As you plan
organizations have achieved using predic- and behavioral/transactional data held in how these decisions will fit into your busi-
tive analytics, including dramatic reductions the customer warehouse. But the more you ness processes, you also need to consider
in customer churn, huge boosts in market- know about your customers, the closer you how they will integrate with the operational
ing response rates, and significant savings can come to a holistic view of them in your systems that support them. For example,
through better fraud detection and risk dataenabling you to better understand will model scores be used to select and rank
management. As C-level executives become them and more accurately predict their target lists that are sent to campaign man-
aware of this opportunity to improve their behavior. Look for additional data that can agement systems, or will models be invoked
businesses, many companies find them- add incremental value to your predictive ana- in real time during contact center conversa-
selves adopting predictive analytics. lytics efforts. Consider text (e.g., transcripts tions, where decisions will be made based on
of call center conversations), clickstream data that has just become available?
Before rushing headlong into a predictive data from Web site visits, and attitudinal data
analytics project, however, you should con- from surveys. Focus on early success, but keep the enter-
sider a few key points to help you ensure prise vision. Although individual predictive
success and maximize the value you can analytics solutions can generate significant
obtain from predictive analyticsboth in
Before rushing headlong into a ROI, organizations that apply the technology
your initial project and ultimately across the predictive analytics project, across different areas of their business gain
enterprise. maximum returns by taking an infrastructure
consider a few key points to help approach to implementing predictive analyt-
Choose your initial target. Look for areas you ensure success and maximize ics. While you should focus on the success
where predictive analytics have been applied of your initial project, keep in mind the
successfully in companies like yours. Across
the value you can obtain. long-term benefits of sharing a common ana-
sectors, the most common initial areas for lytical platform and data views across your
implementation are CRMwhere it is used future applications. Plan a roadmap that will
to optimize customer acquisition, value, and Plan how to use the results. No matter how support your evolution to a truly predictive
retentionand risk management. Seek out good your analysis or how accurate the pre- enterprise. l
case studies and learn lessons that can apply dictive models you build, you only generate
to your business. ROI when you do something with the results. For a free white paper on this topic, download
Predictive Analytics: Extending the Value of
Deployment of results is crucial and needs to
Your Data Warehousing Investment, or click here
Treat it as a business project. Analysis may be planned at the start of your project. Typi- for more information about SPSS.
be a technical activity, but having Ph.D. stat- cally, deployment involves making intelligent
isticians drive your project is the wrong way model-based decisions at key decision points
to do it. Striving for technical improvements in the business processes youre trying to
in accuracy of predictive models isnt the improve. This might be deciding whether to
same as maximizing the business benefit of include a specific customer in an outbound
your analytical results. Bring together analyti- mailing campaign that makes a retention
cal skills and business skills, and ensure the offer to high-value customers predicted to be
focus stays on business success. at serious risk of defection; deciding, during
a contact center conversation, to make a
Leverage all relevant data. Predictive ana- cross-sell offer based on a propensity mod-
lytics leverages your data assets. Many els recommendation; or deciding whether
c a s E s t u Dy
Verizon Communications Inc. delivers communication innovations UMB Financial Corporation is a financial holding company that
to mass market, business, government, and wholesale customers. offers complete banking and related financial services to individual
Verizon Wireless serves 59 million customers nationwide; Veri- and business customers. Its banking subsidiaries own and operate
zon Business operates one of the most expansive wholly owned 139 banking centers. Subsidiaries of the holding company and the
global IP networks; and Verizon Telecom deploys the nations most lead bank, UMB Bank, n.a., include an investment services group
advanced fiber-optic network. based in Milwaukee, Wisconsin, a trust management company in
South Dakota, and single-purpose companies that deal with broker-
In 2003, Verizon Telecom developed Performance Assurance age services, consulting services, and insurance.
Reporting Suite (PARS), a relational online analytical processing
application that serves as a scalable common point of access for Years ago, UMB Bank associated its customers with certain prod-
metrics and analytics. PARS operates atop the companys active uct sets and managed its technology in the same way; however,
enterprise data warehouse environment from Teradata on the same many customers spanned both lines of business. UMB had excel-
high-speed server. lent individual lines of business systems, but immature customer
enterprise information management systems.
Verizon Communications Inc., formed in 2000 by the merger of Bell
Atlantic Corporation and GTE Corporation, has continued to grow During a growth phase, UMB aligned its tools and technologies to
through acquisitions. Verizon had difficulty unifying the diverse fit its business model, which enabled UMB associates to become
markets and product lines of the former companies and reconcil- customer-centric. The transition required breaking down some of
ing data across markets and regions. The company recognized the the organizational silos that functionally segregated customer data.
need for universal access to a central data repository to expedite In addition, UMB needed a mechanism by which all information
data queries and provide valuable customer insight. could be aggregated.
PARS has changed the way Verizon does business. With PARS, Three key aims drove this initiative: 1) to increase front-line efficien-
Verizon now has a single 360-degree view of the customer across cies by consolidating customer data, thus reducing the research
all acquired brands and regions, and it operates with a single, time necessary to quantify the customer relationship; 2) to improve
common version of the truth for reporting and analysis. cross-sale opportunities by consolidating current product offerings
and identifying complementary products; and 3) to empower asso-
Verizons initiative began with an active enterprise data warehouse ciates to fulfill UMBs mission of knowing its customers. To achieve
that served to aggregate metrics across hierarchies. Verizon sought these objectives, UMB needed an enterprise CRM solution with a
insight through customer and product data to successfully promote focus on data quality best practices. UMB evaluated available tech-
its offerings. nologies that would help aggregate existing host systems to create a
foundation for the overall CRM effort.
By building its own application, Verizon has saved approximately
$2 million in resources and $1 million in licensing fees and main- The finished design offered flexibility and logical building blocks for
tenance over a four-year period, and also reduced preparation time the future. The first phase was launched in May 2006. The project
by 90 percent. yielded CRM success, some of which UMB links directly to Trillium
Software and Oracle UCM. UMBs information aggregation model is
highly streamlined and has gained accolades from peer group cus-
tomers and fellow commercial entities.
DaimlerChrysler (DCX) is a global automotive manufacturer formed by Ingenix, a wholly owned subsidiary of UnitedHealth Group (UHG),
the merger of Daimler-Benz and Chrysler Corporation. Procurement at is a global healthcare information company founded in 1996
DCX is part of an organization called Global Procurement and Supply to develop, acquire, and integrate best-in-class healthcare
(GP&S), and is extremely important to DCX because approximately information capabilities.
$100 billion is spent annually on parts and services. Cutting these
costs by even a small percentage generates large benefits. At the heart of all BI activity at Ingenix/UHG is the Galaxy
enterprise data warehouse (DW). Galaxy is an atomic DW with
After the merger, operational systems for creating purchase orders transformations that integrate subject areas across many UGH
and paying suppliers could not be standardized quickly. A data platforms. Galaxy eliminated data silos and inconsistencies across
warehouse was built for combining the procurement summary data; these platforms and is now the companys single source of truth
the result was the Global Procurement & Supply Information System for many applications. Technologies and techniques developed for
(GPSIS), which has grown far beyond the original vision. UHG are also sold to other healthcare companies, making Ingenix
both an in-house analytics and IT group and a commercial solu-
GPSIS aids in global negotiation, facilitating achievement of lower tions provider.
costs and higher quality of purchased parts and services. The
annual corporate goal for reducing purchased-part costs exceeds A centralized program-management office coordinated the
$1 billion, and GPSIS is key to meeting that goal, as it is already transition to Galaxy from two legacy DWs and legacy systems.
credited with helping to create savings of millions of dollars. Requirements-gathering began in 1998, and Galaxy went into pro-
duction in 2001. Its database was 2.5 TB, growing to 18 TB today.
GPSIS began as a globally available DW with structured, Web-based About 50 business analysts, data modelers, DBAs, and software
reporting and has evolved into a fully functional BI platform with engineers worked mostly in-house, with the exception of IBM data
strategic planning applications. modeling assistance.
The original goal was merely to understand how much business The consolidation saved the company several million dollars and
was done with each supplier. This provided leverage for negotiat- has produced ongoing cost savings, eliminated redundancies,
ing lower prices based on the full global value of business across and dramatically increased the efficiency of integrating new data
commodity groups. DaimlerChryler then needed a way to consider sources. Information quality is the foremost objective for Galaxy.
the other aspects of total cost of ownership, since choosing a sup-
plier means more than finding the lowest price. The company used Ingenix has three information-quality goals: 1. Ensure the company
the GPSIS DW as a foundation for balanced scorecards to track meets business-defined quality standards and goals. Galaxy must
supplier performance globally. The next step for the system was to always be valid to a Six Sigma level of verifiable quality. 2. Monitor
support both Daimler and Chrysler corporations as they operated information quality continuously to save operational maintenance
separately. Management at both companies has expressed strong costs. 3. Continuously improve Galaxys overall quality to ensure
desire to retain GPSIS functionality for their respective global pur- UHGs overall health.
chasing operations.
Galaxys industry-differentiating characteristic is its value-added
CRM applications provide a basis for managing a companys rela- transformations, which derive information from multiple sources
tionship to its customers. In a similar fashion, GPSIS is a supplier the heart and soul of the information quality management program.
relationship management system that provides a basis for managing These value-added transformations enable difficult processes such
the companys relationship to its suppliers. as finding patients to invite to drug trials. Galaxys completeness
and breadth, quantity of information, and trustworthiness give value
to this process.
The Richmond, VA, police department needed an analytic system Memorial Sloan-Kettering Cancer Center (MSKCC) is one of the
that would help determine the probability of particular types of premier cancer centers in the world, committed for over a century
crime occurring in specific areas at specific times. Combining to exceptional patient care, leading-edge research, and superb
technology expertise from SPSS and Information Builders, the Rich- educational programs. The Center has nearly 9,000 employees. In
mond Police Department (RPD) is now using predictive analysis 2006, more than 21,000 patients were admitted to Memorial Hos-
and business intelligence technology to apply information-based pital, and MSKCC accommodated over 430,000 outpatient visits.
policy.
The MSKCCs data warehouse, the Institutional DataBase (IDB),
The RPD systems predictive analytics capabilities help determine was launched in 1988 when the information systems senior
where a crime may occur and empower officers at all levels to take management team formed a broad-based steering committee.
immediate actions. Overall, the system delivers accurate insight into This committee defined a methodology to create, maintain, and
where crimes might occur, increases public safety, and reduces the administer a data warehouse that would ultimately unite clinical,
number of calls for assistance. From 2006 to 2007, major crime operational, and financial data. The IDB has evolved well beyond
was down 19 percent; from 2005 to 2006, it was down 21 percent. its original objective to make institutional data readily available for
research, decision support, and executive information systems.
In 2002, RPD procured an enterprise data-mining workbench from
SPSS to predict patterns of behavior that would help it use police Today, IDB data provides clinicians with a patients history of
resources more effectively. Recognizing the value in this statistical chemotherapy; it also helps clinicians study and compare the effec-
analysis system, in 2005 and 2006 RPD enhanced the system by tiveness of treatment regimens.
deploying Information Builders WebFOCUS BI tools in conjunction
with GIS mapping software from ESRI. The benefits of the system MSKCCs information systems data delivery group, DataLine, has
have surpassed original expectations. provided thousands of reports to support cancer research initia-
tives, leading to active protocols and published papers. The group
Three key elements contribute to the success of the project: real-time has also provided key information in the generation of tens of mil-
information, usability, and portability. The agility and responsiveness lions of dollars in institutional grants.
of the RPD system give officers fresh information at every eight-hour
shift change, and some data is updated continuously. The IDB is the primary data source for visit processing, which
supports the coding of about $1 billion in annual ambulatory
Information Builders tied components of WebFOCUS into map- revenue. Further, IDB reports have been created to help support
ping software from ESRI to create an easy-to-understand, intuitive accreditation from the Joint Commission on Accreditation of Health-
presentation of the law enforcement application. Dashboards serve care Organizations (JCAHO). Also, census information from the IDB
as the key interface. The system offers point-and-click drill-down supports budgetary decisions by MSKCC management.
capability and visual representation of current analytic data. The
new applications portability is crucial to successful deployment. In 1989, the IDB consisted of two subject areas. Today, 16 disparate
With data terminals in their cars, officers receive alerts, conduct applications with various DBMSs feed the IDB to produce more than
planning, and develop strategies, and supervisors are able to review 1,000 daily reports. In place since IDBs inception are morning
performance outcomes in each area. reports for each subject area, which are monitored daily in order to
identify data anomalies, growth, and exception conditions.
The predictive analysis system uses a database of arrests, past
calls to police, and crime incidents. Advanced analytics from SPSS DataLine was created in the early 1990s, starting with one data
are used to examine how current crime reports relate to data on expert; the group has grown to six, and develops more than 500
past, present, and anticipated actions. Advanced analytics include ad hoc and scheduled reports per year. Power users also provide
statistical, mathematical, and other algorithmic techniques. data delivery services and run reports out of the IDB for 10 depart-
ments, accounting for thousands of reports per year.
Airlines Reporting Corporation (ARC) is an airline-owned company Corporate Express, part of the Holland-based Corporate Express
offering financial settlement solutions and data and analytical NV (NYSE: CXP), is one of the worlds largest B2B suppliers of
services to airlines, travel agencies, airports, and travel industry essential office and computer products and services, with 2006
analysts. Its vision was to provide a travel industry solution to cus- sales of approximately $4 billion in North America, including
tomers and give them the resources of an industry data warehouse. $3.6 billion in the U.S.
ARCs cross-functional Data & Analytical Services team manages Corporate Expresss distribution infrastructure is among the
ARC COMPASS, a data warehouse that captures and analyzes industrys most advanced. It delivers an average of $13 million in
information related to air travel ticketing and holds 39 months products every business day in the U.S., $6.31 million of which is
of historical data. ARC has centralized and simplified industry ordered through the Internet. To increase sales on all combined
reporting in virtually every internal decision-making and workflow orders, Corporate Express built a market basket application to rec-
function. The result is significant tangible and intangible cost reduc- ommend related products to customers during their purchase.
tions.
The market basket application is based on reference products
ARCs first BI application, ARC Document Retrieval Service, helped and correlated products. When a customer chooses a reference
the company realize $12.5 million in core cost reduction related product, the application presents nine mathematically correlated
to shipping fewer paper ticket coupons. ARC also mines data on products to pair with the reference product. Optimal pairing is
behalf of external customers. The results help travel industry cus- determined by three metrics:
tomers create targeted marketing plans, assess incentive programs,
and optimize promotions. ARC offers insight for route and network Support: The probability that the reference and correlated products
planning, sales trends, customer behavior, demand forecasts, will be purchased together.
statistical profiles, point of sale analysis, and targeted marketing
campaigns. Confidence: The probability that the correlated product will be pur-
chased once the reference product is added to a shopping cart.
The Data & Analytical Products business line has experienced
better than 100 percent revenue growth in each of the past two lift: The improvement in the probability that the correlated product
fiscal years. ARC offers more than 60 revenue-generating reporting will be purchased once the reference product is added to a shop-
products, and launches five new revenue-generating products ping cart, divided by the original probability that the correlated
each year. product will be purchased independently.
ARC has implemented a comprehensive best-practice data gover- With the application in place, analysis now shows and often pre-
nance framework through the assignment of data custodians and dicts what items might occur together in a checkout session. The
data stewards. The data provisioning team provides data integrity BI application is having enormous impact. The company can track
through modeling of the data across business, operational, and all online baskets and identify what SKUs are most profitable or
technical levels. This team also supports ongoing infrastructure poor performers when purchased in combinations. According to
initiatives. ARC develops many of its products and services through Corporate Express, the market basket application has generated the
an iterative prototyping methodology. Prototypes of reports and following ROI results:
even analytical front-end applications are developed quickly and
modified easily. Average order size for basket purchases increased more
than 2 percent
ARC was the first organization in the industry to comply with the
data security standard of the payment card industry, and complies Average order size for orders with a basket pairing is more
with the European Union Safe Harbor program. With its entry into than twice that of orders without a basket pairing
BI/DW solutions, ARC has expanded existing market segments and
developed new ones. The company has significantly expanded its Many companies present complementary products as part of the
marketing list services with ARC COMPASS and can provide highly shopping experience, often based on the professional judgment of
customized marketing lists for destination marketing organizations, marketing or merchandising organizations, and complements are
airlines, and various service providers. often intuitive (e.g., pairing staplers with staple removers). Leverag-
ing predictive analytics allowed Corporate Express to innovate past
intuition and judgment to base pairing decisions on solid math.
radical Bi
Winner: Lawrence Livermore national Laboratory
Dimension data is separate from fact data, which allows ERW users
and application a great deal of flexibility. If fact data contains the
base attribute (such as account or employee number), then all rel-
evant dimension data is dynamically available, even if absent from
the reporting view. Users can easily create, maintain, and use their
own virtual dimensions (URAs) or use a wealth of institutionally
maintained dimensions (IRAs). This dimensioning architecture also
allows for rapid deployment of completely new dimension sets with-
out programming or creating new view structures.
Solution Providers
Actuate Corporation, the leader in business Business Objects is the worlds leading BI
intelligence, performance management, and software company, helping organizations gain
reporting applications, enables organizations better insight into their business, improve
to develop solutions that optimize corporate decision making, and optimize enterprise
performance. Applications built on Actuates performance. The companys business intel-
open sourcebased platform provide all ligence (BI) platform, BusinessObjects
stakeholdersinside and outside the firewall, XI, offers the industrys most advanced and
including employees, customers, partners complete platform for reporting, query and
and citizenswith information that they can analysis, performance management, and
easily access and understand to maximize enterprise information management including
revenue, cut costs, improve customer satisfac- data integration, data quality, and metadata
tion, streamline operations, create competitive management. BusinessObjects XI includes
advantage, and make better decisions. Crystal Reports, the industry standard for
enterprise reporting. Business Objects also
Actuate has more than 4,000 customers has the industrys strongest and most diverse
globally in a diverse range of business areas, partner community, with more than 3,000
including financial services and the public partners worldwide. In addition, the company
sector. Founded in 1993, Actuate has head- offers consulting and education services to
quarters in South San Francisco, California, help customers effectively deploy their busi-
with offices worldwide. Actuate is listed on ness intelligence projects.
NASDAQ under the symbol ACTU. For more
information on Actuate, visit the companys
Web site at www.actuate.com.
Collaborative Consulting is a leading profes- DataFlux enables organizations to analyze, DATAllegro v3 is the industrys most
sional services organization that specializes in improve, and control their data through advanced data warehouse appliance utiliz-
optimizing its clients business and technology an integrated technology platform. With ing an all-commodity platform. By combining
capabilities. We combine exceptional business DataFlux enterprise data quality and data DATAllegros patent-pending software with the
knowledge and market-leading technol- integration products, organizations can more industrys leading hardware, storage, and data-
ogy expertise with an effective partnership effectively and efficiently build a unified view base technologies, DATAllegro has taken data
approach, allowing us to understand and solve of customers, products, suppliers, or any warehouse performance, reliability, and inno-
even the most complex business problems. other corporate data asset. A wholly owned vation to the next level. DATAllegro v3 goes
And, by aligning business and technology ini- subsidiary of SAS (www.sas.com), DataFlux beyond the low cost and high performance
tiatives, we can help clients achieve superior, customers can rapidly assess and improve of first-generation data warehouse appliances
cost-effective business solutions. Founded in problematic data, building the foundation for and adds the flexibility and scalability that only
1999, Collaborative provides operational con- enterprise data governance. Effective data gov- a commoditized platform can offer.
sulting, program management, data services, ernance delivers high-quality information that
and technology services for clients across the can fuel successful enterprise efforts such as Whether you have a few terabytes of user data
U.S., with headquarters in Burlington, MA. risk management, operational efficiency, and or hundreds, DATAllegros data warehouse
Collaboratives Web site is: www.collaborative- master data management (MDM). To learn appliances deliver a fast, flexible, and afford-
consulting.com. more about DataFlux, visit www.dataflux.com. able solution that allows a companys data to
grow at the pace of its business.
Since 1969, ESRI has been giving custom- FAST creates the real-time search and busi- IBM is the worlds leading IT provider. For
ers around the world the power to think and ness intelligence solutions that are behind the nearly a century IBM has been enabling
plan geographically. As the leader in GIS, scenes at the worlds best-known companies companies to make better informed decisions
ESRI applies innovative technologies to help with the most demanding information chal- by helping businesses to generate, manage,
organizations create, analyze, and visual- lenges. FASTs flexible and scalable integrated and extend their enterprise data warehouse.
ize information for more informed decisions. technology platform and personalized portal By combining world-class database software,
ESRI software is used in more than 300,000 connects users, regardless of medium, to the information integration, master data manage-
organizations worldwide, including each of relevant information they need. ment, analytics, Web services and more, IBM
the 200 largest cities in the United States, is now helping organizations move beyond tra-
most national governments, and more than ditional data warehousing approaches toward
two-thirds of Fortune 500 companies. Only dynamic warehousingthe next evolution in
ESRI provides complete technical solutions data warehousing. A dynamic warehousing
for desktop, mobile, server, and Internet plat- approach makes it easier for IT organizations
forms. ESRIs Web site is: www.esri.com to support business requirements for action-
able informationnot just data, but all types
of information with intelligence behind it to
help people take action and make decisions.
Informatica Corporation delivers data integra- Information Builders created the industrys Founded in 1975, Microsoft is the worldwide
tion software and services to solve a problem most widely deployed business intelligence leader in software, services, and solutions that
facing most large organizations: the frag- solution and is the leader in real-time opera- help people and businesses realize their full
mentation of data across disparate systems. tional reporting. The WebFOCUS business potential. Microsoft Business Intelligence is a
Informatica helps organizations gain greater intelligence platform, the companys flagship complete, fully integrated offering, enabling
business value from their information assets product, has the architecture, integration, all decision makers to drive increased busi-
by integrating their enterprise data. Informati- and simplicity to permeate every level of the ness performance at strategic, tactical, and
cas open, platform-neutral software reduces extended enterprise. It is the most scalable, operational levels. Microsoft BI enhances the
costs, speeds time to results, and scales to secure, and flexible solution in the market performance of all employees by providing reli-
handle data integration projects of any size or and helps organizations build applications able access to information they need to make
complexity. With a proven 13-year track record that have no barriers. Information Builders informed decisions and respond appropriately
of success, Informatica helps companies and is the only vendor with its own complete to changing conditions that impact their busi-
government organizations of all sizes realize integration solution. ness. With Microsoft Business Intelligence,
the full business potential of their enterprise you can take advantage of your informa-
data. Thats why Informatica is known as the iWay Softwares ability to seamlessly tion assets, create competitive advantages,
data integration company. integrate with WebFOCUS enables unrivaled improve customer satisfaction, and make well-
information access. informed decisions. Visit www.microsoft.com/
BI for more information.
Information Builders award-winning technol-
ogy provides quality software and superior
services to more than 12,000 customers,
including most of the Fortune 100 and U.S.
federal government agencies. Headquartered
in New York City with 90 offices worldwide,
the company employs 1,600 people and has
more than 350 business partners.
MicroStrategy is a global leader in business Oracles business is informationhow to Pentaho provides a full spectrum of open
intelligence (BI) technology. Founded in 1989, manage it, use it, share it, protect it. For source business intelligence (BI) capabilities,
MicroStrategy provides integrated reporting, nearly three decades, Oracle (NASDAQ: including reporting, analysis, dashboards, data
analysis, and monitoring software that helps ORCL), the worlds largest enterprise software mining, data integration, and a BI platform,
leading organizations worldwide make better company, has provided software and services that have made it the worlds most popular
business decisions every day. Companies that enable organizations to get the most open source BI suite. Formed by a highly expe-
choose MicroStrategy for its advanced techni- accurate and up-to-date information from their rienced team of industry veterans, Pentaho
cal capabilities, sophisticated analytics, and business systems. Today, Oracle has more has a mission to bring innovative, high quality
superior data and user scalability. than 275,000 customersincluding 98 of the technology and professional support to the BI
Fortune 100in more than 145 countries. market. Pentaho uses a revolutionary approach
With thousands of customer successes and to development, distribution, and support,
a reputation for innovation and leadership, made possible by an open source business
MicroStrategy is the clear choice for your model. Pentaho is the primary sponsor and
business intelligence requirements. More owner of popular open source projects includ-
information about MicroStrategy is available at ing Mondrian, JFreeReport, Kettle, and Weka.
www.microstrategy.com. Pentahos technologies support a wide range of
business initiatives from sales and profitability
analysis to customer analysis, HR reporting,
financial reporting, KPI dashboards, supply
chain analytics, and operational reporting.
Portrait Software is a global provider of cus- SAP is the worlds leading provider of busi- SPSS Inc. (Nasdaq: SPSS) is a leading global
tomer interaction optimization software that ness software. More than 41,200 customers in provider of predictive analytics software and
makes every interaction count. more than 120 countries run SAP applica- solutions. The companys predictive analyt-
tionsfrom distinct solutions addressing the ics technology improves business processes
Our software is used by large organizations to needs of small and midsize enterprises to suite by giving organizations forward visibility for
deliver great customer service and to dramati- offerings for global organizations. Powered decisions made every day. By incorporating
cally improve customer revenues, profitability, by the SAP NetWeaver platform to drive predictive analytics into their daily operations,
and loyalty by applying insight and intelligent innovation and enable business change, SAP organizations become Predictive Enterprises
decisioning at the point of customer interac- software helps enterprises of all sizes around able to direct and automate decisions to meet
tion. the world improve customer relationships, business goals and achieve a measurable
enhance partner collaboration and create competitive advantage. More than 250,000
Portrait Software offers applications and solu- efficiencies across their supply chains and public sector, academic, and commercial
tions to optimize these customer interactions to: business operations. SAP solution portfolios customers rely on SPSS technology to help
support the unique business processes of increase revenue, reduce costs, and detect
Deliver a differentiated customer service more than 25 industries, including high tech, and prevent fraud. Founded in 1968, SPSS is
retail, financial services, healthcare, and the headquartered in Chicago, Illinois. For more
Increase profitable sales public sector. With subsidiaries in more than information, please visit www.spss.com.
50 countries, the company is listed on sev-
Retain profitable customers eral exchanges, including the Frankfurt stock
exchange and NYSE under the symbol SAP.
Identify and prevent fraud (Additional information is at www.sap.com.)
Sybase is the largest global enterprise software Syncsort Incorporated is a leading developer Tata Consultancy Services is an IT services,
company exclusively focused on managing of high-performance storage management and business solutions, and outsourcing orga-
and mobilizing information from the data data warehousing software. For more than nization that delivers real results to global
center to the point of action, providing open, 35 years, Syncsort has built a reputation for businesses, ensuring a level of certainty
cross-platform solutions that securely deliver superior product performance and reliable no other firm can match. TCS offers a
information anytime, anywhereenabling cus- technical support. An independent market consulting-led, integrated portfolio of IT and
tomers to create an information edge. Sybase research firm named Syncsort as one of the IT-enabled services delivered through its
addresses the need for business intelligence top data warehouse 100 vendors seven years unique Global Network Delivery Model, rec-
and data warehousing with world-class in a row. More than 90 percent of the ognized as the benchmark of excellence in
data modeling, ultrahigh-speed business Fortune 100 companies are Syncsort custom- software development.
analytics, and comprehensive data integra- ers, and Syncsorts products are used in more
tion technologies. Maximize the potential of than 50 countries to back up and protect data A part of the Tata Group, Indias largest indus-
your information assets and achieve better in distributed environments, speed data ware- trial conglomerate, TCS has more than 94,000
intelligence capabilities with Sybase IQ, Pow- house processing, and improve performance of the worlds best-trained IT consultants in 47
erDesigner, and our Data Integration Suite. in applications with high data volumes. countries. The company generated consoli-
When businesses get serious about business dated revenues of $4.3 billion (U.S. dollars)
intelligence and data warehousing, they get for fiscal year ended March 31, 2007 and is
Sybase. Visit www.sybase.com. listed on the National Stock Exchange and
Bombay Stock Exchange in India. For more
information, visit us at www.tcs.com.
About TDWI
high-quality education and research Through TDWI Membership, business intel- TDWI Onsite brings TDWI courses to customer
ligence and data warehousing professionals sites and offers training for all experience
in the business intelligence and
learn about the latest trends in the industry levels. Everyone involved gains a common
data warehousing industry. Starting while enjoying a unique opportunity to learn, knowledge base and learns in support of the
network, share ideas, and respond as a collec- same corporate objectives. Training can be tai-
in 1995 with a single conference,
tive whole to the challenges and opportunities lored to meet specific business needs and can
TDWI is now a comprehensive in the industry. incorporate organization-specific information.
425.277.9126
info@tdwi.org
www.tdwi.org