You are on page 1of 10

Data warehouse concepts

This document highlights the key concepts for DW/BI project

Agenda
Introduction to BI and DW Data Warehouse Concepts DW development life cycle Data Models Testing models Source Vs Target Diagram Data Warehouse Tools

Introduction to BI
The purpose of Business Intelligent (BI) is to support better business decision making Data warehouse is the main repository of the organizations historical data. It contains the data for the managements decision system Data warehouse can be described as subjectoriented, integrated, time variant, and nonvolatile fashion

Data Warehouse Concepts


Data warehouse concepts involve:
Data Migration Data Cleansing Data Mining Data Auditing

DW Development Life Cycle


DW development life cycle can be grouped into following phases:
Phase I: Inception
Development of a Business Case for a BI Solution Organization of a BI Steering Committee Definition of the Required BI Infrastructure Creation of the BI Evolution Roadmap: Decision Support Systems

Phase II: Initiation


Initiation of a BI Project The development of the Project Charter Business Assessment Requirements Gathering Project Planning
Creation of the Project Team

DW Development Life Cycle


Continue...
Phase III: Design
Analysis and Design activities to create the DW Architecture Conduct Technology and Data Quality Assessments Design Data Models Metadata Repository ETL Application and BI Reports

Phase IV: Development


Develop physical data models Construct ETL code and BI reports

Phase V: Testing
Unit test, System integration test User test and User training

DW Development Life Cycle


Continue.....
Phase VI: Deployment
User Training and Production deployment of
BI Databases Metadata Repository ETL code BI Report

Phase VII: Post Production


BI application monitoring and support
Data load logs Data volumes Data auditing Report usage frequencies Change Tracking

Data Models
Data models included
Source Systems Target Systems Actors Deployment Diagram Package Diagram Stereotype Communication diagram Timing Diagram

Testing Models
Testing models for Data warehouse consists of Requirements testing, unit testing, integration testing, and acceptance testing
Requirements testing:
Use requirements and business rules to validate data reporting through interfaces

Unit testing:
Unit test check the ETL procedures/mappings/jobs and reports developed

Integration testing:
Tests initial and incremental loading for the data warehouse Tests the rejected records and errors logs generation Validate count, source isolation, data quality and granularity

User testing:
Validate reports date, field level data, statistical analysis and data comparison

Data Warehouse Tools


Below some of the popular Data warehouse tools that QA professionals use to: Generate various reports, data models, create test data set, etc (These tools are different than test automation tool):
Ab Initio Cogno DQS Hyperion Informatica Oracle

You might also like