Professional Documents
Culture Documents
Integration
Best Practices for Migrating to
Oracle Data Integrator
CON9604
Julien Testut (@JulienTestut)
Principal Product Manager
Krishna Srinivas
Director - Business Analytics, Jade Global
Gurcan Orhan (@gurcan_orhan)
Senior Manager - Information Management, Deloitte
October, 2015
Copyright 2015, Oracle and/or its affiliates. All rights reserved. |
Agenda
1
Q&A
Agenda
1
Q&A
NoETL Engine
100% Native Data
Transformation
Non-invasive CDC,
Realtime streaming
data delivery
Data
Integrator
Metadata
Management
GoldenGate
Profile, Cleanse,
Match, and
Remediate Data
Big Data
Preparation
Prepare, Secure,
Enrich and Publish
Unstructured Data
Data
Quality
Data Service
Integrator
Federate Data
Across DBs, Services
and Applications
Copyright 2015, Oracle and/or its affiliates. All rights reserved. | Oracle Open World 2015
Agenda
1
Q&A
Cloud
Oracle Data Integrator
Apps
Database
High-performance, low
cost of ownership E-LT
architecture
Lightweight deployment
Extensible Knowledge
Modules
Big Data
Load
Transform
E-LT
Extract
Transform
Load
Transform
10
Declarative Design
Improved Developer Productivity For Faster Time to Solution
Easy and universal for designing simple to complex
mappings
Robust and Reusable: Create Mappings once for
any physical design
Quick to define and refactor maps, high degree of
automation
Extensible model for any data integration
mechanism
Benefits
Significantly reduces the learning curve
1
Define
What
You Want
2
Automatically
Generate
Dataflow
11
Knowledge Modules
Simpler Physical Design and Shorter Implementation Time
Pluggable Knowledge Modules Architecture
Reverse
Engineer
Metadata
Load from
Source to
Staging
Journalize
(CDC)
Check
Constraints
Integrate,
Transform
Data
Service
Spark
Hive
HBase
Pig
Sqoop
BICS
Oracle
Datapump
Oracle
DBLink
JMS
External
Tables
Teradata
SAP
Siebel
eBusiness
Suite
IBM DB2
Netezza
SCD
12
Extended Connectivity
Leverages Existing IT, Faster Implementation
Big Data: Spark, Hive, Pig, HBase, Sqoop &
Oozie
Cloud
Big Data
Applications
Databases
Legacy
13
14
15
Agenda
1
Q&A
16
www.jadeglobal.com
HEADQUARTERS
(San Jose, CA)
LOS ANGELES
ORANGE COUNTY
SAN DIEGO
PUNE
NOID
A
11 years
Enterprise IT
Services
Provider
Of Enterprise
Applications
Development
, Deployment
&
Outsourcing
Expertise
100+
Clients
Served
Worldwide
Over 300
Employees
Worldwide
6 Offices
Worldwide
3 Global
Delivery
Centers
Strategic
Partnership
s
Mappings
Mapplets
Migration Utility
Transformations
Packages &
Interfaces
Informatica Benchmarking
Complex Mapping Benchmark
2.
3.
No variable Ports
No unconnected lookup
No Parameters/Mapping
Variables
Mappings with no SQL overrides in
Source-Qualifier
Mappings with no SQL overrides in
Lookup
1.
2.
3.
4.
1.
2.
3.
4.
5.
Technology
Easy to Use
Convert INFA Mapping to ODI Packages &
Interfaces with click of a button
Desktop file (.exe) that launches the tool with
double-click
Single or Bulk INFA mapping conversion
Coverage
Informatica Custom Mappings
Informatica components: sources, targets, SDE & SIL mappings,
lookups, expressions, transformations, etc.
BI Apps: Category 1, Category 2, Category 3
DI: All INFA mappings: Simple: 100%, Medium: 70%, Complex: 50%
Automated
Conversion
Up to 90%
Reduced
Development
Time
Up to 50%
Cost Savings
Up to 50%
Automated Solution in the
Market
Contact Us
infatoodi.jadeglobal.com
Krishna Srinivas, Director- Business Analytics LOB, Jade Global
krishna.srinivas@jadeglobal.com
1-408-899-7240 (O)
Agenda
1
Q&A
24
WHO AM I ?
+20 years of IT experience.
+12 years of DWH experience.
+9 years of Oracle Data Integrator experience.
+7 years of Oracle Warehouse Builder experience.
Sybase Power Designer, ERwin Data Modeler, SQL Developer Data Modeler
OBIEE, Cognos, Microstrategy, Business Objects, Tableau, QlikView.
26
Deloitte Turkey
As a client and industry oriented professional service provider, we have been delivering high
quality and distinctive services for 29 years with more than 1.350 experienced professionals
through 5 different offices in Turkey.
stanbul
Office
Bursa
Office
Ankara
Office
zmir
Office
ukurova
Office
2015. For information, contact Deloitte Turkey, Member of Deloitte Touche Tohmatsu Limited.
27
Over
1.350 professionals
*Deloitte ranks number 1 among Big 4 on the Leading Companies in Turkey 2015 list published by Realta Consulting and Bloomberg Businessweek Turkey
2015. For information, contact Deloitte Turkey, Member of Deloitte Touche Tohmatsu Limited.
28
MY DEFINITION OF ODI
29
MIGRATION UTILITY
31
WHAT IS SUPPORTED
WHAT IS NOT SUPPORTED
BY
MIGRATION
UTILITY
classic mappings
tables
(columns, keys, indexes)
materialized views
sequences
(columns, keys,
indexes)
Constant
Splitter
View
Flat File
Aggregator
Mapping
Input
Parameter
29th October 2015 - CON9604 @ Oracle Open World 2015
Set
Expression
Code Template
mappings
views
locations
(columns, keys)
Materialized View
33
materialized view
(partitions,
attribute sets,
data rules)
OMB*Plus
scripts
29th October 2015 - CON9604 @ Oracle Open World 2015
custom PL/SQL
(procedure,
package,
and so on)
configuration details
(security,
user extensions,
transportable modules,
schedules/collections,
user folders)
streams
Anydata Cast
name and address
process flow
dimensional
modeling
metadata
table
(partitions
attribute sets,
data rules)
CDC configurations
data auditors
match-merge
34
MIGRATION UTILITY
PARAMETERS
ODI_MASTER_URL=<JDBC_URL>
ODI_MASTER_DRIVER=<JDBC_driver_name>
ODI_USERNAME=<user_name>
{jdbc:oracle:thin:@localhost:1521:mydb}
{oracle.jdbc.OracleDriver}
{SUPERVISOR}
ODI_WORK_REPOSITORY_NAME=<user_name>
{WORKREP1}
OWB_WORKSPACE_OWNER=<workspace_owner>
{WS1}
OWB_URL=<URL>
OWB_WORKSPACE_NAME=<workspace_name>
29th October 2015 - CON9604 @ Oracle Open World 2015
{localhost:1521:mydb}
{REP_1.WS1}
36
MIGRATION_REPORT_INCLUDE=<PASSED|FAILED|ALL>
MIGRATION_MODE=<FAST_CHECK|DRY_RUN|RUN>
MIGRATE_DEPENDENCIES=<TRUE|FALSE>
STOP_ON_ERROR=<TRUE|FALSE>
SPLIT_JOIN_FOR_ANSI_SYNTAX=<TRUE|FALSE>
MIGRATE_UNBOUND_OPERATOR=<TRUE|FALSE>
MIGRATION_OBJECTS=<objects {*}>
FLUSH_BATCH_SIZE=<number_of_mappings {50}>
29th October 2015 - CON9604 @ Oracle Open World 2015
37
./migration.log {detailed}
./migration.report {exclusion}
38
*******************************************************************************
* Oracle Warehouse Builder - Migration Utility - Log
* Created: 9/30/13 10:17 AM
39
DECISION TIME
40
Scheduling
Model Folders
User Folders
Packages
41
WE NEED
A CURE
42
43
ODISTARTOWBJOB PARAMETERS
44
I am the
ETL Admin
45
GO WITH AGILE
Divide OWB
Mappings into
Work Packages
Perform
migration for
WP#n
Change
OdiStartOwbJob
to ODI object
Correct errors,
recode if not
migrated & feasible
46
ADVANTAGES
Zero downtime in ETL jobs
Ongoing development for OWB or ODI
47
FINAL WORDS
http://gurcanorhan.wordpress.com
@gurcan_orhan
http://tr.linkedin.com/in/gurcanorhan
48
Deloitte refers to one or more of Deloitte Touche Tohmatsu Limited, a UK private company limited by guarantee (DTTL), its network of member firms, and
their related entities. DTTL and each of its member firms are legally separate and independent entities. DTTL (also referred to as Deloitte Global) does not
provide services to clients. Please see www.deloitte.com/about for a more detailed description of DTTL and its member firms.
Deloitte provides audit, consulting, financial advisory, risk management, tax and related services to public and private clients spanning multiple industries. With
a globally connected network of member firms in more than 150 countries and territories, Deloitte brings world-class capabilities and high-quality service to
clients, delivering the insights they need to address their most complex business challenges. Deloittes more than 210,000 professionals are committed to
becoming the standard of excellence.
This communication contains general information only, and none of Deloitte Touche Tohmatsu Limited, its member firms, or their related entities (collectively,
the Deloitte network) is, by means of this communication, rendering professional advice or services. No entity in the Deloitte network shall be responsible for
any loss whatsoever sustained by any person who relies on this communication
2015. For more information, contact Deloitte Touche Tohmatsu Limited.
49
Agenda
1
Q&A
50
Wednesday, Oct 28
Tuesday, Oct 27
Thursday, Oct 29
Integrating Big Data: Balancing the Data Warehouse and the Data
Reservoir [CON8768]
Zero-Downtime Upgrading Using Oracle GoldenGate [CON7892]
Best Practices for Migrating to Oracle Data Integrator [CON9604]
Oracle GoldenGate Performance Tuning and Monitoring [CON8736]
Cloud Data Quality: Lessons Learned from Oracles Journey to the
Sales Cloud [CON9595]
Oracle Enterprise Metadata Management and the Cloud [CON9612]
Developer Best Practices for Oracle Data Integrator Lifecycle
Management [CON9611]
Oracle Management Pack for Oracle GoldenGate Update [CON9716]
51
53
54
55