Professional Documents
Culture Documents
CDC Architecture
2
Information Management Software
Audit
Database
BI Appliance
TCP/IP
Message
Queue
3
Information Management Software
4
Information Management Software
Admin API Java based API Optional Java-based programming interface that you can use
interface to CDC to script operational configurations
commands
Command Line Command based Allows you to administer datastore and user accounts, as well
Interface operations as perform administration scripting independent of MC
5
Information Management Software
6
Information Management Software
7
Information Management Software
Target
Subscription 1
Subscription 1
Database
logs
Target
Subscription 3
Subscription 3
Transaction
queues
8
Information Management Software
9
Information Management Software
10
Information Management Software
11
Information Management Software
Heartbeat
Heartbeat message is sent on the control channel
System Parameters:
Timeout value if heartbeat not received from other side:
global_shutdown_after_no_heartbeat_response_minutes=10 mins
Frequency of heartbeat message sent: global_heartbeat_interval_seconds = 15 secs
The data incoming connection is usually idle. Firewall can potentially close this idle connection after it exceeds the idle
time period. To address this issue configure a keep alive msg on the data channel to keep the connection alive
TCP_KEEPALIVE_SECS configured in comms.ini
Heartbeat sent on the communications every TCP_KEEPALIVE_SECS to prevent firewall from closing sessions
Control Channel
Data Channel
12
Information Management Software
13
Information Management Software
Checkpoint:
Q2: When are transaction queues and staging store data persisted
to disk?
Q3: Describe the recoverability of ICDC and how the product can
recover and continue replication without data loss in the event of
database/network outages.
14
Information Management Software
Deploying CDC
Features and Configuration Details
15
Information Management Software
Hostname
Port - communication connection
Communication protocol (TCP/IP)
Optionally, you may need to know:
Datastore type Datastore
CDC version
16
Information Management Software
17
Information Management Software
Role
System
administrator
Able to newly create user or data Administrator
store Operator
Monitor
18
Information Management Software
Enabled/disable accounts
Lock/unlock accounts
Force password change
Set password to never expire
19
Information Management Software
Roles
System System Administrator Operator Monitor
administrator + administrator
Enable user
account and
data store
management
Access Manager
Available
perspective Configuration
Monitor
Create user or
data store
mapping
Change system
parameters
Available Setup subscription
operations
Start and end
replication
Reference event
log or statistics
20
Information Management Software
21
Information Management Software
22
Information Management Software
Checkpoint:
Q6: When does CDC enable and disable supplemental logging for
the table selected for mirroring?
23
Information Management Software
24
Information Management Software
Process multiple table mapping with one subscription Process one subscription and table mapping
Subscription Subscription
Table mapping Table mapping
Table mapping
A table B table
D table
TA table TB table
TD table
25
Information Management Software
Subscription
Defining table mapping for integrity-related tables to the same subscription will enable changed
applications to be updated in transaction units identical to the original transaction, thus maintaining
referential integrity. This mechanism will also maintain data consistency between target tables.
26
Information Management Software
TX1
27
Information Management Software
INSERT T2 (B)
INSERT T1 (A)
COMMIT
INSERT T2 (B)
COMMIT INSERT T1 (A) Transactions are
separated and their
COMMIT orders may be
switched.
One table is the minimum definition unit for subscription.
Resources are consumed in subscription units.
Read logs per subscription.
28
Information Management Software
Table4 Table4
Multi subscription
Source Target
Table1 Threads subB1 Threads Table1
Table3 Table3
subB3
Table4 Threads Threads Table4
29
Information Management Software
30
Information Management Software
LiveAudit
Product
ID Action Qty
Widget Make 1000
Widget Calibrate Test Eqpmt
Eqmt -
Widget Test Initiated 1000
Widget Test Result: PASS
FAIL 1000
Widget Bottle 1000
Widget Ship 1000
31
Information Management Software
33
Information Management Software
Address Table
Key Address City Province PostalCode
1 5 Main St. E. Kingston ON K7L 8T3
2 14 Pineridge Ave. Kelowna BC V3R 8Z9
34
Information Management Software
Consolidation Key
Merged Table
Key Name Address City Prov PostCode
1 John Grant 5 Main St. E. Kingston ON K7L 8T3
2 Julie Noor 14 Pineridge Ave. Kelowna BC V3R 8Z9
35
Information Management Software
Replication Log
Continuous
(Real Time)
Database Table
Refresh
(Full Copy)
36
Information Management Software
Replication Log
Continuous
(Real Time)
Database Table
Refresh
(Full Copy)
37
Information Management Software
Replication Log
Continuous
(Real Time)
Database Table
Refresh
(Full Copy)
38
Information Management Software
Status
Refresh
Copy all in the next replication.
Initial status is set as refresh even if the replication
method is mirroring.
Active
Delta copy in the next replication.
Parked
This mapping will be ignored in the next replication.
39
Information Management Software
Mapping of columns
Define mapping of columns between source and target.
Able to define conversion processes.
Columns will be mapped to default values if there is no mapping.
40
Information Management Software
A column name,
description, type and
length is provided
The expression is
calculated on the source
The result is replicated to
the target
41
Information Management Software
42
Information Management Software
43
Information Management Software
44
Information Management Software
45
Information Management Software
46
Information Management Software
47
Information Management Software
Conflict Resolution
48
Information Management Software
Conflict Detection
CDC detects the following conflicts as it replicates data from the
source to the target:
Inserting a row where the row's key already exists in the
subscription table. This violates the unique key constraint.
Updating a row where the row's key does not exist in the
subscription table.
Deleting a row where the row's key does not exist in the
subscription table.
50
Information Management Software
52
Information Management Software
Operation
Control of application operations and refresh operations
Settings such as disable Delete operations are possible.
Able to change option items depending on table mapping types.
Row-level operations
Set whether or not each operation is available.
Table-level operations
Alter the default operation for Insert, Update and Delete
Delete all (default)
Options are Do not delete and Delete selected rows
53
Information Management Software
1 4
ROW ROW
SELECTION LEVEL
54
Information Management Software
55
Information Management Software
BEGIN
CASE s$entry AFTER INSERT, UPDATE, DELETE, which will be inserted in another table
WHEN 4 THEN insert into TGT_PATTERN2_1_2 values (d$PK, a$ID, a$C3, a$C4);
WHEN 6 THEN update TGT_PATTERN2_1_2 set pk=d$pk, C3=a$C3, C4=a$C4 where id=b$id;
WHEN 8 THEN delete from TGT_PATTERN2_1_2 where id=b$id;
END CASE;
END SP_2_1_2;
/
56
Information Management Software
Checkpoint:
57
Information Management Software
QUESTIONS?
58