Change Data Capture(CDC) when running Batch jobs

View previous topic View next topic Go down

Change Data Capture(CDC) when running Batch jobs

Post  tosan.tidm on Thu Apr 17, 2014 9:40 am

Hi
As we know, when the CDC is running any changes in the data will be recorded. Also we know batch jobs(with many transactions) can executed several times a day and caused many changes in data(for example, in banking industry ).
My question is that when changes are recorded if a batch job is executed, is this creates a lot of false alarms?
The CDC must be switched off during executing batch jobs??????
How can we distinguish between these two(changed arise from batch job (that are normal changes) and other changes(that may be suspicious))???

Thanks

tosan.tidm

Posts : 1
Join date : 2014-04-17

View user profile

Back to top Go down

Re: Change Data Capture(CDC) when running Batch jobs

Post  nick_white on Wed Apr 23, 2014 2:54 am

1. Configure your CDC process so it only captures data changes you are interested in
2. The files generated by the CDC process contain only potential changes - you can still implement logic in your ETL process to decide whether or not to updates your DW with a record in a CDC file/table

nick_white

Posts : 366
Join date : 2014-01-06
Location : London

View user profile

Back to top Go down

View previous topic View next topic Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum