Duplicates

View previous topic View next topic Go down

Duplicates

Post  braken on Tue Nov 27, 2012 2:55 pm

In the Load of the ETL, I know there may be duplicates that may go against the constraint. Do you normally have to do something to make sure those don't even get inserted? To me, it seems when that error happens, I want it to not insert under those circumstances but I also want it to just continue. Any thoughts? (Maybe this is something that ETL software handles)

braken

Posts : 2
Join date : 2012-11-27

View user profile

Back to top Go down

Re: Duplicates

Post  John Simon on Sat Dec 01, 2012 8:30 pm

I wouldn't have any constraints on my tables in the first place as this will significantly impact the ETL processing times.
The ETL job should ensure referential integrity through the generation of surrogate keys and resolve issues such as duplicates.

John Simon

Posts : 186
Join date : 2009-05-29
Location : Melbourne, Australia

View user profile http://jsimonbi.wordpress.com

Back to top Go down

View previous topic View next topic Back to top


 
Permissions in this forum:
You cannot reply to topics in this forum