Kimball Forum
Would you like to react to this message? Create an account in a few clicks or log in to continue.

Duplicates

2 posters

Go down

Duplicates Empty Duplicates

Post  braken Tue Nov 27, 2012 2:55 pm

In the Load of the ETL, I know there may be duplicates that may go against the constraint. Do you normally have to do something to make sure those don't even get inserted? To me, it seems when that error happens, I want it to not insert under those circumstances but I also want it to just continue. Any thoughts? (Maybe this is something that ETL software handles)

braken

Posts : 2
Join date : 2012-11-27

Back to top Go down

Duplicates Empty Re: Duplicates

Post  John Simon Sat Dec 01, 2012 8:30 pm

I wouldn't have any constraints on my tables in the first place as this will significantly impact the ETL processing times.
The ETL job should ensure referential integrity through the generation of surrogate keys and resolve issues such as duplicates.

John Simon

Posts : 186
Join date : 2009-05-29
Location : Melbourne, Australia

http://jsimonbi.wordpress.com

Back to top Go down

Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum