ETL Replacement Suggestions Needed

View previous topic View next topic Go down

ETL Replacement Suggestions Needed

Post  Traci Marcero on Wed Apr 21, 2010 5:02 pm

Greetings,
I’ve just begun the process of researching a fitting ETL tool that will allow for a simplistic user friendly source extraction to staging configuration for minimal licensing costs. We are in the works of decommissioning a very old version of DataMirror (4.3) that pumps data from our i5 system into a SQL Server 2000 data warehouse. The reason for the decommission is that we no longer hold licensing for the DataMirror product, thus we are not supported on it. Additionally, management does not want to spend the exuberant cost that is required for the licensing.
We have a small 80GB data warehouse that comprises of stage, fact, and dimensional tables as well as some historical tables. We hold 2 full years plus current years’ data. The plan is to upgrade from SQL Server 2000 to 2005 in conjunction with the new ETL.
Our current ETL is installed on both our i5 (Host) and SQL server (Client). DataMirrror does Transformation Server Mapping and on the i5 contains the Source Administration piece that consists of three steps: Defining a target system (SQL Server), selecting the source tables (i5 tables) that you want to replicate to the target system, and describing these tables to the target system by means of a secured connection made between the Host and Client. It also allows one to select/exclude specific rows and columns in a table and define derived columns to support joins. DataMirror on the SQL server end (Client end) registers and connects to an ODBC data source (SQL Server data warehouse ), then allows one to ‘Assign’ the ‘Target’ tables (SQL Server tables) to the ‘Source’ tables (i5 tables), that were previously described from the i5 to the SQL Server. This will complete the connection and assignment process needed for the refreshment of data. We refresh our data once per week.
My plan was to start looking into Microsoft’s SQL Server Integration Services as a replacement of DataMirror. I have very little experience using the product and have only created a few basic packages in the past. This will be my first endeavor in the implementation of a full blown ETL project. I’m hardly qualified, but the job is up to me to figure out as we cannot hire contractors at this time. I’m doing my best in trying to convince the boss to send me to the ‘ETL Architecture in Depth’ seminar that’s upcoming in May, however I’m hoping to have a solid plan in place before then, or at least know what product I will be utilizing for the ETL.
Long story short, I would appreciate any feedback or thoughts regarding what might be a good fit as an ETL replacement. After reading my description of how we are currently handling our ETL, does a more suiting ETL utility come to mind that I might research? We currently hold licensing for MS SSIS which was my original ETL choice to start looking at, especially since money was an issue.
Again, any suggestions would be greatly appreciated!
Regards,
Traci Marcero
avatar
Traci Marcero

Posts : 2
Join date : 2010-04-13
Age : 38
Location : Michigan

View user profile

Back to top Go down

Re: ETL Replacement Suggestions Needed

Post  ngalemmo on Wed Apr 21, 2010 5:34 pm

SSIS is not a bad tool and it's free, so the price is right.

There are open source options, such as Kettle, but since you are a SQL Server shop, there really isn't any particular reason to not use SSIS. Just make sure you are on the most current version... it is much improved over the pre-2005 stuff.
avatar
ngalemmo

Posts : 3000
Join date : 2009-05-15
Location : Los Angeles

View user profile http://aginity.com

Back to top Go down

Re: ETL Replacement Suggestions Needed

Post  Traci Marcero on Thu Apr 22, 2010 9:25 am

Ngalemmo,

Thank you for taking the time to analyze my choices. I will strongly consider SSIS and I'll be certain to upgrade to the latest and greatest when doing so.
I look forward to using you as a knowledgeable resource as I will certainly need it in my upcoming project.

Thanks Again,

Traci M.
avatar
Traci Marcero

Posts : 2
Join date : 2010-04-13
Age : 38
Location : Michigan

View user profile

Back to top Go down

Re: ETL Replacement Suggestions Needed

Post  ngalemmo on Thu Apr 22, 2010 12:22 pm

Good luck.
avatar
ngalemmo

Posts : 3000
Join date : 2009-05-15
Location : Los Angeles

View user profile http://aginity.com

Back to top Go down

Re: ETL Replacement Suggestions Needed

Post  Sponsored content


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum