Table column analysis/profiling tool?

View previous topic View next topic Go down

Table column analysis/profiling tool?

Post  sman on Thu Dec 15, 2011 11:39 pm

Hello,

Is there a tool (preferably freeware) that can analyse tables and present results like below?

Table nameColumn namedata type and lengthMinimum valueMaximum ValueMinimum Length*Maximum Length*Distinct CountNull countNull percentageTop 3 valuesBottom 3 values
dbo.CustomerJRBTGRPvarchar(50)'Home''Joint Partnership'417273402.3%'Home', 'Public', 'Government''Private', 'Charity', 'No rebate'
dbo.CustomerJRBTLDNnumeric(10,2)0.024.67--67520.04%2.45, 2.23, 1.750.45,0.0, 4.10

I am in the process of doing a data analysis and profiling prior to developing a data mart. It helps me immensely if I can generate results like this for source database tables.

Could some experienced data analysts shed some light?

Thanks

sman

Posts : 22
Join date : 2011-01-30

View user profile

Back to top Go down

Check out Talend Data Quality Tool

Post  daveraffaele on Mon Dec 19, 2011 9:39 am

I think this is what you are looking for. It is easy to get up and running and is open source.

Search google for "Talend Data Quality". I am new to the forum so I can't send you the direct link.

- dave

daveraffaele

Posts : 1
Join date : 2011-12-19
Age : 44
Location : Boston, MA

View user profile http://www.daveraffaele.com

Back to top Go down

For Dave...

Post  elmorejr on Mon Dec 19, 2011 10:03 am

Until Dave's noob time passes...

http://www.talend.com/products-data-quality/matrix-data-quality.php

elmorejr

Posts : 25
Join date : 2011-10-20
Location : Columbus, Ohio, United States of America, Earth, Sol

View user profile

Back to top Go down

Re: Table column analysis/profiling tool?

Post  sman on Wed Dec 21, 2011 2:47 am

Thanks Dave and Elmorejr.

I've used Talend open profiler. I could not get it to do last two columns ("Top 3 values", "Bottom 3 values").

Also, is there a way to re-organise the Talend's output as I listed above?
I've noticed that the above format shows just enough information without taking too much space, which is handy when working with 50-100 tables.
The above info can be presented in MS Excel spreadsheets and further adhoc filtering can be done with Excel's drop down filters.



sman

Posts : 22
Join date : 2011-01-30

View user profile

Back to top Go down

Re: Table column analysis/profiling tool?

Post  Mike Honey on Wed Jan 11, 2012 11:57 pm

Hi Sman,

There's a set of SSRS reports that came with the Kimball Microsoft Data Warehouse Toolkit book - you can download them from here:
http://www.kimballgroup.com/html/booksMDWTtools.html

I'm referring to the Data profiling reports. Being SSRS, you could extend or modify the reports to suit your requirements.

There's also a Data Profiler tool that comes with SSIS.
http://technet.microsoft.com/en-us/library/bb895310.aspx
http://consultingblogs.emc.com/jamiethomson/archive/2008/03/02/ssis-data-profiling-task-part-1-introduction.aspx

Both are limited to SQL Server tables as the data source.

Good luck!
Mike
avatar
Mike Honey

Posts : 185
Join date : 2010-08-04
Location : Melbourne, Australia

View user profile http://www.mangasolutions.com

Back to top Go down

Re: Table column analysis/profiling tool?

Post  Sponsored content


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum