Is it the end of the Relational Dimensional Data Warehouse ?

View previous topic View next topic Go down

Is it the end of the Relational Dimensional Data Warehouse ?

Post  davfaibish on Mon Jun 11, 2012 6:35 am

With all the technologies of cubes, columnar databases, big data, advanced semantic layers, self-service BI and tools like Power Pivot and Power View from Microsoft for example, is it still relevant to build a traditional relational data warehouse? A Kimball like with facts, dimensions (surrogate keys, Slow Changing Dimensions and etc…)

davfaibish

Posts : 1
Join date : 2012-06-11

View user profile

Back to top Go down

Re: Is it the end of the Relational Dimensional Data Warehouse ?

Post  BoxesAndLines on Mon Jun 11, 2012 12:17 pm

Don't believe the marketing hype. Dimensional warehouses will be around for years to come.
avatar
BoxesAndLines

Posts : 1212
Join date : 2009-02-03
Location : USA

View user profile

Back to top Go down

Re: Is it the end of the Relational Dimensional Data Warehouse ?

Post  ngalemmo on Mon Jun 11, 2012 4:39 pm

Cubes have limited capacity.

Columnar databases are relational.

Structured big data is handled in relational environments (MPP systems). Unstructured data is sometimes. You should remember that the whole point of Hadoop is to address MPP for those who don't have an MPP database system. It is not a replacement, and a very poor substitute when dealing with structured data. It is also very inefficient both in personnel and hardware.

Semantic layers (and 'self service' tools) have, and will continue to coexist with dimensional DW implementations. They are complementary technologies.



avatar
ngalemmo

Posts : 3000
Join date : 2009-05-15
Location : Los Angeles

View user profile http://aginity.com

Back to top Go down

Re: Is it the end of the Relational Dimensional Data Warehouse ?

Post  John Simon on Tue Jun 12, 2012 1:19 am

It's definitely not the end.

In-memory solutions actually work better against a star schema than a snow-flake or 3NF solution.
Storing your entire data warehouse in-memory is also not sustainable for large (multi-terabyte) data warehouses.

In-memory has it's place, but obviously has a cost in terms of hardware. Yahoo have a 24Tb SSAS cube (last I heard, probably bigger now) - imagine how expensive that would be to put into memory!


John Simon

Posts : 186
Join date : 2009-05-29
Location : Melbourne, Australia

View user profile http://jsimonbi.wordpress.com

Back to top Go down

Re: Is it the end of the Relational Dimensional Data Warehouse ?

Post  Sponsored content


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum