“Big Data” is the buzzword bingo winner for 2011. It does have considerable merit. It is not hyped to the level of the cloud, nothing could be; but it still pushed by vendors of all capabilities as an alternative next big thing. Strip away the hype and successful implementation of big data outcomes and solutions will enable organisations to dramatically improve value obtained from their data and information. Furthermore, the ability to manage structured and unstructured data in real time is going to provide competitive differentiation.
IBM, HP SAP, Oracle and most DW and related analytics vendors such as Informatica, Microsoft in the SME space are all developing sound and relevant solutions.
Organisations must have an integrated data management strategy for to maximise the value they gain. Failure to do this will not so much result in a Garbage In- Garbage out approach but will reduce the efficiency of limited investment dollars none the less. A key way in which to improve data based budgets is through data de-duplication.
Data de-duplication was a buzzword bingo winner in 2009. It has been largely forgotten in the last 12-24 months with the hype of cloud and now big data. However, studies indicate that organisations are saving up to 100 versions of each email that enters their system. Clearly this is ridiculous and provides unnecessary cost and infrastructure pressure on storage demands for organisations. We believe that organisations looking at big data solutions must review overall storage requirements to minimise the overall demand for growth in data storage whether used for analytics or not. Hopefully for the CIO money spent on “Big Data” solutions can be saved with a delay in storage hardware expenditure.