Few days back, I came across an article By Hyuon Park of Amalgam Insights, which clearly explains what has happened to Big Data in last 13 years. It also talks about what is replacing the trend. I wanted to share the article with my readers. Please find it here .
Here is a snippet of the article.
RIP Era of Big Data
April 1, 2006 – June 5, 2019
Key Message from Article:
The Era of Big Data is coming to an end as the focus shifts from how we collect data to processing that data in real-time. Big Data is now a business asset supporting the next eras of multi-cloud support, machine learning, and real-time analytics. The Era of Big Data passed away on June 5, 2019, with the announcement of Tom Reilly’s upcoming resignation from Cloudera and subsequent market capitalization drop. Coupled with MapR’s recent announcement intending to shut down in late June, which will be dependent on whether MapR can find a buyer to continue operations, June of 2019 accentuated that the initial Era of Hadoop-driven Big Data has come to an end.
Big Data will be remembered for its role in enabling the beginning of social media dominance, its role in fundamentally changing the mindset of enterprises in working with multiple orders of magnitude increases in data volume, and in clarifying the value of analytic data, data quality, and data governance for the ongoing valuation of data as an enterprise asset.
So, the era of Big Data has come to an end. But in the process, Big Data itself has become a core aspect of IT and brought into being a new set of Eras, each with its bright future. Companies that have invested in Big Data should see these investments as an important foundation for their future as real-time, augmented, and interactive engagement companies. As the Era of Big Data comes to an end, we are now ready to use the entirety of Big Data as a business asset, not just hype, to support job-based context, machine learning, and real-time interaction.
My Notes:
Let us not forget merger of Cloudera and Hortonworks. Cloudera also recently announced adoption of full open source software following RedHat model. This became MUST HAVE strategy for them to stay relevant. MapR was closed source because of their unique file system whose real value now emanates in S3 of AWS , GCS of Google Cloud and Blob Storage/ADLS of Azure. Value has tilted to multi-cloud vendors which provide general file system with every thing for Big Data as a service.
I urge all Big Data lovers/users/entrepreneurs to look at emerging multi cloud environment where Big Data applications ( Machine learning, AI, Vision, Discovery, Augmented Reality, Bots, IoT etc. ) are offered as consumable services in metered manner. This trend will continue to thrive and keep us busy for years to come. Personally, I have enjoyed own cloud journey. I am glad to let my readers know what I am an Microsoft Certified Azure Solutions Architect Expert. It covers many areas of Azure Cloud. Please find details about the certification here.