Internet Giants: The Impact of Google, Amazon, and Facebook
In this video, you’ll learn about the contribution companies like Google have made to the development of modern data platforms.
Did you ever consider that you live in a world where Google -- and by extension other internet giants -- are sending you messages from the future? There’s no doubting the impact research from the likes of Google, Amazon, Facebook and other internet giants have had on the evolution of modern data platforms. These organizations wanted to do things with data that just couldn’t be accomplished with legacy data platforms. So… they created their own. 451 Research projects revenue from Hadoop and NoSQL to grow from $1B to $5B each by 2020, while it expects traditional relational and nonrelational database revenue to only grow by around 10 percent.
So, if we're talking about modern data platforms, we have to recognize the impact that organizations like Google, Amazon and Facebook and other internet giants have had in driving the emergence of these new data platforms.
Messages from the Future
Doug Cutting, the co-creator of Hadoop, described it well when he talked about the fact that we're fortunate to live in a world where Google sends us messages from the future. And he was talking specifically about Google Spanner, but we see that much of the research that has shaped the emergence of Hadoop and NoSQL has actually come from the internet giants - so, the Google File System paper published in 2003, and for example the Google Big Table paper in 2006 or Amazon Dynamo paper in 2007, which have been really fundamental in driving the emergence of NoSQL.
Legacy Data Platforms Could Not Deliver “SPRAIN”
Now, what is interesting about this is that these organizations, you know, didn't create new data platforms for fun. They did it because they saw that the existing data platforms in the market couldn't deliver what they were looking for. And the things that we see that caused that can be summed up with the term sprain. So, a sprain is when something is stretched beyond its normal capacity, and we see that in terms of what's happening with relational databases.
And these companies were looking for additional Scalability, Performance, Relaxed Consistency, Availability, Intricacy and Necessity, which obviously spells out SPRAIN. That last one necessity is the key point here.
So, Werner Vogel, who's the Amazon CTO, has talked about the fact that, you know, they couldn't bet their company on other companies, specifically the relational database vendors, building what they needed.
Strong Growth in Adoption for Modern Data Platforms
But, it's not just the internet giants that are now benefiting from Hadoop and NoSQL. So, we see distributed data processing framework revenue, including Hadoop and NoSQL revenue, growing from roughly the same amount, just over $1 billion in 2016, to over $5 billion for each in 2021. So, that's growth of 33 percent for Hadoop and distributed data processing frameworks and about 35 percent for NoSQL.
To put that in context, we see growth of just 7 percent for analytic databases in the same timeframe, 9 percent from traditional non-relational databases and 10 percent for relational databases. So, even though, these technologies were inspired by the internet giants, we see ordinary traditional organizations rapidly adopting them in order to enjoy the same benefits.