Notes on Hadoop adoption and trends
With Strata/Hadoop World being next week, there is much Hadoop discussion. One theme of the season is BI over Hadoop. I have at least 5 clients claiming they’re uniquely positioned to support that (most of whom partner with a 6th client, Tableau); the first 2 whose offerings I’ve actually written about are Teradata Aster and Hadapt. More generally, I’m hearing “Using Hadoop is hard; we’re here to make it easier for you.”
If enterprises aren’t yet happily running business intelligence against Hadoop, what are they doing with it instead? I took the opportunity to ask Cloudera, whose answers didn’t contradict anything I’m hearing elsewhere. As Cloudera tells it (approximately — this part of the conversation* was rushed):
- Industry segments include:
- Web, media, telecom, etc. (duh)
- Banking (in which I think they conflate investment/trading and commercial)
- Federal
- Retail
- Marketing services
- Insurance (coming on now)
- Bio/pharma (ditto)
- Cloudera’s basic split of use cases, in their lingo, is:
- “Data processing” (which is like ETL) — 40% or so of uses
- “Advanced analytics” — 40% or so
- “Real-time” (which is largely HBase) — 20% or so
- Notwithstanding that 20% figure, a majority of Cloudera clients seem to make some use of HBase.
- Application categories of note include but aren’t limited to:
- Anti-fraud — this seems to be driving insurance adoption, along with its more established footholds in trading, credit-granting, etc.
- Recommendation engines, in various obvious sectors
- Market basket analysis — I didn’t get much detail here
- Gene sequencing data analysis — this seems to be driving bio/pharma adoption
Anyhow, Cloudera says that its users typically get into true production within a few quarters after signing up — because if they were just doing utter experimentation, they’d be using a totally free version of Hadoop.
*This was the same conversation in which I asked Cloudera about Hadoop hardware trends.
And finally, while I’m jumping around here — last April I wrote:
If MapR still has momentum, nobody I talked with has noticed.
That is no longer accurate. Hadapt and another of my clients are partnering with MapR, in both cases because of their customers who are MapR users.
Comments
5 Responses to “Notes on Hadoop adoption and trends”
Leave a Reply
[…] I wrote last week that I have at least 5 clients claiming they’re uniquely positioned to support BI over Hadoop […]
[…] are many other solutions you could try. Indeed, Cirro is one of the examples I had in mind when I wrote last week that: One theme of the season is BI over Hadoop. I have at least 5 clients claiming […]
[…] When I relayed Cloudera’s comments on Hadoop adoption, I left out a couple of categories. One Cloudera called “mobile”; when I probed, that […]
[…] and that’s exactly what I had with Cloudera last week. We touched on hardware and general adoption, but much of the conversation was about Cloudera Impala, announced today. Like Hive, Impala turns […]
[…] still uses a figure of 20% of its customers being […]