Gartner research shows that more than half of companies have no current plans to adopt Hadoop-based data analytics, despite large firms like British Airways and Marks & Spencer being big fans of the technology.
Gartner's 2015 Hadoop Adoption Study has found that investment remains “tentative” in the face of “sizable challenges around business value and skills”. The survey, which was conducted in February and March 2015 among 284 Gartner Research Circle members, found that only 125 respondents had already invested in Hadoop or had plans to do so within the next two years.
The Gartner Research Circle is a Gartner-managed panel composed of IT and business leaders. "Despite considerable hype and reported successes for early adopters, 54 percent of survey respondents report no plans to invest at this time, while only 18 percent have plans to invest in Hadoop over the next two years," said Nick Heudecker, an analyst at Gartner.
"Furthermore,” he said, “the early adopters don't appear to be championing for substantial Hadoop adoption over the next 24 months; in fact, there are fewer who plan to begin in the next two years than already have."
Hadoop is an open source framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage.
According to the Gartner research, only 26 percent of respondents claim to be either deploying, piloting or experimenting with Hadoop, while 11 percent plan to invest within 12 months and seven percent are planning investment in 24 months.
Responses pointed to two interesting reasons for the lack of intent, said the analyst. First, several responded that Hadoop was simply “not a priority”. The second was that Hadoop was “overkill” for the problems the business faced, “implying the opportunity costs of implementing Hadoop were too high relative to the expected benefit”, said Gartner.
Gartner analyst Merv Adrian said: "Future demand for Hadoop looks fairly anaemic over at least the next 24 months. Moreover, the lack of near-term plans for Hadoop adoption suggest that despite continuing enthusiasm for the big data phenomenon, demand for Hadoop specifically is not accelerating.
"The best hope for revenue growth for providers would appear to be in moving to larger deployments within their existing customer base."
Skills gaps were a major adoption inhibitor for 57 percent of respondents, while figuring out how to get value from Hadoop was cited by 49 percent. “The absence of skills has long been a key blocker,” the analyst said. “Tooling vendors claim their products also address the skills gap. While tools are improving, they primarily support highly skilled users rather than elevate the skills already available in most enterprises,” Gartner said.
Gartner estimates it will take “two to three years” for the Hadoop skills challenge to be addressed.