The firm synonymous with the catchy “compare the meerkat.com” jingle has signed a deal with WANdisco to bridge its disparate Hadoop clusters, distributions and storage systems across its international datacentres.
The move is part of comparethemarket.com’s wider big data strategy to learn more about customer behaviour online in a bid to boost sales and offer better user experience.
WANdisco Fusion offers “agnostic architecture” prevents vendor lock-in. The firm is part of the Open Data Platform (ODP), a consortium of major Hadoop distributors who have joined forces to create products based on one version of Hadoop to ease interoperability challenges across industry.
IBM, Hortonworks, SAP, Pivotal and Wandisco, amongst others, will distribute or work with a standardised version of Hadoop 2.6.
However, the standardisation of a Hadoop kernel has raised questions over competitiveness and possible lock-in for customers as not all vendors have joined the consortium.
WANdisco’s co-founder and CEO David Richards told ComputerworldUK that this wasn’t the case.
“Not at all – quite the opposite in fact. By promoting coordination and collaboration among vendors, we hope to provide users with increased flexibility to choose what they need.
“We’re part of the ODP and our latest products have been designed with the specific aim of preventing vendor lock-in.
“The ODP embodies the spirit of an open-source community and is our attempt to ensure this isn’t lost as various parties attempt to monopolise, which will only be bad news in the long run.
“As any good economist knows, one of the first things to die in a world without competition is innovation.”
Competitors MapR and Cloudera have declined invitations to join the ODP, as to do so would mean certifying Hadoop management tools that directly compete with their own products.
Richards added: “New vendors are joining by the week and the fact that end users – such as Verizon – are on board only signals that the need to de-mystify the industry is very real.
“The real question is why anyone working in open source wouldn’t buy into the ODP’s ethos. Why would someone turn down the invitation?”