Startup ClearStory Data is set to launch a sophisticated data analytics service for business users.
The ClearStory service will let business users mash up data from corporate databases, Hadoop environments and public web sources, and then run it through a statistical analysis, said CEO and co-founder Sharmila Mulligan.
Investors in ClearStory, founded by former executives at Big Data management and analysis firm Aster Data, include Google Ventures, Andreessen Horowitz and Khosla Ventures.
Mulligan said the ClearStory technology is designed to enable non-technical users to relatively easily explore and analyse vast sets of public and private data.
Companies using the service won't have to have to hire workers with highly specialised skills to do Big Data analytics projects, she added. "There is a huge shortage of data experts and data scientists out there," said Mulligan, a former executive at Netscape, AOL and Aster Data.
The exploding corporate interest in big data analytics means that demand for such experts will far exceed supply, at least in the short term, she said.
ClearStory's service will provide non-technical business users a "self-driven data exploration" tool that can be used to track and explore Big Data, she said.
The ClearStory service also includes core technology that present data integrated multiple sources, such as internal databases and public data stores such as Datasift and Microsoft's Windows Azure Data Marketplace, in a manner that is easy to analyse and to visualise.
The ClearStory service will go directly to public data sources where it makes sense and also leverage public data marketplaces where needed, the company said.
Just like the semantic layer in business intelligence tools allow non-technical users to ask ad-hoc queries of corporate data, ClearStory's service will support such queries across heterogeneous data sets. Importantly, it will allow business users to do this data exploration with little to no help from IT personnel.
ClearStory's service is likely to be of immediate appeal to people who rely on data from outside sources, such as marketers and corporate sales teams, said Curt Monash, an analyst at Monash Research.
Marketers, for example, will be able to use the service to get demographic, lifestyle and census data about potential customers in a specific location, which they can then mesh with their own data Monash said.
The key for ClearStory is to ensure its technology can integrate and present data from disparate sources, Monash said. "The problem becomes more difficult when you are trying to include data from outside, over which you have less control," he said.
The planned ClearStory service comes amid booming interest in Big Data analytics as enterprises look for ways to derive value from huge volumes of data trapped in their repositories and being gathered daily via weblogs, clickstreams, social media, sensors, supply chains and logistics tools.
Many analysts say the trend is driving huge demand for data scientists and data analysts.
In a report last May , McKinsey Global Institute predicted that the US will need between 140,000 to 190,000 more "deep analytical" professionals and about 1.5 million more "data savvy" managers to address Big Data needs over the next few years.
McKinsey concluded that a company's ability to mine Big Data will soon become a key competitive weapon in industries like retail and healthcare.