Story image

Ovum: Big questions for those looking for answers in big data

14 Nov 2016

“Some complex systems, such as the weather, are oblivious to our predictions. The process of human development, in contrast, reacts to them. Indeed, the better our forecasts, the more reactions they engender.”

These observations of Professor Yuval Noah Harari, one of the outgoing American president’s favoured authors (Sapiens: A Brief History of Humankind), are particularly apposite right now as pollsters, experts, and analysts in various parts of the world examine their election forecasts and models.

At a time when organisations and nation states have more data and more compute power than ever before, the notion of “the more we know, the less we can predict” should provoke “big questions” for those working with “big data.”

The future is disobedient: the more we know, the less we can predict

Analytics, as part of the broader topic of exploiting data for business value, remains one of the most widely discussed topics in the enterprise applications software market.

Given this continued surge in demand, vendors are eagerly looking for new ways to offer business analytics and market insights through a broader range of channels, be it self-service analytics, embedded business intelligence, cloud analytics, big data analytics, or the infusion of predictive analytics into real-time applications.

And as if this were not enough, collaboration, productivity, and business application vendors are introducing rules engines, machine learning technologies, natural language processing systems, bots, and cognitive capabilities to their products too.

Power users and early adopters are already being drawn to these new capabilities, combining them in various ways to make sense of big data, but the “law of unintended consequences” may yet present users with some unexpected outcomes, especially where human-centric data is concerned.

The notion of “setting information free” and providing analytics to the entire workforce is of course laudable, and one that this analyst espouses. But business leaders and CIOs must be mindful of its potential impact.

In the words of Professor Harari from his latest book, Homo Deus: “Knowledge that does not change behaviour is useless. But knowledge that changes behaviour quickly loses its relevance. The more data we have and the better we understand history, the faster history alters its course, and the faster our knowledge becomes outdated.”

This paradox is one that few vendors and data scientists seem to openly acknowledge, and even fewer CIOs have considered. However, one thing is apparent: the future is still “disobedient.” No amount of data and compute power can accurately forecast the outcome of events that are dictated by human emotions, sentiments, and feelings. But for how long?

Article by Richard Edwards, Ovum principal analyst, enterprise ICT.

Interview: What you can expect from LogicMonitor's APAC expansion
LogicMonitor is a provider of SaaS-based infrastructure monitoring software for hybrid IT environments – and it has big plans to shake up Asia Pacific this year.
Cryptomining apps discovered on Microsoft’s app store
It is believed that the eight apps were likely developed by the same person or group.
A multi-cloud approach - what is in it for me?
OVH CEO Michel Paulin explains the benefits of a multi-cloud approach to an organisations digitalisation and what to consider before implementation.
Why the IT service integration market is becoming highly automated
"The SIAM market is not large, but it is one of the fundamental pillars of every digital transformation strategy."
Intel and Rakuten partner to address 5G network gap
“We believe this full end-to-end virtualised network will help us to shift away from reliance on dedicated hardware and legacy infrastructure.”
Spoofs, forgeries, and impersonations plague inboxes
It pays to double check any email that lands in your inbox, because phishing attacks are so advanced that they can now literally originate from a genuine sender’s account – but those emails are far from genuine.
HCL and IBM collaborate to encourage global hybrid cloud uptake
HCL announced a collaboration with IBM designed to help advance the hybrid cloud journeys of organisations worldwide. 
Robots to the fore – Key insights for New Zealand Business into RPA in 2019
From making artificial intelligence a business reality to closer ties to human colleagues, robotic process automation is gearing up for a strong 2019.