IT Brief New Zealand logo
Technology news for New Zealand's largest enterprises
Story image

How the evolution of data will virtually transform our businesses - Denodo

By Contributor
Mon 2 Sep 2019
FYI, this story is more than a year old

Article by Denodo Technologies CEO and founder Angel Vina

As business needs have shifted and come to rely on data as the single biggest asset driving successful outcomes, the data landscape has shifted as well.

Tracing back through the evolution of data proves to be incisive – it has become evident that our attitude to data, and how it serves us, has changed dramatically.

In the 1980s, when all data was stored in a single database, our concept of data and its uses was based on the idea of a central repository.

From there, the single database evolved into data warehouses, which allowed data to be ingested and stored according to its source and category, but in doing so it became siloed, and ultimately proved to be inefficient.

Enterprises later began to realise the power of analytics, and early-generation analytics programs were written to sit above the data layer and derive business value from it.

The data warehouse evolved into mini data warehouses to avoid bottlenecks created from having one mass repository, and then evolved again into the enterprise data warehouse, with integrations and layers of analytic software built into them.

By the mid-2000s, Hadoop changed things up once more, building code into the data itself, so that it became more fluid and easily accessible.

It was also in this period where we witnessed a surge in the number of disparate data sources that an enterprise had at its disposal, with the rise of social media and mobile applications.

This brought a whole lot more data into the business, much of which was unstructured rather than structured.

However, companies required an unobstructed view of both data sets to maximise the benefits and effectiveness of the intelligence within their enterprise.

Storing all data in one place was no longer an effective strategy, as it became hard to access and even harder to analyse effectively.

Deriving true business value from both structured and unstructured data meant it was not stored in a single place, introducing a host of other inefficiencies.

One source of data for finance, for example, would need its own data warehouse, as would sales, as would marketing.

Much of that data would be common across several departments, so the governance of data became much more complicated as well.

Throughout this brief history of big data storage, one theme remains constant — the need to access data quickly and effectively.

This has always been the central concern for an enterprise needing fast, efficient access to data for generating reports, predicting consumer behaviours, employing predictive maintenance on key assets, and enabling strategic decision-making.

The next phase of data access in the enterprise is to move to a scenario where data resides in source systems but is accessed virtually from one single platform.

Just as virtualisation was a highly effective model for moving information and apps into the cloud, data virtualisation will be crucial in enabling the next stage of the data evolution.

The logical approach to accessing different types of data across disparate sources and systems has been to bring it together into one single pool rather than store it in one repository.

Yet data virtualisation can allow enterprises to connect to this pool wherever it happens to be, even across distributed systems, without having to physically bring it together into the central repository.

With data divided into structured and unstructured forms and streaming in from across disparate systems, it would be almost impossible to process without automation.

Currently, enterprises generally process data at great speed, even as it is collected.

However more than raw data, people require information in their hands in real-time, or at least as close to real-time as is possible.

To get from data to information, there is a significant need to process data and convert it into intelligence and business insights even as more data is streaming onto the business.

Now that artificial intelligence and machine learning are becoming fundamental parts of business functionality, automating the value derived from data makes a lot of sense to speed up processes and remove inefficiencies.

Beyond this, data virtualisation creates intelligence through the metadata layer, which allows businesses to understand and relate to changes occurring in source systems and have that aggregated data available to end-users.

Virtualisation can also provide information on the lineage of data, indicating how it has transformed over time, where it has come from, how it has associated with other data sources over the life of its journey.

This, in turn, can provide deep insights into core business functions such as sales and marketing — mapping and preventing customer churn, indicating what products they may have purchased in the past, whether they have warranties for that product, or if they have upgraded services at any stage as a few use cases.

Automated, virtualised data also catalogues this information across all systems, documenting changes so that the organisation does not have to manually reconcile it.

This can provide users with insights into data literally as events occur in all areas of the business.

Hot ticket items suddenly trending online? Retailers can set an alert, mark up prices, or order more stock in real-time, reacting to what business intelligence reveals in real-time.

The data landscape has changed, and it is clear that the virtualisation of data is the next stage of its evolutionary journey.

We’ve moved beyond the physical movement of data, reducing the costs associated with that process, of storing it in one large repository.

This equates to reduced overheads, coupled with the savings in the time afforded by a more efficient system.

Combine that with a better, more holistic view of data, and the ability to assimilate information in real-time as it streams into the organisation, and the business benefits become obvious.

Virtualisation of data is the next vital step towards running a faster, more efficient and cost-effective enterprise.

Related stories
Top stories
Story image
What every CISO must answer to enable a best-in-class security operations program
It has been widely reported recently that South Australian government employees have been the victims of a cyberattack.
Story image
Identity and Access Management
The post-pandemic workforce requires secure IAM capabilities
HID Global discusses what identity and access management means for organisations in today's convoluted digital world.
Story image
Microsoft previews Power Platform website design offering
Microsoft has announced the preview of Power Pages, the fifth product in its Power Platform family, designed for low-code makers and professional developers.
Story image
The paradox of change, and how to get around it
The business decision to technologically transform should not come from an IT department but from the business itself.
Story image
Digital Marketing
Getty Images delves into the world of NFTs with Candy Digital
Getty Images and Candy Digital, the next-generation digital collectible company, have announced a new multi-year partnership agreement.
Story image
Skills shortages hold orgs back from capitalising on cloud 2.0
Organisations are becoming more comfortable with sophisticated 'cloud 2.0' technologies, even as they confront difficulties in hiring and retaining IT talent.
Story image
Sysdig unveils new Kubernetes troubleshooting and cloud innovations
Sysdig has introduced two new innovations that look to help bolster cloud services and simplify Kubernetes troubleshooting.
Story image
MEC spending for private cellular networks to reach $5.8b
A new ABI Research report finds the revenue for Multi Access Edge Compute (MEC) deployments for private cellular networks will reach USD$5.8 billion by 2030.
Story image
Infosec unveils role-guided cybersecurity training roadmaps
Infosec Skills Roles maps hands-on training and certifications to the 12 most in-demand cybersecurity roles to maximise training efficiency.
Story image
BYOD / Bring Your Own Device
How zero trust can lead the battle against ransomware
SecOps teams champion a zero trust strategy to support the fight against the escalating risk of cybercrime and help monitor threat actors across a network.
Story image
Digital Transformation
Harnessing digital innovations to maximise loyalty programmes and improve CX
When it comes to the retail sector, merchants have never had access to so many different client touchpoints and data to understand their customers better.
Story image
New Relic
New Relic launches vulnerability management platform
New Relic has introduced New Relic Vulnerability Management to help organisations find and address security risks faster and with greater precision.
Story image
Comcast to use ThreatQuotient for cybersecurity operations
Comcast, the parent company of NBC Universal and SKY Group, has chosen ThreatQ Platform and ThreatQ Investigations to meet their cybersecurity needs.
Story image
Equinix announces milestones on sustainability commitments
Equinix has released its 2021 Sustainability Report which outlines progress, innovation and accomplishments on key ESG commitments.
Story image
Aligned Data Centers increases sustainability-linked loan
Aligned Data Centers has increased its sustainability-linked loan from $375 million to $1.75 billion to speed up the next phase of its strategic growth.
Story image
Artificial Intelligence
Frost & Sullivan recognises Genesys as leader in new reports
Frost & Sullivan has recognised Genesys as a leader in the cloud contact centre market for its robust cloud and digital capabilities.
Story image
Accenture - a collective security approach a driving factor for cyber resilience
With the approaching Davos World Economic Forum upon us, it is even more imperative to discuss the impact of cybersecurity on business operations leading into the future.
Story image
Ponemon Institute
Email revealed to be riskiest channel for data loss
More than half (60%) of organisations experienced data loss or exfiltration caused by an employee mistake on email in the last 12 months.
Story image
Women in Technology
Huawei webinar emphasises the importance of women in tech
Industry findings by Coursera discussed as part of a webinar jointly organised by Huawei and Reuters Events found 6% more women enrolled in tech courses this year than in 2021.
Story image
Digital Signage
MAXHUB's Digital Signage range to bolster boardroom productivity
The new MAXHUB Digital Signage technology is purpose-built to make every kind of team meeting more effective.
Story image
Silver Peak
The path to an adaptive, modern network
Managing and securing the network looks different than it did just two years ago—especially given that most of these networks are made up of multi-generations of infrastructure stitched together over time.
Story image
APAC organisations fail to disclose ransomware breaches
85% of organisations in APAC were breached by ransomware at least once in the past five years, but only 28% publicly disclosed the incident.
Story image
Data Center
Preventing downtime costs and damage with Distributed Infrastructure Management
Distributed Infrastructure Management (DIM) can often be a lifeline for many enterprises that work with highly critical ICT infrastructure and power sources.
Story image
SPS network now available to CrescoData eCommerce customers
CrescoData, a Pitney Bowes Company and PaaS business in the commerce space, says its customers can now connect to the SPS Commerce Retail Network.
Story image
Sift shares crucial advice for preventing serious ATO breaches
Are you or your business struggling with Account Takeover Fraud (ATO)? One of the latest ebooks from Sift can provide readers with the tools and expertise to help launch them into the new era of account security.
Story image
CERT NZ releases first Cyber Security Insights for 2022
CERT NZ has released Quarter One: Cyber Security Insights 2022, which offers an overview of reports about cybersecurity incidents affecting New Zealanders.
Story image
Trojan cyber attacks hitting SMBs harder than ever - Kaspersky
In 2022 the number of Trojan-PSW detections increased by almost a quarter compared to the same period in 2021 to reach 4,003,323.
Booster Innovation Fund. A fund of Kiwi ingenuity – for Kiwi investors.
Link image
Story image
Fastly acquires Glitch, enables faster developer innovation
"This acquisition brings together two of the worlds best ecosystems for application development into a single, seamless developer experience."
Story image
Digital Transformation
Digital transformation increasing business complexities
A new survey suggests businesses must re-examine their digital transformation approach to better help employees adapt to change.
Story image
Multi Cloud
Red Hat updates dev tools, empowers use of hybrid and multicloud
Red Hat has unveiled updates across its portfolio of developer tools, designed to help organisations build and deliver applications faster.
Story image
Managed service provider
Barracuda MSP Day 2022 highlights MSP opportunities
Barracuda Networks has released a report showing global services-related MSP revenue is set to increase by more than a third in 2022 compared to 2021.
Story image
Artificial Intelligence
Gartner reveals top three tech trends for banks this year
Gartner says generative artificial intelligence, autonomic systems and privacy-enhancing computation are gaining traction in banking and investment services.
Story image
Manhattan Associates
Shortening the click-to-customer cycle through smart technologies
Speed of delivery without accuracy is a dealbreaker for consumers. How can retailers operating in an omnichannel environment overcome the challenge of click-to-customer cycle times.
Story image
SoftIron named global leader for efficient DC infrastructure solutions
SoftIron has been named a global leader for supplying energy-efficient data infrastructure solutions for core-to-edge data centers after an assessment by Earth Capital Ltd.
Story image
Data Protection
Information management capabilities to meet privacy requirements
Organisations with customers or operations across more than one country face a spate of new and proposed privacy and data protection laws.
Story image
Alteryx releases updates, empowers data insights for enterprise
Alteryx has released new advancements designed to aid enterprises with cloud analytics, democratise insights and ensure data governance.
Story image
Elevation of Privilege the top 2021 Microsoft vulnerability
BeyondTrust has released its 2022 Microsoft Vulnerabilities Report, finding that Elevation of Privilege is the top vulnerability category for the second consecutive year.
Story image
Red Sift
Entrust expands strategic partnership with Red Sift
Entrust has expanded its strategic partnership with Red Sift to make it easier for businesses to adopt Brand Indicators for Message Identification (BIMI) standards for email identification and security.
Story image
Check Point
Check Point and CCTV expert join forces to boost protection
The partnership will involve Check Point Quantum IoT Protect Nano Agent being embedded in Provision-ISR’s CCTV cameras for on-device runtime protection.
Story image
i-PRO releases smallest AI-based surveillance camera on the market
The new i-PRO mini network camera is now available, with a pocket-sized form factor and full AI analytics functionality.
Find out how a behavioural analytics-driven approach can transform security operations with the new Exabeam commissioned Forrester study.
Link image
Story image
Vectra AI
Vectra’s inaugural Partner of the Year Awards revealed
APAC companies Baidam, Firmus, ShellSoft and Macnica have been recognised in Vectra AI's inaugural Partner of the Year Awards.
Threat actors are exploiting weaknesses in interconnected IT/OT ecosystems. Darktrace illuminates your entire business and takes targeted action to stop emerging attacks.
Link image