IT Brief New Zealand logo
Technology news for New Zealand's largest enterprises
Story image

The future of data with machine learning and cloud advancement

By Contributor
Tue 8 Jan 2019
FYI, this story is more than a year old

Article by Cloudera Australia and New Zealand country manager Nick Hoskins

Machine learning and cloud are set to continue as ‘hot topics’ in 2019. As technology evolves, organisations that don’t take the reins in terms of machine learning and cloud adoption may see themselves left behind. You only have to look as far as the Australian market to see numerous initiatives and great projects taking place. However, to be successful, they must have data at the centre of their attention.  

Machine learning

According to Gartner, machine learning promises to transform business processes; it will not only reconfigure the workforce, optimise infrastructure behaviour, but also blend industries through rapidly improved decision making and process optimisation.

Moreover, the exciting part is that we are just at the beginning of the enterprise machine learning transformation. Machine learning will increasingly become a core business and analytic component. Its advancements and capabilities will allow organisations to automate pattern detection, prediction and decision making which will drive transformational efficiency improvement, competitive differentiation and growth. 

Early adopters of machine learning that have had time to experiment with its capabilities will move from a proof-of-concept stage to production deployment of multiple use-cases. This will allow for an emergence of technologies and best practices aimed at enhancing operation, scale and ultimately achieve full transformational value.

Infrastructure and tooling will continue to evolve around efforts to streamline and automate the process of building and deploying machine learning apps at enterprise scale.  In particular, machine learning workload containerisation and Kubernetes orchestration will provide organisations a direct path to efficiently building, deploying and scaling apps in public and private clouds. 

We will see continued growth in the automated machine learning (AutoML) tools ecosystem, as vendors capitalise on opportunities to speed up time-consuming, repeatable chunks of the machine learning workflow, from data prep and feature engineering to model lifecycle management. 

Streamlining and scaling machine learning workflows from research to production will also drive new requirements for DevOps as well as corporate IT, security and compliance, as data science teams place increasing demands on infrastructure, continuous integration/continuous deployment (CI/CD) pipelines, cross-team collaboration capabilities, and corporate security and compliance to govern hundreds of machine learning models, not just one or five, deployed in production.

Beyond technology, we’ll see continuing demand for expert guidance and best practice approaches to scaling organisational strategy, skills and continuous learning in order to achieve the long term goal of embedding machine learning in every business product, process and service.  

A recent report by advocacy group StartupAUS in collaboration with Microsoft revealed Australia is facing a critical shortage of coders — including full stack developers, front-end, back-end and mobile — user experience designers and start-up-focused sales roles such as business development managers. Visionary adopters will seek to build an investment portfolio of differentiated machine learning capabilities and optimise their people, skills and technology capabilities to best support it. 

In 2019, we expect to see the best practice approaches to scaling organisational strategy alongside continuous learning of machine learning. 


Cloud will become significantly more important for organisations in Australia with Gartner predicting 30 percent of organisations will use object storage as a data repository on-premises, bringing cloud architecture to the data center by 2019.  

As organisations begin to understand and appreciate the value of adding cloud to their existing infrastructure and applications, a mix of public cloud and on premise cloud will become increasingly important, offering organisations the flexibility and delivering a solution that best fits their needs. 

Any vendor that only offers one option and “locks in” a company will find their customers will be at a disadvantage. With this choice of deployment options, the need for a consistent framework that ensures security, governance, and metadata management will become even more crucial. 

As a result, companies will be able to simplify the development and deployment of applications, regardless of where data is stored and applications are run, also ensuring that they can use a variety of machine learning and analytic capabilities, working in concert with data from different sources into a single coherent picture, without the associated complexity.

With these benefits in mind, companies will be more likely to move to a hybrid cloud model, enabling them to have workloads and data running in private cloud and/or public cloud based on their needs. Bursting, especially with large amounts of data, is time consuming and not an optimal use of hybrid cloud. Instead, specific use cases such as running transient workloads in the public cloud and persistent workloads in private cloud provide a “best of both worlds” deployment. 

Hybrid cloud will also open doors for organisations to utilise a platform as a service (PaaS), an application development platform for developers to write custom applications without provisioning the underlying infrastructure they need to run. 

Most major PaaS software can run on customer’s premises, hosted in a private environment or natively in the major IaaS public cloud. The PaaS automatically configures infrastructure resources across these environments, making them a platform for hybrid cloud. 

Even though this is a market with great potential to grow, the hybrid model is a challenge for public cloud as well as private cloud only vendors. In order to prepare for this move, vendors are making acquisitions such as the recent one by IBM buying Red Hat. 

The reality is that in 2019 we’ll certainly see more of them, also mergers among vendors to broaden their product offerings for hybrid cloud deployments. It’s safe to say the race to drive hybrid cloud is only starting.

Related stories
Top stories
Story image
Tech job moves - Forcepoint, Malwarebytes, SolarWinds & VMware
We round up all job appointments from May 13-20, 2022, in one place to keep you updated with the latest from across the tech industries.
Story image
Let’s clear the cloud visibility haze with app awareness
Increasingly, organisations are heading for the cloud, initiating new born-in-the-cloud architectures and migrating existing applications via ‘lift and shift’ or refactoring.
Story image
Remote Working
Successful digital transformation in the hybrid work era is about embracing shifting goalposts
As organisations embraced remote working, many discovered they lacked the infrastructure needed to support history’s first global load test of remote work capabilities.
Story image
Vectra AI
Understanding the weight on security leader’s shoulders, and how to shift it
Millions of dollars of government funding and internal budgets are being funnelled into cybersecurity to build resilience against sophisticated threats, indicating how serious this issue has become.
Story image
Artificial Intelligence
SAS announces new products amid cloud portfolio success
Analytics and AI company SAS is deepening its broad industry portfolio with offerings that support life sciences, energy, and martech.
Story image
Artificial Intelligence
AI-based email security platform Abnormal Security valued at $4B
"A new breed of cybersecurity solutions that leverage AI is required to change the game and stop the rising threat of sophisticated and targeted email attacks."
Story image
Digital Transformation
Pluralsight and Ingram Micro Cloud team up on cloud initiative
Pluralsight has teamed with Ingram Micro Cloud to build upon cloud competence and maturity internally, and externally support partners’ capabilities.
Story image
Artificial Intelligence
CFOs using digital workers and AI to prevent unnecessary loss
New technology is now allowing CFOs to use digital workers to automate their accounting processes, making it easier for them to avoid unnecessary losses.
Story image
ChildFund launches new campaign to protect children online
ChildFund says WEB Safe & Wise aims to protect children from sexual exploitation and abuse online while also empowering them to become digitally savvy. 
Story image
Digital Transformation
How to modernise legacy apps without compromising security
At a time when digital transformation has become central to business, even the most important applications come with a ‘use-by’ date.
Story image
Data backup plans inadequate, data still at risk - study
The Apricorn 2022 Global IT Security Survey revealed that while the majority organisations have data backup plans in place, data for many are at risk.
Story image
Lightspeed launches all-in-one marketing platform in A/NZ
ECommerce provider, Lightspeed has launched a new all-in-one marketing solution, Lightspeed Marketing & Loyalty in Australia and New Zealand.
Story image
Vodafone NZ buys remaining stake in retail joint venture
Vodafone New Zealand has purchased the remaining 50% stake in the specialist joint venture (JV) with private equity company Millennium Corp.
Story image
Application Security
What are the DDoS attack trend predictions for 2022?
Mitigation and recovery are vital to ensuring brand reputation remains solid in the face of a Distributed Denial of Service (DDoS) attack and that business growth and innovation can continue.
Story image
Cybersecurity starts with education
In 2021, 80% of Australian organisations responding to the Sophos State of Ransomware study reported being hit by ransomware. 
Story image
Apple previews new features for users with disabilities
Apple says new software features that offer users with disabilities new tools for navigation, health and communication, are set to come out later this year.
Story image
Qualys updates Cloud Platform solution with rapid remediation
The new update is designed to enable organisations to fix asset misconfigurations, patch OS and third-party applications, and deploy custom software.
Story image
Cradlepoint expands its Cellular Intelligence capabilities
Cradlepoint has announced additional Cellular Intelligence capabilities with its NetCloud service.
Story image
New vulnerabilities found in Nuspire’s Q1 2022 Threat Report
“Threat actors are quickly adjusting their tactics and these exploits tend to get industry attention, but the threat posed by older and attacks still persists."
Story image
A10 Networks finds over 15 million DDoS weapons in 2021
A10 Networks notes that in the 2H 2021 reporting period, its security research team tracked more than 15.4 million Distributed Denial-of-Service (DDoS) weapons.
For every 10PB of storage run on HyperDrive vs. comparable alternatives, an estimated 6,656 tonnes of CO₂ are saved by reduced energy consumption alone over its lifespan. That’s the equivalent of taking nearly 1,500 cars off the road for a year.
Link image
Story image
Could your Excel practices be harming your business?
While Excel has been the de-facto standard for budgeting, planning, and forecasting, is it alone, enough to support organisations in the global marketplace that’s facing rapid changes due to digital transformation?
Threat actors are exploiting weaknesses in interconnected IT/OT ecosystems. Darktrace illuminates your entire business and takes targeted action to stop emerging attacks.
Link image
Story image
Fonterra to use automated guided vehicles by Dematic
New Zealand's dairy giant Fonterra is upgrading its manufacturing facility in Edendale with new automated guided vehicles (AGVs) from Dematic.
Story image
Maintaining secure systems with expectations of flexible work
Most office workers feel they've proved they can work successfully from home, and as much as employers try, things aren't going back to the way they were anytime soon.
Booster Innovation Fund. A fund of Kiwi ingenuity – for Kiwi investors.
Link image
Story image
A third of companies paying ransom don’t recover data - report
Veeam's report finds 76% of businesses who are victims of cyberattacks paid the ransom to recover data, but a third were still unable to get their information back.
Story image
Amazon Web Services / AWS
RedShield leverages AWS to scale cybersecurity services
"Working with AWS gives RedShield the ability to mitigate significant application layer DDoS attacks, helping leaders adopt best practices and security architectures."
Story image
Power at the edge: the role of data centers in sustainability
The Singaporean moratorium on new data center projects was recently lifted, with one of the conditions being an increased focus on power efficiency and sustainability.
Story image
Sift shares crucial advice for preventing serious ATO breaches
Are you or your business struggling with Account Takeover Fraud (ATO)? One of the latest ebooks from Sift can provide readers with the tools and expertise to help launch them into the new era of account security.
Story image
Revenue operations is taking centre stage
As the business world continues to evolve, new demands need to be met to keep up with the ever-changing landscape. 
Find out how a behavioural analytics-driven approach can transform security operations with the new Exabeam commissioned Forrester study.
Link image
Story image
More than 40% of banks worried about cloud security - report
Publicis Sapient's new report finds security and the lack of cloud skills and internal understanding of business benefits are big obstacles for banks moving to the cloud.
Story image
Digital Transformation
Trading up: It's time to swap core systems for flexible digital applications
This year will see more oranisations planning and commencing high tech renovations that will shake up the way they operate.
Story image
Customer experience
Gartner recognises Okta for abilities in Access Management
Okta has announced it has been recognised as a Customers' Choice for the fourth time in a row in the Gartner Peer Insights "Voice of the Customer" report.
Story image
Wireless Nation
Wireless Nation, N4L provide 4G network to remote NZ schools
Wireless Nation and Network for Learning (N4L) have rolled out the Rural Connectivity Group’s (RCG) new 4G network to better connect three Chatham Islands schools.
Story image
Data Protection
Barracuda launches new capabilities for API Protection
"Every business needs this type of critical protection against API vulnerabilities and automated bot attacks," Barracuda says.
Story image
Data Center
Preventing downtime costs and damage with Distributed Infrastructure Management
Distributed Infrastructure Management (DIM) can often be a lifeline for many enterprises that work with highly critical ICT infrastructure and power sources.
Story image
Grasping the opportunity to rethink the metrics of a sustainable data centre
A data centre traditionally has two distinct operations teams: the Facility Operations team, and the IT Operations team. Collaboration between them is the key to defining, measuring, and delivering long-term efficiency and sustainability improvements.
Story image
Data and analytics could be key to higher selling prices in APAC
Sisense's latest report has found that almost half of data professionals in APAC think customised data and analytics can create better selling prices for their products.
Story image
Alarming surge in Conti Ransomware Group activity - report
A new report has identified a 7.6 per cent increase in the number of vulnerabilities tied to ransomware in Q1 2022.
Story image
Nutanix study reveals financial services sector lagging with multicloud adoption
Nutanix has released new research that reveals the financial services sector is lagging behind when it comes to multicloud adoption.
Story image
Supply chain
Jetstack promotes better security with supply chain toolkit
The web-based resource is designed to help organisations evaluate and plan the crucial steps they need to establish effective software supply chain security.
Story image
Nozomi Networks
Nozomi Networks, Siemens reveal software integration
Nozomi Networks and Siemens have extended their partnership by embedding Nozomi Networks’ software into the Siemens Scalance LPE local processing engine.