itb-nz logo
Story image

How Cloudera aims to accelerate the industrialisation of AI

06 Dec 2018

Cloudera announced a preview of a new cloud-native machine learning platform powered by Kubernetes. The upcoming Cloudera Machine Learning expands Cloudera’s offerings for enterprise self-service data science. 

It delivers provisioning and autoscaling as well as containerised, distributed processing on heterogeneous compute. Cloudera Machine Learning also aims to ensure secure data access with a unified experience across on-premises, public cloud, and hybrid environments.

It aims to combine data engineering and data science, on any data, anywhere. In addition, it breaks down data silos to accelerate the end-to-end machine learning workflow. 

Containers and the Kubernetes ecosystem are enabling the agility of cloud across diverse environments with a consistent experience, unlocking scalable service delivery for IT across hybrid and multi-cloud deployments. 

At the same time, enterprises are looking to operationalise and scale end-to-end machine learning workflows. 

Cloudera Machine Learning supposedly enables enterprises to accelerate machine learning from research to production – empowering users to easily provision environments and scale resources so they can spend less time on infrastructure and more time on innovation.

“Making teams more productive is essential to scaling machine learning capabilities in the enterprise. This requires a new kind of platform to consistently build and deploy models across highly scalable, transparent infrastructure, tapping into data anywhere,” said Hilary Mason, general manager, Machine Learning at Cloudera. 

“Cloudera Machine Learning brings together the critical capabilities of data engineering, collaborative exploration, model training, and model deployment in a cloud-native platform that runs where you need it – all with the built-in security, governance, and management capabilities our customers require.”

To help customers leverage AI, Cloudera’s applied research team recently introduced Federated Learning for deploying machine learning models from the cloud to the network edge while ensuring data privacy and reducing network communications overhead. 

The report offers a detailed, technical explanation of the approach along with practical engineering recommendations that address use cases across mobile, healthcare and manufacturing, including IoT-driven predictive maintenance.

Capabilities include:

  • Portability across private cloud, public cloud, and hybrid cloud powered by Kubernetes.
  • Cloud provisioning and autoscaling.
  • Scale-out data engineering and machine learning with dependency management provided by containerised Python and Spark-on-Kubernetes.
  • High velocity deep learning powered by distributed GPU scheduling and training.
  • Secure data access across HDFS, cloud object stores, and external databases.
Story image
Company-X cofounder joins Waikato Regional Skills Leadership Group
David Hallett was elected as the group’s information and communication technology (ICT) and creative representative, where he will help to increase opportunities for those who have become unemployed and those who want to make a career in ICT.More
Story image
Oracle Cloud supports VMware-based environments
The solution aims to replicate the on-premise experience through a global, hyperscale public cloud.More
Story image
Location tech crucial for the future of transport and logistics, research finds
The transport and logistics sector has been hard hit by recent events, however location technologies are paving the way for post COVID-19 growth and, as a result, commercial telematics system revenue in Asia-Pacific is set to hit US$14 billion by 2025. More
Download image
Workforce demographics and culture is changing. Management must too
The way we work is changing, and so is the make-up of the workforce. To get the best results, businesses need to take on dynamic workforce management.More
Story image
Samsung unveils 5 new devices, including Galaxy Note20
Samsung has today announced a suite of new products to its consumer device lineup, adding to their roster two new phones, a tablet, a smartwatch and earbuds.More
Link image
Nine developer enablement practices to achieve DevOps at enterprise scale
Senior software engineering leader with experience at multiple Fortune 500 companies shares how a metrics-driven mindset can dramatically improve software quality and enable DevOps at enterprise scale.More