IT Brief New Zealand logo
Technology news for New Zealand's largest enterprises
Story image

Ignite 2018 - Making AI real for your business with Azure Data

By Contributor
Wed 26 Sep 2018
FYI, this story is more than a year old

At Microsoft Ignite in Orlando, I shared how the confluence of Cloud, Data, and Artificial Intelligence (AI) is driving unprecedented change and is rapidly becoming foundational to innovation in every industry.

The driving force behind powerful AI applications is data – and getting the most out of AI requires a modern data estate. Unlocking the potential of data has become an imperative for organisations that want to leverage AI to uncover new insights and create new business opportunities.

Today, we shared a number of exciting announcements that will enable organisations to build data and AI solutions that transform their businesses.

For over two decades, organisations have relied on SQL Server to manage all facets of their relational data. Last year at Ignite, we announced the general availability of SQL Server 2017, which brought the much beloved SQL Server engine to Linux. With over 5.6 million downloads in just the first 6 months, it rapidly became our most popular SQL Server version yet.

Today, we are building on that momentum with the announcement of the SQL Server 2019 preview. With SQL Server 2019, organisations can now seamlessly manage their relational and non-relational data in a single, integrated solution.

It comes with big data capabilities built-in, including support for Apache SparkTM and Hadoop Distributed File System (HDFS). And with SQL Server Machine learning Services and Spark Machine learning (ML), organisations can get AI-driven insights from their entire data estate, regardless of data type.

We also enhanced PolyBase with additional connectors to data sources, such as Azure SQL Data Warehouse, Azure Cosmos DB, Mongo DB, Oracle, and Teradata, further helping organisations break down their data silos. With this new level of data virtualisation, organisations can now apply the same security and access control policies and run T-SQL queries on all their data – regardless of its source.

SQL Server 2019 also runs anywhere in Kubernetes – on-premises, on Azure Stack, or in the cloud. With the preview of Azure Data Studio’s tooling for SQL Server 2019, organisations can now not only manage their big data clusters, they can also take advantage of a new analytics notebook experience and a PolyBase wizard for fast and easy access to data stored in other database management systems.

We are excited to see customers, like Johns Hopkins University, already running demanding big data workloads on it to unlock analytics and AI.

"From its inception the Sloan Digital Sky Survey database has run on SQL Server, and SQL Server also stores object catalogs from large cosmological simulations. We are delighted with the promise of SQL Server 2019 big data clusters, which will allow us to enhance our databases to include all our big data sets.

The distributed nature of SQL Server 2019 allows us to expand our efforts to new types of simulations and to the next generation of astronomical surveys with datasets up to 10 PB or more, well beyond the limits of our current database solutions," - Dr. Gerard Lemson, Institute for Data Intensive Engineering and Science, Johns Hopkins University

We also made a number of exciting announcements that make Azure the best destination for an organisation’s data. For SQL workloads, Azure SQL Database Managed Instance offers an easy path to the cloud and incredible value. Generally available today, Azure SQL Database Managed Instance enables organisations to migrate their SQL Server workloads to Azure with zero code changes. It offers native VNET support and is compatible with the full SQL Server feature set.

Thanks to offers like Azure Hybrid Benefit and SQL Database reserved capacity, organisations that migrate to Azure can save up to 80 percent compared to other cloud offerings. In addition, organisations can now use the fully managed Azure Database Migration Service to migrate at scale from SQL Server to SQL Database Managed Instance. It is inspiring to see the strong demand for Azure SQL Database Managed Instance and the value it is already delivering to organisations.

“We were able to deploy our TimeXtender solution into production on Azure SQL Database Managed Instance in a matter of weeks. We immediately realised a 49% cost savings and a 25-30 percent performance improvement, and the promise of applying artificial intelligence through machine learning to our data is an exciting opportunity for us," - John Steele, GM of Business Technology & Systems, Komatsu Australia.

Azure SQL Database Managed Instance is also catching the attention of analysts. Forrester recently interviewed several customers who have migrated their SQL databases onto a managed instance and found that on average they saw a migration payback period of less than 6 months and a 40 percent improvement in DBA productivity.

We also announced today the preview of Azure SQL Database Hyperscale, a highly scalable service tier that adapts on-demand to workload needs. With Azure SQL Database Hyperscale, organisations can grow a single database up to 100 TB, significantly expanding the potential for application growth. Innovations like these make Azure SQL Database the best relational database in the cloud.

As a further testament to Azure’s commitment to openness, we also made a number of exciting announcements for our open source databases. Azure Database for MariaDB is now in preview, bringing a fully managed, open source MariaDB database-as-a-service to the Azure platform. MariaDB on Azure offers developers built-in high availability, dynamic scaling, flexible pricing, and world-class security and infrastructure.

We also announced the preview of Advanced Threat Protection for Azure database services for MySQL and PostgreSQL, enabling organisations to detect and respond to potential threats as they occur. Azure Database for PostgreSQL now provides preview support for Query Store, Query Performance Insights, and Performance Recommendations as part of its Intelligent Performance offering. Using this combination of features, organisations can inspect their databases to understand their workloads, identify bottlenecks, and detect changes in query performance. 

Azure Cosmos DB is Microsoft's globally distributed, multi-model database service for NoSQL workloads. Azure Cosmos DB provides turnkey global distribution, elastic scaling, single-digit millisecond latency, five well-defined consistency models, and guaranteed high availability. Azure Cosmos DB automatically indexes all data without requiring developers to deal with schema or index management. It is a multi-model service, which natively supports document, key-value, graph, and column-family data models.

Today, we are happy to announce the general availability of multi-master at global scale in Azure Cosmos DB. This enables unprecedented write scalability and availability with multi-master replication. With Azure Cosmos DB’s multi-master replication every region becomes writable (in addition to being readable) which enables single digit millisecond write latency and 99.999% write availability around the world. To learn more, please read our latest SLA page.

We are also excited to announce general availability of Azure Cosmos DB Cassandra API. By providing wire protocol level compatibility with the Apache Cassandra, Azure Cosmos DB ensures you can continue using your existing application and favorite open source software (OSS) tools with virtually no code changes and gives you the flexibility to run your Cassandra apps fully managed with no vendor lock-in. It is exciting to see the amazing momentum for Azure Cosmos DB in the market and to see how customers are adopting it to drive their business forward.

“Cosmos DB has delivered a high performance, worldwide platform for our global reputation system. With a click of a button we can rapidly deploy regions worldwide to deliver excellent response time to our customers and partners. The Cosmos DB Cassandra API eliminated major engineering efforts during the migration of our services as we were able to integrate with very minimal changes. Our largest service is slated to migrate with the launch of Cassandra API support," - Michael Shavell, Technical Director / Architect at Symantec

Azure Cosmos DB not only delivers industry-leading performance, but it also offers superior value. Organisations that migrate their existing NoSQL applications to Azure Cosmos DB can save up to six times compared to enterprise versions of OSS NoSQL databases. Today, we are happy to announce general availability of Azure Cosmos DB Reserved Capacity, enabling organisations to save up to 65 percent off the list price of Azure Cosmos DB.

In addition, today we announced that a database can be provisioned for as little as 10,000 RU/s (lowering the entry point by 5x) and can grow incrementally to fit an organisation’s needs. We are also happy to announce that we are extending the length of the popular Try Cosmos DB for Free trial to 1 month. In total, Azure Cosmos DB’s capabilities and value make it the best destination for all of your NoSQL workloads.

When it comes to analytics and AI, Azure provides the most compelling set of services to help organisations quickly gain important insights to their businesses. Azure Data Factory enables organisations to effortlessly ingest data at multi-TB scale into Azure from over 70 data sources, including AWS S3, AWS Redshift, Google Big Query, Oracle, Teradata, Netezza and SAP HANA for deeper analytics.

Azure Databricks provides a fast, easy and collaborative Apache Spark-based analytics platform for data preparation and machine learning (and deep learning) model development and training. It offers the best of OSS analytics frameworks and tight integration with the Azure ecosystem. Azure SQL Data Warehouse is our enterprise-class, fully integrated data warehouse and is the first of its kind to offer independent scaling for compute and storage. These three services taken together form our ‘modern data warehouse’ and ‘machine learning on big data’ patterns and offer organisations incredible value.

“Our modern data warehouse gives us increased agility which was missing from our datacenter. By focusing less on the operational complexity and more on the business logic, we are increasing our agility and reaping business value faster," - Chetan Kundavaram, Global Director, Anheuser Busch Inbev

Today, we announced that Azure SQL Data Warehouse will now be accessible to more customers through a smaller service level (DW500c). With this release, organisations can get started with a powerful cloud data warehouse for as low as $6.049/hour. This performance-oriented tier is now available across 26 Azure global regions, including Azure Government. Azure SQL Data Warehouse now has even better integration with Azure Databricks allowing organisations to easily stream, train, and publish streaming data to build real-time analytics solutions.To learn more, please check out our Azure SQL Data Warehouse announcement blog.

Also new is the preview of Azure Databricks Delta. Azure Databricks Delta enables organisations to increase data reliability, improve performance, and simplify their data pipelines. Building high performance analytics solutions at scale using Azure Databricks is now simpler than ever for organisations. With new metadata, indexing and caching capabilities over Spark tables, organisations can get better reliability and performance on Spark jobs and queries in Azure Databricks. 

As part of our continued commitment to supporting open source analytics, I also announced today that HDInsight will now support Hadoop 3.0—making Azure the first cloud provider to offer this capability. HDInsight also offers enhanced security with the general availability of Enterprise Security Package, which enables organisations to join their HDInsight clusters to a domain, authenticate users with Kerberos, and authorize and audit their access using Apache Ranger. Developers will also find it easy to debug and diagnose large jobs using playback, automatic data skew detection, and other innovative enhancements. To learn more, please check out our HDInsight announcement blog.

We also announced today the preview of Azure Data Explorer—a lightning fast service optimised for data exploration. The service helps organisations quickly discover insights from petabytes of structured and unstructured data. Azure Data Explorer can be used to query streaming data to drive instant insights for analyzing performance, identifying trends and anomalies, and diagnosing problems.

Data engineers can also use it to explore data in the early stages of data analytics to better understand what’s in their data. Azure Data Explorer enhances the modern data warehouse by providing instant visibility and analytics over data spanning minutes ago to weeks or months. To learn more, please check out our Azure Data Explorer announcement blog.

Finally, I’d like to close with an example of a truly transformational customer solution. Shell, a global oil and gas company, has been on a journey to leverage data and AI to digitally transform their business. One amazing example of this is how they are using the power of their data to improve the safety and effectiveness of their retail stores. With Azure Databricks, Shell can train algorithms to analyse thousands of hours of closed-circuit television (CCTV) footage to identify potential safety concerns in near real-time.

“We have developed a collection of machine learning models that operate both at the edge and in the cloud. We can identify events of interest at the edge in real-time and pass those to the cloud for tight processing and we can use the cloud for near real-time alerting. The Azure cloud is powering this transformation, bringing together the best of platform-as-a-service offerings, like Azure Databricks, and combine them with open source technologies like TensorFlow and Kafka," - Daniel Jeavons, GM of Data Science, Shell.

Article by Azure Data corporate vice president Rohan Kumar.

Related stories
Top stories
Story image
TO THE NEW unveils A/NZ Managed Services for Microsoft Azure
TO THE NEW has released Managed Services for Microsoft Azure to meet the growing demand in the A/NZ market and globally.
Story image
Honeywell launches new carbon energy management software for buildings
The new Carbon & Energy Management service allows building owners to track and optimise energy performance against carbon reduction goals, down to a device or asset level.
Story image
Global investment in data centers more than doubled in 2021
DLA Piper's latest global survey finds the total investment in data center infrastructure worldwide rose from USD $24.4 billion in 2020 to USD $53.8 billion in 2021.
Story image
Internet of Things
Global 5G subscriptions to top one billion by the end of 2022
Global 5G subscriptions are predicted to pass the one billion milestone by the end of 2022, according to a new report.
Story image
Contact Centre
Customer service agents don't want to return to contact centres
A new report has revealed that 85% of customer service agents want to work full-time at home and not return to contact centre offices.
Story image
Forrester names Talend Leader in enterprise data fabric
Forrester has named Talend a leader among enterprise data fabric providers in the Forrester Wave: Enterprise Data Fabric, Q2 2022 report.
Story image
Microsoft launches app for modern selling experience
The new release is designed to enhance CRM systems with customer engagement data from Microsoft 365 and Microsoft Teams.
Story image
Sternum joins NXP, collaborates on IoT security and observability
Sternum has announced it has joined the software partner community of NXP Semiconductors, a manufacturer of and large marketplace for embedded controllers.
Story image
Consumers want personalisation, but don't trust brands with their data
Customers expect personalisation during every brand interaction but they don't trust brands to keep their personal data secure and to use it responsibly. 
Story image
Varonis strengthens security capabilities for AWS and S3
Varonis has strengthened and expanded its cloud and security capabilities, with a critical aim of improving safety and boosting data visibility in Amazon Simple Storage Service (S3).
Story image
Disaster Recovery
Eaton provides business continuity with disaster avoidance application
Many SMBs often struggle with problems relating to UPS and IT assets due to the sheer amount of time and resources required to run effectively. 
Story image
Tech job moves
Tech job moves - ActiveCampaign, Arcserve, LogRhythm & Qlik
We round up all job appointments from June 17-22, 2022, in one place to keep you updated with the latest from across the tech industries.
Story image
Corpay partners with supply chain platform PracBiz Exchange
Corpay's new partnership with PracBiz’s allows more than 4000 B2B suppliers on the latter's platform to use Corpay's global payments services.
Story image
Dark web
Cybercrime in Aotearoa: How does New Zealand law define it?
‘Cybercrime’ is a term we hear all the time, but what exactly is it, and how does New Zealand define it in legal terms?
Story image
Cloudflare outage in 19 data centers worldwide due to own error
Cloudflare says its outage for 19 of its data centers yesterday was because of a change in a long-running project to increase resilience in its busiest locations.
Story image
How TruSens air purifiers can create healthier workspaces
The pandemic has heightened our awareness of our own and others’ health, and made us all much more conscious of the environments we work in.
Story image
VMware wins Google Cloud partner award for infrastructure modernisation
The cloud computing and virtualisation company was recognised for its achievements as part of the Google Cloud ecosystem.
Story image
Internet of Things
Domino's Pizza: A blueprint for secure enterprise IoT deployment
Increasingly, organisations are embracing smart technologies to underpin innovations that can enhance safety and productivity in every part of our lives, from industrial systems, utilities, and building management to various forms of business enablement.
Story image
Digital Transformation
Cybersecurity priorities for digital leaders navigating digital transformation
In recent years, Asia-Pacific has especially been a hotspot for cyberattacks, and as we continue into 2022, it’s evident that the problem is becoming more significant.
Story image
Hybrid workforce
Why hybrid working is here to stay and how to ace it
Citrix's new report reveals hybrid workers are more productive and engaged at work than their office and completely remote counterparts.
Story image
Lenovo announces launch of Retail Solutions portfolio in A/NZ
Lenovo has announced the launch of its Lenovo Retail Solutions portfolio across the A/NZ region, which they say will help retailers transform their business and face future retail demands.
Story image
Online identity theft is rising in NZ - here’s what to do about it
It may start with a few stolen details online, but it could end with thousands of dollars missing or worse, a reputation down the drain.
Story image
Microsoft expands APAC Enabler Mentorship Program
"Mentors are the key to success for every professional. A good mentor is a coach, a guide, as well as a vocal advocate."
Story image
Workday winning on culture and family focus
This family-first approach sees all employees receive access to family-wide private healthcare cover, as well as income protection and life insurance policies.
Story image
Market growth
Salesforce unveils new offerings for consumer goods companies
Salesforce has announced new products for consumer goods companies to help brands navigate increasing market complexity more easily.
Story image
Network Security
Netskope announces zero trust network access updates
Customers can now apply zero trust principles across a range of hybrid work security needs, including SaaS, IaaS, private applications, and endpoint devices.
Story image
Significant security concerns resulting from open source software ubiquity
"The risk is real, and the industry must work closely together in order to move away from poor open source or software supply chain security practices."
Story image
Ready for anything with the PagerDuty Operations Cloud
In a world of digital everything, teams face increasing complexity. Ever-growing dependencies across systems and processes put customer and employee experience, not to mention revenue, at risk.
Story image
DigiCert acquires DNS Made Easy and affiliated brands
Greg Clark comments, says, "This combination enhances the security of certificate validation and enables the automation of future validations."
Story image
Greater API usage raises concerns for protection - report
Radware has released its 2022 State of API Security report, which shows a rise in APIs, with 92% of the organisations surveyed significantly or somewhat increasing their usage.
Story image
Artificial Intelligence
Accenture shares the benefits of supply chain visibility
It's clear that gaining better visibility into the supply chain will help organisations avoid excess costs, inefficiencies, and complexity to ultimately improve their bottom line.
Story image
Aqua Security, CIS create software supply chain security guide
Aqua Securityand the Center for Internet Security have together released the industry’s first formal guidelines for software supply chain security.
Story image
SMX partnership with Microsoft leads to NTT recognition
SMX has captured the attention of NTT after receiving positive reviews from businesses across Australasia and beyond for its email security.
Story image
Video: 10 Minute IT Jams - An update from Tricentis
Tricentis provides software testing automation, and software quality assurance products for enterprise software.
Story image
Why is NZ lagging behind the world in cybersecurity?
A recent report by TUANZ has revealed that we are ranked 56th in the world when it comes to cybersecurity - a look into why we're so behind and what needs to be done.
Story image
Volpara, Microsoft project to detect cardiovascular issues
Volpara Health Technologies is working with Microsoft on a research and development project to speed up creating a product that detects and quantifies breast arterial calcifications (BACs).
Story image
Canstar finds Flick Electric NZ’s favourite provider
Canstar’s annual research to find New Zealand’s favourite electricity provider reveals Flick Electric has come out on top.
Story image
Ingram Micro launches vendor-backed security program
Ingram Micro has unveiled a new program intended to give resellers the effective offerings their customers need to stay safe in the evolving threat landscape.
Story image
Amazon Web Services / AWS
Zscaler, AWS accelerate onramp to the cloud with zero trust
Zscaler has announced an extension to its relationship with Amazon Web Services, as well as innovations built on Zscaler's Zero Trust architecture.
Story image
The best ways to attract young talent during labour shortages
New research from Citrix reveals hybrid working and ventures into the metaverse are top of mind for Gen Z workers.
Story image
IT and security team collaboration crucial to data security
Many IT and security decision makers are not collaborating as effectively as possible to address growing cyber threats.
Story image
Industry-first comprehensive risk-based API security enhances protection
Application Programming Interfaces (APIs) have become a crucial part of operating web and mobile application businesses and are causing significant economic growth in the digital sector.
Story image
The rise of digital gifting in the workplace
The name itself does most of the explaining; it’s a gift you receive virtually. But a misconception about digital gifts is that they need to be redeemed virtually as well. 
Story image
10 Minute IT Jams
Video: 10 Minute IT Jams - An update from Rimini Street
Today we welcome back Daniel Benad, who is the GVP & regional GM for Oceania at Rimini Street.