IT Brief New Zealand - Technology news for CIOs & IT decision-makers
Story image
Snowflake unveils new innovations to its unified platform
Wed, 5th Jul 2023

Snowflake has announced new advancements to its single, unified platform that make it easier for organisations to get value from all of their data, while continuing to deliver improved performance for customers’ most critical workloads.

With new innovations like Document AI (private preview), Snowflake is launching a new large language model (LLM) built from Applica’s pioneering generative AI technology to help customers understand documents and put their unstructured data to work. 

Snowflake is also unveiling updates to Iceberg Tables (private preview soon) to further eliminate data silos and allow organisations to use open table formats with fast performance and enterprise-grade governance for both data in Snowflake’s catalog and data managed by another catalog. 

In addition, the new Snowflake Performance Index (SPI) provides increased transparency and metrics around Snowflake’s ongoing performance improvements, revealing that query duration has improved by 15% for stable customer workloads since Snowflake began tracking this metric over the last eight months — reinforcing how Snowflake continues to advance price per performance for customers.

Snowflake Brings the Power of LLMs to the Data Cloud
Over the next five years, more than 90% of the world’s data will be unstructured in the form of documents, images, video, audio, and more, according to IDC. This massive volume of unstructured data is routinely stored by organisations, however gaining valuable insight from it has historically required manual, error-prone processes and limited expert skillsets.

Building on Snowflake’s support for unstructured data, Snowflake’s built-in Document AI will make it effortless for organisations to understand and extract value from documents using natural language processing. 

Document AI stems from Snowflake’s acquisition of Applica (Sept. 2022) and leverages its purpose-built, multimodal LLM. By integrating this model within Snowflake’s platform, organisations will be able to easily extract content like invoice amounts or contractual terms from documents and fine-tune results using a visual interface and natural language. 

Customers are using Document AI to help their teams be smarter about their businesses, and enhance user productivity in secure and scalable ways. Snowflake is starting with Document AI and plans to expand these capabilities to more types of unstructured data.

Snowflake Extends Performance and Governance to More Data with Iceberg Tables
As Apache Iceberg continues to grow in popularity as the industry standard for open table formats, Snowflake is making it easier for enterprises to extend the value of the Data Cloud to Iceberg data. With Iceberg Tables, organisations can work with data in their own storage in the Apache Iceberg format, whether that data is managed by Snowflake or managed externally, while still benefiting from Snowflake’s ease of use, performance, and unified governance. 

This simplifies data management by eliminating the need for organisations to move or copy data between systems, all the while increasing flexibility and reducing costs. In addition, Apache Iceberg’s growing ecosystem of diverse adopters, contributors, and commercial offerings future-proofs storage, preventing vendor lock-in and frequent migrations. Customers like Booking.com are leveraging Iceberg Tables today to bring the power of the Data Cloud to all of their data.

Snowflake’s number one value is to ‘put customers first.’ Snowflake remains focused on delivering continuous innovations with regular releases to improve performance and efficiency, often requiring no action from customers. 

With this in mind, Snowflake is introducing the new SPI to quantify improvements over time by analysing actual customer workloads. Based on the SPI, query duration time has improved by 15% since Snowflake began tracking this metric over the last eight months for stable customer workloads in Snowflake. 

The SPI highlights Snowflake’s commitment to continuously optimising cost and performance for customers, and providing them with more transparency on the quantitative performance impact of platform capabilities and hardware improvements on their production workloads over time.

In addition, Snowflake is advancing its single platform to support a broader set of advanced analytics capabilities including pre-built machine learning functions for SQL users (public preview), and expanding its unified governance and privacy with new data quality metrics and classification features (both in private preview). 

“Snowflake’s single platform continues to be core to our innovation strategy, and we’re constantly enhancing it so customers can access, understand, and protect their data seamlessly, while benefiting from Snowflake’s leading performance, scale, and governance,” says Christian Kleinerman, SVP of Product, Snowflake. 

“We’re unlocking a new data era for customers, leveraging AI and eliminating silos previously bound by format, location, and more to revolutionise how organisations put their data to work and drive insights with the Data Cloud.” 

Snowflake also announced new innovations that extend data programmability for data science, data engineering, and application development; advancements that enable organisations to distribute and monetise leading applications at scale in the Data Cloud.