Story image

AWS launches fully-managed data lake service

12 Aug 2019

Amazon Web Services has launched a new, fully-managed service for customers to build, secure, and manage data lakes.

AWS Lake Formation aims to simplify and automate the creation of a data lake, including data collection, cleaning, and cataloguing, as well as data availability for analytics.

According to AWS, “Customers can easily bring their data into a data lake from a variety of sources using pre-defined templates, automatically classify and prepare the data, and centrally define granular data access policies to govern access by the different groups within an organisation.”

AWS Lake Formation also automates manual, time-consuming steps, like provisioning and configuring storage, crawling the data to extract schema and metadata tags, automatically optimising the partitioning of the data, and transforming the data into formats like Apache Parquet and ORC that are ideal for analytics.

 AWS Lake Formation cleans and deduplicates data using machine learning to improve data consistency and quality. 

AWS Lake Formation simplifies data access and security by providing a single, centralised place to set up and manage data access policies, governance, and auditing across Amazon S3 and multiple analytics engines. 

AWS Lake Formation also reduce dataset hunting time by providing a central, searchable catalogue, which describes the available data sets and their appropriate business use.

Customers will be able to analyse data through AWS analytics and machine learning services such as Amazon Redshift, Amazon Athena, and Amazon Glue.

AWS expects to add capabilities for Amazon EMR, Amazon QuickSight, and Amazon SageMaker following in the coming months.

“Our customers tell us that Amazon S3 is the ideal place to house their data lakes, which is why AWS hosts more data lakes than anyone else – with tens of thousands and growing every day. They’ve also told us that they want it to be easier and faster to set up and manage their data lakes,” says AWS vice president of databases, analytics and machine learning, Raju Gulabani.

“That’s why we built AWS Lake Formation, so customers can spend more time learning from their data and innovating, rather than wrestling that data into functioning data lakes. AWS Lake Formation is available today and we’re excited to see how customers use it as one of the building blocks for growing and transforming their businesses and customer experience.”

AWS says there are no additional charges required to use AWS Lake Formation, and customers pay only for the underlying AWS services used.

AWS Lake Formation is available today in Asia Pacific (Tokyo), Europe (Ireland), US East (Ohio), US East (N. Virginia), and US West (Oregon), with additional regions coming soon.

Story image
16 Oct
APAC lights the way for women in executive roles
Organisations in Asia Pacific and the United States have more women in management than organisations in Europe – and globally, female representation on boards has doubled in the space of just 10 years.More
Download image
ESG puts Juniper Networks security solutions to the test
With a multitude of solutions on the market, ESG decided to use malware attacks to evaluate market solutions like Juniper Networks’ automated threat detection and remediation.More
Story image
14 Oct
IBM announces z15 with new data privacy capabilities
The IBM z15 is a new enterprise platform delivering the ability to manage the privacy of customer data across hybrid multicloud environments.More
Story image
18 Oct
CCL and Commvault: when partnership breeds success
At the Commvault GO event in Denver this week, we sat down with CCL and Commvault to discuss the relationship between the two companies, the next steps for CCL and how the partnership played into achieving success.More
Story image
24 Sep
You're invited to QNAP 2020 TechDay: Leveraging digital technologies to transform your business
QNAP 2020 TechDay will demonstrate its latest technologies to help businesses succeed in digital transformation, and to help them realise the near-limitless potential of future IT trends.More
Story image
16 Oct
Commvault launches Metallic, a next generation SaaS venture
With Metallic, Commvault proposes that customers are able to protect their on-premises, cloud-based, and hybrid file and application data with the SaaS solution.More