Major developments in cloud, data analytics, databases and warehousing are in store for 2022, according to new predictions from Ahana.
Ahana cofounder and chief product officer, Dipti Borkar, along with cofounder and chief executive officer, Steven Mih, predict key trends for data in the year ahead include open data lake analytics stack, open source, data engineering, more SaaS and containers.
"The COVID-19 pandemic continues to propel businesses to make strategic data-driven shifts. Today more companies are augmenting the traditional cloud data warehouse with cloud data lakes for much greater flexibility and affordability," says Borkar.
"Combined with more analytics and AI applications, powerful, cloud-native open source technologies are empowering data platform teams to analyse that data faster, easier and more cost-effectively in SaaS environments," he says.
OpenFlake - the Open Data Lake for Warehouse Workloads
Data warehouses like Snowflake are the new Teradata with proprietary formats," Borkar says.
"2022 will be about the Open Data Lake Analytics stack that allows for open formats, open source, open cloud and no vendor lock-in," he says.
More Open source Behind Analytics - AI
As the momentum behind the Open Data Lake Analytics stack to power, analytics - AI applications continues to grow, Borkar says we'll see a bigger focus on leveraging Open source to address flexibility and cost limitations from traditional enterprise data warehouses.
"Open source cloud-native technologies like Presto, Apache Spark, Superset, and Hudi will power AI platforms at a larger scale, opening up new use cases and workloads," he says.
Database Engineering is Cool Again
With the rise of the Data Lake tide, 2022 will make database engineering cool again, Borkar says.
"The database benchmarking wars will be back and the database engineers who can build a data lake stack with data warehousing capabilities (transactions, security) but without the compromises (lock-in, cost) will win."
A Post-Pandemic Data-Driven Strategic Shift to Out-Of-The-Box Solutions
Borkar says the pandemic has brought about massive change across every industry and the successful pandemic companies were able to pivot from their traditional business model.
"In 2022 we will see less time spent on managing complex, distributed systems and more time focused on delivering business-driven innovation. That means more out-of-the-box cloud solution providers that reduce cloud complexities so companies can focus on delivering value to their customers," he says.
More SaaS, More Containers
When it comes to 2022, Borkar says abstracting the complexities of infrastructure will be the name of the game.
"Containers provide scalability, portability, extensibility and availability advantages, and technologies like Kubernetes alleviate the pain around building, delivering, and scaling containerised apps. As the SaaS space continues to explode, we'll see even more innovation in the container space."
Meanwhile, Mih says investment and adoption of managed services for Open source will soar in 2022.
"More companies will adopt managed services for open source in 2022 as more cloud-native open source technologies become mainstream (Spark, Kafka, Presto, Hudi, Superset)," he says.
"Open source companies offering easier-to-use, managed service versions of installed software enable companies to take advantage of these powerful systems without the resource overhead so they can focus on business-driven innovation."