Remove 2023 Remove Data Architecture Remove Metadata
article thumbnail

Run Apache XTable in AWS Lambda for background conversion of open table formats

AWS Big Data

This post was co-written with Dipankar Mazumdar, Staff Data Engineering Advocate with AWS Partner OneHouse. Data architecture has evolved significantly to handle growing data volumes and diverse workloads. This allows the existing data to be interpreted as if it were originally written in any of these formats.

Metadata 105
article thumbnail

AWS re:Invent 2023 Amazon Redshift Sessions Recap

AWS Big Data

Amazon Redshift powers data-driven decisions for tens of thousands of customers every day with a fully managed, AI-powered cloud data warehouse, delivering the best price-performance for your analytics workloads. What’s new with Amazon Redshift Want to learn more about the most recent features launched in Amazon Redshift?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Amazon Redshift announcements at AWS re:Invent 2023 to enable analytics on all your data

AWS Big Data

For example, earlier in the year, we announced speed ups for string-based data processing up to 63x compared to alternative compression encodings such as LZO (Lempel-Ziv-Oberhumer) or ZStandard. At AWS re:Invent 2023, we extended data sharing capabilities to launch multi-data warehouse writes in preview.

article thumbnail

Migrate an existing data lake to a transactional data lake using Apache Iceberg

AWS Big Data

Over the years, data lakes on Amazon Simple Storage Service (Amazon S3) have become the default repository for enterprise data and are a common choice for a large set of users who query data for a variety of analytics and machine leaning use cases. Analytics use cases on data lakes are always evolving.

Data Lake 122
article thumbnail

KGF 2023: Bikes To The Moon, Datastrophies, Abstract Art And A Knowledge Graph Forum To Embrace Them All

Ontotext

It enriched their understanding of the full spectrum of knowledge graph business applications and the technology partner ecosystem needed to turn data into a competitive advantage. Content and data management solutions based on knowledge graphs are becoming increasingly important across enterprises.

article thumbnail

Insights from Gartner Data & Analytics Summit Orlando 2023

Alation

Ehtisham Zaidi, Gartner’s VP of data management, and Robert Thanaraj, Gartner’s director of data management, gave an update on the fabric versus mesh debate in light of what they call the “active metadata era” we’re currently in. The foundations of successful data governance The state of data governance was also top of mind.

article thumbnail

2023 Predictions: Data Trends That Will Dominate Business Agenda in APAC

Cloudera

As more industries mature digitally and widely adopt AI and machine learning technologies, 2023 will be a pivotal year for organizations looking to deploy emerging tech solutions company-wide to fulfill business objectives. 1- Treating data as a strategic business asset . Find out more about CDP for modern data architectures here.