Use Apache Iceberg in a data lake to support incremental data processing
AWS Big Data
MARCH 2, 2023
To set up and test this solution, we complete the following high-level steps: Set up an S3 bucket in the curated zone to store converted data in Iceberg table format. In our tests, we observed Athena scanned 50% or less data for a given query on an Iceberg table compared to original data before conversion to Iceberg format.
Let's personalize your content