Use Apache Iceberg in a data lake to support incremental data processing
AWS Big Data
MARCH 2, 2023
Apache Iceberg is designed to support these features on cost-effective petabyte-scale data lakes on Amazon S3. To set up and test this solution, we complete the following high-level steps: Set up an S3 bucket in the curated zone to store converted data in Iceberg table format. tableProperty("format-version", "2").partitionedBy($"product_category").createOrReplace()
Let's personalize your content