Remove 05 python-libraries-for-data-engineers
article thumbnail

Handle UPSERT data operations using open-source Delta Lake and AWS Glue

AWS Big Data

Many customers need an ACID transaction (atomic, consistent, isolated, durable) data lake that can log change data capture (CDC) from operational data sources. There is also demand for merging real-time data into batch data. The Delta Lake layer ensures ACID compliance of the source data.