AWS Big Data

JUNE 21, 2023

A key pillar of AWS’s modern data strategy is the use of purpose-built data stores for specific use cases to achieve performance, cost, and scale. Deriving business insights by identifying year-on-year sales growth is an example of an online analytical processing (OLAP) query. To house our data, we need to define a data model.

Data Warehouse 83

Data Warehouse Data Lake OLAP Cost-Benefit 83

AWS Big Data

AUGUST 1, 2024

The data warehouse is highly business critical with minimal allowable downtime. We can determine the following are needed: An open data format ingestion architecture processing the source dataset and refining the data in the S3 data lake. The following figure shows a daily usage KPI. Vijay Bagur is a Sr.

Data Warehouse 92

Data Warehouse KPI Optimization Cost-Benefit 92

AWS Big Data

MARCH 20, 2023

The data from the Kinesis data stream is consumed by two applications: A Spark streaming application on Amazon EMR is used to write data from the Kinesis data stream to a data lake hosted on Amazon Simple Storage Service (Amazon S3) in a partitioned way.

Analytics 52

Analytics Slice and Dice Data Processing Data Lake 52

IBM Big Data Hub

SEPTEMBER 25, 2023

Uber understood that digital superiority required the capture of all their transactional data, not just a sampling. They stood up a file-based data lake alongside their analytical database. Because much of the work done on their data lake is exploratory in nature, many users want to execute untested queries on petabytes of data.

OLAP 86

OLAP Data Lake Data-driven Snapshot 86