AWS Big Data

SEPTEMBER 13, 2024

In this post, we share how we built a well-governed and scalable data engineering platform using Amazon EMR for financial features generation. Joel Farvault is Principal Specialist SA Analytics for AWS with 25 years’ experience working on enterprise architecture, data governance and analytics, mainly in the financial services industry.

Interactive 84

Interactive Strategy Cost-Benefit Data Governance 84

AWS Big Data

AUGUST 1, 2024

However, you might face significant challenges when planning for a large-scale data warehouse migration. Data engineers are crucial for schema conversion and data transformation, and DBAs can handle cluster configuration and workload monitoring. Platform architects define a well-architected platform.

Data Warehouse 96

Data Warehouse KPI Optimization Cost-Benefit 96

AWS Big Data

JULY 31, 2023

Customers often use many SQL scripts to select and transform the data in relational databases hosted either in an on-premises environment or on AWS and use custom workflows to manage their ETL. AWS Glue is a serverless data integration and ETL service with the ability to scale on demand.

Sales 52

Sales Data Warehouse Visualization Testing 52

AWS Big Data

OCTOBER 30, 2024

In the Driver Properties section, enter the parameters that you captured from Amazon DataZone: CredentialsProvider : The credentials provider to authenticate requests to AWS DataZoneDomainId : The ID of your Amazon DataZone domain DataZoneDomainRegion : The AWS Region where your domain is hosted. Lionel Pulickal is Sr.

Visualization 114

Visualization Data Lake Testing Data Governance 114

AWS Big Data

DECEMBER 4, 2024

This post explores how the shift to a data product mindset is being implemented, the challenges faced, and the early wins that are shaping the future of data management in the Institutional Division. Consumer feedback and demand drives creation and maintenance of the data product.

Metadata 88

Metadata Data Governance Data Quality Data-driven 88