AWS Big Data

MARCH 6, 2025

Copy and save the client ID and client secret needed later for the Streamlit application and the IAM Identity Center application to connect using the Redshift Data API. Generate the client secret and set sign-in redirect URL and sign-out URL to [link] (we will host the Streamlit application locally on port 8501).

Visualization 104

Visualization Sales Data Warehouse Management 104

AWS Big Data

JUNE 10, 2024

The producer account will host the EMR cluster and S3 buckets. The catalog account will host Lake Formation and AWS Glue. The consumer account will host EMR Serverless, Athena, and SageMaker notebooks. By using Data Catalog metadata federation, organizations can construct a sophisticated data architecture.

Data Lake 117

Data Lake Metadata Data Warehouse Data Processing 117

AWS Big Data

MARCH 7, 2024

At the same time, they need to optimize operational costs to unlock the value of this data for timely insights and do so with a consistent performance. With this massive data growth, data proliferation across your data stores, data warehouse, and data lakes can become equally challenging.

Data Lake 131

Data Lake Analytics Dashboards Metrics 131

AWS Big Data

JANUARY 22, 2024

Cost and resource efficiency – This is an area where Acast observed a reduction in data duplication, and therefore cost reduction (in some accounts, removing the copy of data 100%), by reading data across accounts while enabling scaling.

Data-driven 118

Data-driven Advertising Metadata Data Architecture 118

AWS Big Data

APRIL 28, 2023

When building a scalable data architecture on AWS, giving autonomy and ownership to the data domains are crucial for the success of the platform. Solution overview In the first post of this series, we explained how Novo Nordisk and AWS Professional Services built a modern data architecture based on data mesh tenets.

Data Governance 72

Data Governance Management Data-driven Analytics 72

AWS Big Data

JANUARY 21, 2025

The Lambda function will invoke the Amazon Titan Text Embeddings Model hosted in Amazon Bedrock , allowing for efficient and scalable embedding creation. This architecture simplifies various use cases, including recommendation engines, personalized chatbots, and fraud detection systems.

Data Processing 111

Data Processing Metrics Data-driven Publishing 111

AWS Big Data

APRIL 28, 2025

In your project, in the navigation pane, choose Data. Choose the plus sign, and for Add data source , choose Add connection. For Data source name , enter postgresql_source. For Host , enter the host name of your Aurora PostgreSQL database cluster. Select PostgreSQL. For Database , enter your database name.

Big Data 68

Big Data Visualization Data Processing Data Processing 68