AWS Big Data

MARCH 10, 2023

They enable transactions on top of data lakes and can simplify data storage, management, ingestion, and processing. These transactional data lakes combine features from both the data lake and the data warehouse. One important aspect to a successful data strategy for any organization is data governance.

Data Lake 121

Data Lake Sales Data Warehouse Snapshot 121

Cloudera

JANUARY 30, 2024

Simply put, many organizations fail to realize the value of AI because they rely on AI tools and data science that is being applied to data which is faulty to begin with. Trusted AI begins with trusted data What resolves the data challenge and fuels data-driven AI in manufacturing?

Manufacturing 81

Manufacturing Contextual Data IoT Internet of Things 81

Peter James Thomas

JANUARY 8, 2020

The recently launched Data Strategy Review Service is just one example. White Papers can be based on themes arising from articles published here, they can feature findings from de novo research commissioned in the data arena, or they can be on a topic specifically requested by the client.

Consulting 61

Consulting Data-driven Publishing Data Strategy 61

Peter James Thomas

MARCH 9, 2020

In the thirteen years that have passed since the beginning of 2007, I have helped ten organisations to develop commercially-focused Data Strategies [1]. However, in this initial article, I wanted to to focus on one tool that I have used as part of my Data Strategy engagements; a Data Maturity Model.

Measurement 67

Measurement Data Strategy Strategy Modeling 67

AWS Big Data

AUGUST 1, 2024

Success criteria alignment by all stakeholders (producers, consumers, operators, auditors) is key for successful transition to a new Amazon Redshift modern data architecture. The success criteria are the key performance indicators (KPIs) for each component of the data workflow.

Data Warehouse 114

Data Warehouse KPI Optimization Cost-Benefit 114

Peter James Thomas

APRIL 9, 2019

Overall the total number of articles and new pages I published exceeded 2017’s figures to claim the second spot behind 2009; our first year in business. How to Spot a Flawed Data Strategy. What the similarities (and differences) between Ichthyosaurs and Dolphins can tell us about different types of Data Architectures.

Data-driven 49

Data-driven Statistics Data Science Big Data 49

Octopai

APRIL 19, 2021

Donna Burbank is a Data Management Consultant and acts as the Managing Director at Global Data Strategy, Ltd. Her Twitter page is filled with interesting articles, webinars, reports, and current news surrounding data management. TDAN stands for The Data Administration Newsletter. It is published by Robert S.

Metadata 59

Metadata Management Business Intelligence Data Governance 59

AWS Big Data

JULY 16, 2024

Zurich also configured a connector for their existing SIEM to query OpenSearch, which further allows distributed processing from on premises, and enables aggregation of data across data sources. She currently serves as the Global Head of Cyber Data Management at Zurich Group.

Insurance 129

Insurance Management Cost-Benefit Optimization 129

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

AWS Big Data

JULY 14, 2023

These inputs reinforced the need of a unified data strategy across the FinOps teams. We decided to build a scalable data management product that is based on the best practices of modern data architecture. This enabled producers to publish data products that were curated and authoritative assets for their domain.

Finance 98

Finance Metadata Big Data Recreation/Entertainment 98

AWS Big Data

SEPTEMBER 13, 2023

The Analytics specialty practice of AWS Professional Services (AWS ProServe) helps customers across the globe with modern data architecture implementations on the AWS Cloud. Ravi helps customers with enterprise data strategy initiatives across insurance, airlines, pharmaceutical, and financial services industries.

Data Lake 110

Data Lake Data Processing Metadata Snapshot 110

AWS Big Data

APRIL 3, 2024

In this example, we use Amazon EMR Serverless in combination with the open source library Pydeequ to act as an external system for data quality. If the asset has AWS Glue Data Quality enabled, you can now quickly visualize the data quality score directly in the catalog search pane.

Data Quality 118

Data Quality Visualization Metadata Metrics 118

AWS Big Data

FEBRUARY 26, 2025

Amazon SageMaker Lakehouse provides an open data architecture that reduces data silos and unifies data across Amazon Simple Storage Service (Amazon S3) data lakes, Redshift data warehouses, and third-party and federated data sources.

Analytics 62

Analytics Data Lake Metadata Data Warehouse 62

Jet Global

OCTOBER 1, 2024

With Simba drivers acting as a bridge between Trino and your BI or ETL tools, you can unlock enhanced data connectivity, streamline analytics, and drive real-time decision-making. Let’s explore why this combination is a game-changer for data strategies and how it maximizes the value of Trino and Apache Iceberg for your business.

Dashboards 52

Dashboards Data Lake Reporting Cost-Benefit 52

AWS Big Data

APRIL 29, 2025

While enabling organization-wide efficiency, the team also applied these principles to the data architecture, making sure that CLEA itself operates frugally. After evaluating various tools, we built a serverless data transformation pipeline using Amazon Athena and dbt. However, our initial data architecture led to challenges.

Data Transformation 55

Data Transformation Cost-Benefit Testing Data Lake 55

AWS Big Data

APRIL 28, 2025

When the user interacts with resources within SageMaker Unified Studio, it generates IAM session credentials based on the users effective profile in the specific project context, and then users can use tools such as Amazon Athena or Amazon Redshift to query the relevant data. SageMaker Unified Studio supports Lake Formation hybrid mode.

Metadata 62

Metadata Data Lake Big Data Publishing 62

Jet Global

MAY 9, 2025

The Challenge of Capturing Human Input Modern data architectures, like Microsoft Fabric, excel in collecting and processing system-generated data. Whether transactional data, operational metrics, or system logs, these platforms are optimized to deliver analytical insights from structured sources.

Visualization 52

Visualization Dashboards Reporting Data Architecture 52