TDAN

JUNE 5, 2024

In the ever-evolving landscape of data management, two key concepts have emerged as essential components for organizations seeking to harness the power of their data: data marts and data lakes. Understanding the distinctions […]

Data Lake 52

Data Lake Management Data Architecture Big Data 52

Peter James Thomas

APRIL 9, 2019

This increase was driven in part by the launch of my new Maths & Science section , articles from which claimed no fewer than 6 slots in the 2018 top 10 articles, when measured by hits [1]. This is my selection of the articles that I enjoyed writing most, which does not always overlap with the most popular ones. May onwards.

Data-driven 49

Data-driven Statistics Data Science Big Data 49

IBM Big Data Hub

AUGUST 4, 2023

When workers get their hands on the right data, it not only gives them what they need to solve problems, but also prompts them to ask, “What else can I do with data?” ” through a truly data literate organization. What is data democratization?

Data Architecture 59

Data Architecture Data Lake Machine Learning Data Governance 59

Cloudera

JUNE 30, 2022

Over the past decade, Cloudera has enabled multi-function analytics on data lakes through the introduction of the Hive table format and Hive ACID. Companies, on the other hand, have continued to demand highly scalable and flexible analytic engines and services on the data lake, without vendor lock-in.

Data Lake 88

Data Lake Data Warehouse Data Architecture Metadata 88

CIO Business Intelligence

APRIL 12, 2023

After walking his executive team through the data hops, flows, integrations, and processing across different ingestion software, databases, and analytical platforms, they were shocked by the complexity of their current data architecture and technology stack. It isn’t easy.

Machine Learning 145

Machine Learning Cost-Benefit Data-driven Strategy 145

Smart Data Collective

AUGUST 9, 2019

However, more mainstream games use big data as well. Fortnite is one of the games that uses big data to offer great service to its customers. Even Forbes Tech Council has written about the benefits of data lakes in Fortnite. As it turns out, Epic uses a data lake for this massive undertaking.

Big Data 96

Big Data Data Lake Data Architecture Machine Learning 96

TDAN

MARCH 15, 2022

In her groundbreaking article, How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh, Zhamak Dehghani made the case for building data mesh as the next generation of enterprise data platform architecture.

Data Lake 69

Data Lake Enterprise Data Architecture Data Governance 69

Cloudera

SEPTEMBER 15, 2022

Mark: The first element in the process is the link between the source data and the entry point into the data platform. At Ramsey International (RI), we refer to that layer in the architecture as the foundation, but others call it a staging area, raw zone, or even a source data lake. What is a data fabric?

Data Lake 83

Data Lake Data Architecture Data-driven Data Warehouse 83

Data Virtualization

JANUARY 19, 2023

Reading Time: 2 minutes Today, many businesses are modernizing their on-premises data warehouses or cloud-based data lakes using Microsoft Azure Synapse Analytics. Unfortunately, with data spread.

Data Analytics 52

Data Analytics Data Lake Data Warehouse Analytics 52

Cloudera

OCTOBER 7, 2021

This blog will focus more on providing a high level overview of what a data mesh architecture is and the particular CDF capabilities that can be used to enable such an architecture, rather than detailing technical implementation nuances that are beyond the scope of this article. Introduction to the Data Mesh Architecture.

Metadata 124

Metadata Cost-Benefit Enterprise Interactive 124

IBM Big Data Hub

JANUARY 18, 2023

In another decade, the internet and mobile started the generate data of unforeseen volume, variety and velocity. It required a different data platform solution. Hence, Data Lake emerged, which handles unstructured and structured data with huge volume. This article endeavors to alleviate those confusions.

Data Lake 52

Data Lake Data Warehouse Data-driven Metadata 52

Data Virtualization

JANUARY 20, 2022

Reading Time: 3 minutes We are always focused on making things “Go Fast” but how do we make sure we future proof our data architecture and ensure that we can “Go Far”? Technologies change constantly within organizations and having a flexible architecture is key.

Data Architecture 52

Data Architecture Data Integration Technology Management 52

TDAN

MAY 31, 2022

As we enter a new cloud-first era, advancements in technology have helped companies capture and capitalize on data as much as possible. Deciding between which cloud architecture to use has always been a debate between two options: data warehouses and data lakes.

Data Lake 52

Data Lake Data Warehouse Technology Data Architecture 52

Data Virtualization

JANUARY 20, 2022

Reading Time: 3 minutes We are always focused on making things “Go Fast” but how do we make sure we future proof our data architecture and ensure that we can “Go Far”? Technologies change constantly within organizations and having a flexible architecture is key.

Data Architecture 52

Data Architecture Data Integration Technology Management 52

Octopai

AUGUST 24, 2022

The term “mesh”’s latest appearance is in the concept of data mesh , coined by Zhamak Dehghani in her landmark 2019 article, How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh. How is data mesh a mesh? .

Strategy 92

Strategy Data-driven Sales Enterprise 92

TDAN

JUNE 16, 2020

When companies embark on a journey of becoming data-driven, usually, this goes hand in and with using new technologies and concepts such as AI and data lakes or Hadoop and IoT. Suddenly, the data warehouse team and their software are not the only ones anymore that turn data […].

Data Warehouse 52

Data Warehouse Data-driven Data Lake IoT 52

Peter James Thomas

APRIL 3, 2020

For anyone who is unaware, the title of the article echoes a 1953 Nature paper [1] , which was instead “of considerable biological interest” [2]. I have been very much focussing on the start of a data journey in a series of recent articles about Data Strategy [3]. Another article from peterjamesthomas.com.

Dashboards 61

Dashboards Reporting Sales Data Lake 61

Peter James Thomas

MAY 3, 2019

Data Architecture / Infrastructure. When I first started focussing on the data arena, Data Warehouses were state of the art. More recently Big Data architectures, including things like Data Lakes , have appeared and – at least in some cases – begun to add significant value.

Strategy 55

Strategy Data Architecture Data Quality Data Strategy 55

Data Virtualization

JUNE 19, 2024

The post Navigating the New Data Landscape: Trends and Opportunities appeared first on Data Management Blog - Data Integration and Modern Data Management Articles, Analysis and Information. At TDWI, we see companies collecting traditional structured.

Data Integration 59

Data Integration Management Analytics Data Architecture 59

Data Virtualization

NOVEMBER 17, 2022

Data catalogs also seek to be the. The post Choosing a Data Catalog: Data Map or Data Delivery App? appeared first on Data Virtualization blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Data Integration 59

Data Integration Management Data Lake IT 59

Data Virtualization

SEPTEMBER 19, 2024

The post Accelerate Data Access: How the Denodo Platform Powers High-Performance Queries appeared first on Data Management Blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Data Integration 52

Data Integration Optimization Management Data Lake 52

Data Virtualization

MAY 19, 2023

Reading Time: 11 minutes The post Data Strategies for Getting Greater Business Value from Distributed Data appeared first on Data Management Blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Data Strategy 52

Data Strategy Strategy Data Integration Management 52

Data Virtualization

JULY 12, 2023

The post The Energy Utilities Series: Challenge 2 – Electrification (Post 3 of 6) appeared first on Data Management Blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Data Integration 52

Data Integration Management Data Lake Data Architecture 52

Data Virtualization

JUNE 2, 2023

The post The Energy Utilities Series: Challenges and Opportunities of Decarbonization (Post 2 of 6) appeared first on Data Management Blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Data Integration 52

Data Integration Internet of Things Management Data Lake 52

Data Virtualization

JANUARY 14, 2022

For the delivery a single data mart with. The post Go Fast Using Data Virtualization appeared first on Data Virtualization blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Data Warehouse 52

Data Warehouse Metrics Data Integration Management 52

Data Virtualization

MARCH 18, 2024

Facing a range of regulations covering privacy, such as the General Data Protection Regulation (GDPR) and the Health Insurance Portability and Accountability Act (HIPAA), to financial regulations such as Dodd-Frank and Basel II, to.

Insurance 52

Insurance Data Integration Management Data Lake 52

Data Virtualization

MARCH 31, 2022

Listen to “Is Data Fabric the Ideal Approach for Effective Data Management?” ” The post Data Fabric Approach for Effective Data Management appeared first on Data Virtualization blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Management 52

Management Data Integration Marketing Data Lake 52

Data Virtualization

APRIL 27, 2023

The post Revolutionizing Financial Institutions: How Data Virtualization Enables Tailored Products and Services appeared first on Data Management Blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Data Integration 52

Data Integration Management Data Lake Data Warehouse 52

Data Virtualization

MAY 13, 2022

Reading Time: 3 minutes Join our conversation on All Things Data with Robin Tandon, Director of Product Marketing at Denodo (EMEA & LATAM), with a focus on how data virtualization helps customers realize true economic benefits in as little as six weeks.

Data Integration 52

Data Integration Marketing Management Data Warehouse 52

TDAN

JULY 17, 2024

They are interesting to an extent, but mostly, they feel like a late-night re-run and remind me that data work is hard. If you haven’t heard about metrics stores yet, they’re “newish,” so you likely will. So, what is a metrics store? Most of the young vendors trying to create this category will tell you that […]

Metrics 52

Metrics OLAP Data Lake Data Architecture 52

Peter James Thomas

AUGUST 18, 2018

No this article has not escaped from my Maths & Science section , it is actually about data matters. The image at the start of this article is of an Ichthyosaur (top) and Dolphin. That was the Science, here comes the Technology… A Brief Hydrology of Data Lakes.

Data Lake 63

Data Lake Data Warehouse Data mining Statistics 63

CIO Business Intelligence

AUGUST 7, 2024

The company started its New Analytics Era initiative by migrating its data from outdated SQL servers to a modern AWS data lake. It then built a cutting-edge cloud-based analytics platform, designed with an innovative data architecture.

IT 119

IT Insurance Cost-Benefit Testing 119

Data Virtualization

NOVEMBER 24, 2022

The post The Data Warehouse is Dead, Long Live the Data Warehouse, Part II appeared first on Data Virtualization blog - Data Integration and Modern Data Management Articles, Analysis and Information.

Data Warehouse 52

Data Warehouse Data Integration Technology Management 52

AWS Big Data

APRIL 28, 2025

Many organizations turn to data lakes for the flexibility and scale needed to manage large volumes of structured and unstructured data. Recently, NI embarked on a journey to transition their legacy data lake from Apache Hive to Apache Iceberg. NIs leading brands, Top10.com

Data Lake 67

Data Lake Metadata Cost-Benefit Snapshot 67

CIO Business Intelligence

APRIL 23, 2025

This unification of data engineering, data science and business intelligence workflows contrasts sharply with traditional approaches that required cumbersome data movement between disparate systems (e.g., data lake for exploration, data warehouse for BI, separate ML platforms).

Insurance 109

Insurance Digital Transformation Data Quality Data Lake 109