CIO Business Intelligence

MARCH 25, 2025

Data debt that undermines decision-making In Digital Trailblazer , I share a story of a private company that reported a profitable year to the board, only to return after the holiday to find that data quality issues and calculation mistakes turned it into an unprofitable one.

Risk 140

Risk Cost-Benefit Data-driven Digital Transformation 140

Cloudera

SEPTEMBER 6, 2022

Data has continued to grow both in scale and in importance through this period, and today telecommunications companies are increasingly seeing data architecture as an independent organizational challenge, not merely an item on an IT checklist. Why telco should consider modern data architecture. The challenges.

Data Architecture 84

Data Architecture Cost-Benefit Digital Transformation Business Driver 84

DataKitchen

AUGUST 3, 2021

The data mesh design pattern breaks giant, monolithic enterprise data architectures into subsystems or domains, each managed by a dedicated team. The communication between business units and data professionals is usually incomplete and inconsistent. Introduction to Data Mesh. Source: Thoughtworks.

Data Architecture 246

Data Architecture Data Lake Cost-Benefit Data Warehouse 246

AWS Big Data

JUNE 6, 2023

AWS Glue Data Quality allows you to measure and monitor the quality of data in your data repositories. It’s important for business users to be able to see quality scores and metrics to make confident business decisions and debug data quality issues. An AWS Glue crawler crawls the results.

Data Quality 78

Data Quality Metrics Visualization Dashboards 78

AWS Big Data

OCTOBER 9, 2024

Some customers build custom in-house data parity frameworks to validate data during migration. Others use open source data quality products for data parity use cases. This takes away important person hours from the actual migration effort into building and maintaining a data parity framework.

Data Quality 95

Data Quality Data Lake Data Warehouse Metrics 95

Cloudera

JUNE 29, 2023

To improve the way they model and manage risk, institutions must modernize their data management and data governance practices. Implementing a modern data architecture makes it possible for financial institutions to break down legacy data silos, simplifying data management, governance, and integration — and driving down costs.

Data Architecture 85

Data Architecture Risk Management Risk Management 85

AWS Big Data

DECEMBER 4, 2024

With this launch, you can query data regardless of where it is stored with support for a wide range of use cases, including analytics, ad-hoc querying, data science, machine learning, and generative AI. We’ve simplified data architectures, saving you time and costs on unnecessary data movement, data duplication, and custom solutions.

Data Analytics 85

Data Analytics Analytics Data Lake Data Quality 85

AWS Big Data

OCTOBER 10, 2023

Due to the volume, velocity, and variety of data being ingested in data lakes, it can get challenging to develop and maintain policies and procedures to ensure data governance at scale for your data lake. Data confidentiality and data quality are the two essential themes for data governance.

Data Quality 103

Data Quality Data Governance Data Lake Testing 103

AWS Big Data

SEPTEMBER 11, 2024

This complex process involves suppliers, logistics, quality control, and delivery. This post describes how HPE Aruba automated their Supply Chain management pipeline, and re-architected and deployed their data solution by adopting a modern data architecture on AWS.

Data Architecture 96

Data Architecture Optimization Data Warehouse Metadata 96

Cloudera

AUGUST 30, 2022

Legacy data sharing involves proliferating copies of data, creating data management, and security challenges. Data quality issues deter trust and hinder accurate analytics. Modern data architectures. Deploying modern data architectures. Forrester ).

Data Architecture 79

Data Architecture Data Lake Data Warehouse Metadata 79

Jim Harris

JANUARY 1, 2016

1 — Investigate Data quality is not exactly a riddle wrapped in a mystery inside an enigma. However, understanding your data is essential to using it effectively and improving its quality. In order for you to make sense of those data elements, you require business context.

Data Quality 61

Data Quality Data Governance Cost-Benefit ROI 61

IBM Big Data Hub

JULY 13, 2023

When we talk about data integrity, we’re referring to the overarching completeness, accuracy, consistency, accessibility, and security of an organization’s data. Together, these factors determine the reliability of the organization’s data. Data quality Data quality is essentially the measure of data integrity.

Data Quality 63

Data Quality Data Integration Metadata Cost-Benefit 63

Smart Data Collective

FEBRUARY 23, 2021

To help you identify and resolve these mistakes, we’ve put together this guide on the various big data mistakes that marketers tend to make. Big Data Mistakes You Must Avoid. Here are some common big data mistakes you must avoid to ensure that your campaigns aren’t affected. Ignoring Data Quality.

Big Data 142

Big Data Visualization Data Quality Data-driven 142

CIO Business Intelligence

DECEMBER 11, 2024

Furthermore, generally speaking, data should not be split across multiple databases on different cloud providers to achieve cloud neutrality. Not my original quote, but a cardinal sin of cloud-native data architecture is copying data from one location to another.

Management 111

Management Data Governance Data Science Reporting 111

AWS Big Data

APRIL 8, 2025

In modern data architectures, Apache Iceberg has emerged as a popular table format for data lakes, offering key features including ACID transactions and concurrent write support. Both operations target the same partition based on customer_id , leading to potential conflicts because theyre modifying an overlapping dataset.

Snapshot 116

Snapshot Management Metadata Big Data 116

Data Virtualization

FEBRUARY 28, 2020

Too often the design of new data architectures is based on old principles: they are still very data-store-centric. They consist of many physical data stores in which data is stored repeatedly and redundantly. Over time, new types of data stores,

Data Architecture 52

Data Architecture Data Lake Digital Transformation Data Quality 52

IBM Big Data Hub

AUGUST 4, 2023

Today, the way businesses use data is much more fluid; data literate employees use data across hundreds of apps, analyze data for better decision-making, and access data from numerous locations. This results in more marketable AI-driven products and greater accountability.

Data Architecture 59

Data Architecture Data Lake Machine Learning Data Governance 59

CIO Business Intelligence

MARCH 24, 2023

The Business Application Research Center (BARC) warns that data governance is a highly complex, ongoing program, not a “big bang initiative,” and it runs the risk of participants losing trust and interest over time. Informatica Axon Informatica Axon is a collection hub and data marketplace for supporting programs.

Data Governance 142

Data Governance Management Metadata Data Quality 142

AWS Big Data

NOVEMBER 22, 2024

This enables you to extract insights from your data without the complexity of managing infrastructure. dbt has emerged as a leading framework, allowing data teams to transform and manage data pipelines effectively. With dbt, teams can define data quality checks and access controls as part of their transformation workflow.

Data Lake 83

Data Lake Data Warehouse Cost-Benefit Data Transformation 83

CIO Business Intelligence

JANUARY 20, 2023

A big part of preparing data to be shared is an exercise in data normalization, says Juan Orlandini, chief architect and distinguished engineer at Insight Enterprises. Data formats and data architectures are often inconsistent, and data might even be incomplete.

Data Lake 135

Data Lake Data-driven Finance Data Architecture 135

erwin

JULY 12, 2019

It also helps enterprises put these strategic capabilities into action by: Understanding their business, technology and data architectures and their inter-relationships, aligning them with their goals and defining the people, processes and technologies required to achieve compliance.

Data Governance 110

Data Governance Management Metadata Risk Management 110

AWS Big Data

FEBRUARY 27, 2024

Governance and self-service – The Bluestone Data Platform provides a governed, curated, and self-service avenue for all data use cases. AWS services like AWS Lake Formation in conjunction with Atlan help govern data access and policies. Ben Vengerovsky is a Data Platform Product Manager at Bluestone.

Data-driven 106

Data-driven Data Lake Data Quality Data Governance 106

Cloudera

MAY 14, 2024

More than that, though, harnessing the potential of these technologies requires quality data—without it, the output from an AI implementation can end up inefficient or wholly inaccurate. Meaningful results, and a scalable, flexible data architecture demand a ‘true’ hybrid cloud approach to data management.

Data Architecture 99

Data Architecture Data Governance Unstructured Data Structured Data 99

CIO Business Intelligence

MARCH 9, 2022

They conveniently store data in a flat architecture that can be queried in aggregate and offer the speed and lower cost required for big data analytics. On the other hand, they don’t support transactions or enforce data quality. Each ETL step risks introducing failures or bugs that reduce data quality. .

Data Lake 119

Data Lake Unstructured Data Data Warehouse Big Data 119

erwin

OCTOBER 24, 2019

The complexities of metadata management can be addressed with a strong data management strategy coupled with metadata management software to enable the data quality the business requires. Organizations then can take a data-driven approach to business transformation , speed to insights, and risk management.

Metadata 104

Metadata Management Data-driven Data Architecture 104

AWS Big Data

JANUARY 15, 2025

Need for a data mesh architecture Because entities in the EUROGATE group generate vast amounts of data from various sourcesacross departments, locations, and technologiesthe traditional centralized data architecture struggles to keep up with the demands for real-time insights, agility, and scalability.

IoT 100

IoT Machine Learning Metadata Data-driven 100

TDAN

JUNE 18, 2019

The first step to fixing any problem is to understand that problem—this is a significant point of failure when it comes to data. Most organizations agree that they have data issues, categorized as data quality. However, this definition is […].

Data Quality 90

Data Quality Data Architecture IT Data Governance 90

TDAN

APRIL 16, 2019

The phrase “data architecture” often has different connotations across an organization depending on where their job role is. For instance, most of my earlier career roles were within IT, though throughout the last decade or so, has been primarily working with business line staff.

Data Architecture 40

Data Architecture IT Data Quality Data Governance 40

CIO Business Intelligence

NOVEMBER 29, 2022

A sea of complexity For years, data ecosystems have gotten more complex due to discrete (and not necessarily strategic) data-platform decisions aimed at addressing new projects, use cases, or initiatives. Layering technology on the overall data architecture introduces more complexity.

Data Architecture 111

Data Architecture Data Integration IoT Data-driven 111

DataKitchen

OCTOBER 11, 2021

First, you must understand the existing challenges of the data team, including the data architecture and end-to-end toolchain. Based on business rules, additional data quality tests check the dimensional model after the ETL job completes. A DataOps implementation project consists of three steps.

Testing 152

Testing Metadata Dashboards Statistics 152

IBM Big Data Hub

APRIL 10, 2023

A well-designed data architecture should support business intelligence and analysis, automation, and AI—all of which can help organizations to quickly seize market opportunities, build customer value, drive major efficiencies, and respond to risks such as supply chain disruptions.

Strategy 85

Strategy Data Architecture Cost-Benefit Reporting 85

erwin

DECEMBER 6, 2019

Enterprise Data Management Methodology : DG is foundational to enterprise data management. metadata management, enterprise data architecture, data quality management), DG will be a struggle. Without the other essential components (e.g.,

Data Governance 145

Data Governance Metadata Enterprise Data-driven 145

CIO Business Intelligence

JUNE 9, 2023

A few years ago, Gartner found that “organizations estimate the average cost of poor data quality at $12.8 million per year.’” Beyond lost revenue, data quality issues can also result in wasted resources and a damaged reputation. Learn more about data architectures in my article here.

Strategy 116

Strategy Management Key Performance Indicator Cost-Benefit 116

CIO Business Intelligence

JULY 28, 2023

Modern data platforms can stop enterprises from drowning in a sea of data by integrating AI and ML to enable more efficient, accessible data. It also helps to overcome the challenges of shadow data, which enterprise security policies do not recognize or cover.

Risk 98

Risk Management Data mining Cost-Benefit 98

CIO Business Intelligence

NOVEMBER 7, 2023

This team has helped the company to align data across business areas; establish a data governance function to enable trust, privacy, and security of the data; and invest in the talent and technology needed to build a holistic data architecture across Lexmark, Gupta says.

Data Warehouse 142

Data Warehouse Digital Transformation Data-driven Reporting 142

Cloudera

SEPTEMBER 15, 2022

The consumption of the data should be supported through an elastic delivery layer that aligns with demand, but also provides the flexibility to present the data in a physical format that aligns with the analytic application, ranging from the more traditional data warehouse view to a graph view in support of relationship analysis.

Data Lake 83

Data Lake Data Architecture Data-driven Data Warehouse 83

erwin

SEPTEMBER 17, 2020

Here are six benefits of automating end-to-end data lineage: Reduced Errors and Operational Costs. Data quality is crucial to every organization. Automated data capture can significantly reduce errors when compared to manual entry.

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143