DataKitchen

APRIL 18, 2025

Welcome to the Data Quality Coffee Series with Uncle Chip Pull up a chair, pour yourself a fresh cup, and get ready to talk shopbecause its time for Data Quality Coffee with Uncle Chip. This video series is where decades of data experience meet real-world challenges, a dash of humor, and zero fluff.

Data Quality 152

Data Quality Dashboards Testing IT 152

DataKitchen

SEPTEMBER 18, 2024

A DataOps Approach to Data Quality The Growing Complexity of Data Quality Data quality issues are widespread, affecting organizations across industries, from manufacturing to healthcare and financial services. 73% of data practitioners do not trust their data (IDC).

Scorecard 177

Scorecard Data Quality Measurement Testing 177

DataKitchen

DECEMBER 9, 2024

A Drug Launch Case Study in the Amazing Efficiency of a Data Team Using DataOps How a Small Team Powered the Multi-Billion Dollar Acquisition of a Pharma Startup When launching a groundbreaking pharmaceutical product, the stakes and the rewards couldnt be higher. data engineers delivered over 100 lines of code and 1.5

Data Quality 161

Data Quality Data Lake Testing Statistics 161

Anmut

JANUARY 30, 2025

They made us realise that building systems, processes and procedures to ensure quality is built in at the outset is far more cost effective than correcting mistakes once made. How about data quality? Redman and David Sammon, propose an interesting (and simple) exercise to measure data quality.

Data Quality 52

Data Quality Cost-Benefit Statistics Data-driven 52

DataKitchen

MARCH 20, 2025

We’ve identified two distinct types of data teams: process-centric and data-centric. Understanding this framework offers valuable insights into team efficiency, operational excellence, and data quality. Process-centric data teams focus their energies predominantly on orchestrating and automating workflows.

Data Quality 161

Data Quality Testing Metrics Management 161

AWS Big Data

AUGUST 8, 2024

They establish data quality rules to ensure the extracted data is of high quality for accurate business decisions. These rules commonly assess the data based on fixed criteria reflecting the current business state. In this post, we demonstrate how this feature works with an example.

Data Quality 116

Data Quality Statistics Visualization Metrics 116

DataKitchen

AUGUST 6, 2024

DataKitchen’s Data Quality TestGen found 18 potential data quality issues in a few minutes (including install time) on data.boston.gov building permit data! Imagine a free tool that you can point at any dataset and find actionable data quality issues immediately! first appeared on DataKitchen.

Data Quality 124

Data Quality Testing Cost-Benefit Software 124

DataKitchen

JUNE 21, 2024

Navigating the Storm: How Data Engineering Teams Can Overcome a Data Quality Crisis Ah, the data quality crisis. It’s that moment when your carefully crafted data pipelines start spewing out numbers that make as much sense as a cat trying to bark. You’ve got yourself a recipe for data disaster.

Data Quality 130

Data Quality Measurement Metrics Data Collection 130

DataKitchen

NOVEMBER 18, 2022

Question: What is the difference between Data Quality and Observability in DataOps? Data Quality is static. It is the measure of data sets at any point in time. A financial analogy: Data Quality is your Balance Sheet, Data Observability is your Cash Flow Statement.

Data Quality 130

Data Quality Testing Measurement Data Integration 130

DataKitchen

JULY 12, 2023

The Syntax, Semantics, and Pragmatics Gap in Data Quality Validate Testing Data Teams often have too many things on their ‘to-do’ list. Each unit will have unique data sets with specific data quality test requirements. One of the standout features of DataOps TestGen is the power to auto-generate data tests.

Data Quality 130

Data Quality Testing Manufacturing Finance 130

DataKitchen

MAY 10, 2024

The Five Use Cases in Data Observability: Ensuring Data Quality in New Data Sources (#1) Introduction to Data Evaluation in Data Observability Ensuring their quality and integrity before incorporating new data sources into production is paramount.

Data Quality 124

Data Quality Interactive Dashboards Testing 124

DataKitchen

DECEMBER 9, 2022

Some of the key benefits of DataOps include: Improved speed and reliability: By automating and streamlining data-related tasks and processes, DataOps can help organizations to accelerate the development and deployment of data-driven solutions, and to improve the reliability of their data analytics and machine learning initiatives.

Machine Learning 130

Machine Learning Data-driven Optimization Data Analytics 130

AWS Big Data

OCTOBER 9, 2024

Some customers build custom in-house data parity frameworks to validate data during migration. Others use open source data quality products for data parity use cases. This takes away important person hours from the actual migration effort into building and maintaining a data parity framework.

Data Quality 113

Data Quality Data Lake Data Warehouse Metrics 113

AWS Big Data

JUNE 6, 2023

We are excited to announce the General Availability of AWS Glue Data Quality. Our journey started by working backward from our customers who create, manage, and operate data lakes and data warehouses for analytics and machine learning. It takes days for data engineers to identify and implement data quality rules.

Data Quality 98

Data Quality Statistics Data Lake Visualization 98

datapine

NOVEMBER 27, 2019

Companies are no longer wondering if data visualizations improve analyses but what is the best way to tell each data-story. 2020 will be the year of data quality management and data discovery: clean and secure data combined with a simple and powerful presentation. 1) Data Quality Management (DQM).

Business Intelligence 361

Business Intelligence Analytics Prescriptive Analytics Data Quality 361

AWS Big Data

DECEMBER 4, 2024

Data teams struggle to find a unified approach that enables effortless discovery, understanding, and assurance of data quality and security across various sources. Having confidence in your data is key. Automate data profiling and data quality recommendations, monitor data quality rules, and receive alerts.

Data Analytics 102

Data Analytics Analytics Data Lake Data Quality 102

AWS Big Data

OCTOBER 10, 2023

Due to the volume, velocity, and variety of data being ingested in data lakes, it can get challenging to develop and maintain policies and procedures to ensure data governance at scale for your data lake. Data confidentiality and data quality are the two essential themes for data governance.

Data Quality 111

Data Quality Data Governance Data Lake Testing 111

Alation

JANUARY 20, 2022

Several weeks ago (prior to the Omicron wave), I got to attend my first conference in roughly two years: Dataversity’s Data Quality and Information Quality Conference. Ryan Doupe, Chief Data Officer of American Fidelity, held a thought-provoking session that resonated with me. Step 2: Data Definitions.

Data Quality 94

Data Quality Data Governance Metrics Statistics 94

DataKitchen

APRIL 13, 2021

Read the complete blog below for a more detailed description of the vendors and their capabilities. This is not surprising given that DataOps enables enterprise data teams to generate significant business value from their data. QuerySurge – Continuously detect data issues in your delivery pipelines. Data breaks.

Testing 300

Testing Machine Learning Consulting Data Science 300

AWS Big Data

JUNE 6, 2023

Poor-quality data can lead to incorrect insights, bad decisions, and lost opportunities. AWS Glue Data Quality measures and monitors the quality of your dataset. It supports both data quality at rest and data quality in AWS Glue extract, transform, and load (ETL) pipelines.

Data Quality 94

Data Quality Data Lake Visualization Data-driven 94

DataKitchen

MAY 7, 2024

DataKitchen Training And Certification Offerings For Individual contributors with a background in Data Analytics/Science/Engineering Overall Ideas and Principles of DataOps DataOps Cookbook (200 page book over 30,000 readers, free): DataOps Certificatio n (3 hours, online, free, signup online): DataOps Manifesto (over 30,000 signatures) One (..)

Data Quality 161

Data Quality Testing Metrics Consulting 161

O'Reilly on Data

MARCH 24, 2020

NPR put it well : “the gold standard of scientific studies is to make a single hypothesis, gather data to test it, and analyze the results to see if it holds up. By Wansink’s own admission in the blog post, that’s not what happened in his lab.” The importance of automating data preparation.

Machine Learning 364

Machine Learning Statistics Data Quality Data Collection 364

Dataiku

SEPTEMBER 13, 2023

In this blog , David Talaga (Product Marketing at Dataiku) explains that shopping in a supermarket could be similar to searching for the best data product for your use case. As a data analyst, the same mechanism applies to the data products you are looking for: Can I trust it?

Data Quality 85

Data Quality Marketing IT 85

datapine

MAY 28, 2019

Maximum security and data privacy. The post Top 5 Tips For Conducting Successful BI Projects With Examples & Templates appeared first on BI Blog | Data Visualization & Analytics Blog | datapine. Reducing the reporting time. Challenges : Reducing IT involvement.

Business Intelligence 317

Business Intelligence KPI Dashboards Reporting 317

Smarten

NOVEMBER 26, 2024

If the data is not easily gathered, managed and analyzed, it can overwhelm and complicate decision-makers. Data insight techniques provide a comprehensive set of tools, data analysis and quality assurance features to allow users to identify errors, enhance data quality, and boost productivity.’

Machine Learning 64

Machine Learning Data Quality Predictive Modeling Metadata 64

DataKitchen

MAY 10, 2024

Harnessing Data Observability Across Five Key Use Cases The ability to monitor, validate, and ensure data accuracy across its lifecycle is not just a luxury—it’s a necessity. Data Evaluation Before new data sets are introduced into production environments, they must be thoroughly evaluated and cleaned.

Data Quality 141

Data Quality Dashboards Strategy Testing 141

Smarten

APRIL 25, 2024

How Can I Ensure Data Quality and Gain Data Insight Using Augmented Analytics? There are many business issues surrounding the use of data to make decisions. One such issue is the inability of an organization to gather and analyze data.

Data Quality 64

Data Quality Analytics Machine Learning Visualization 64

Cloudera

NOVEMBER 13, 2024

This guarantees data quality and automates the laborious, manual processes required to maintain data reliability. Robust Data Catalog: Organizations can create company-wide consistency with a self-creating, self-updating data catalog.

Metadata 90

Metadata Management Data Governance Data-driven 90

datapine

JANUARY 24, 2021

This can include a multitude of processes, like data profiling, data quality management, or data cleaning, but we will focus on tips and questions to ask when analyzing data to gain the most cost-effective solution for an effective business strategy. 4) How can you ensure data quality?

IT 317

IT Statistics KPI Data-driven 317

DataKitchen

MAY 10, 2024

Data ingestion monitoring, a critical aspect of Data Observability, plays a pivotal role by providing continuous updates and ensuring high-quality data feeds into your systems. This process is critical as it ensures data quality from the onset. Ensuring all data arrives on time and is of the right quality.

Data Quality 130

Data Quality Testing Software Dashboards 130

Ontotext

NOVEMBER 16, 2023

In the first part of this series of technological posts, we talked about what SHACL is and how you can set up validation for your data. Tacking the data quality issue — bit by bit or incrementally There are two main approaches to validating your data, which would be dependent on the specific implementation.

Data Quality 69

Data Quality Reporting Testing Technology 69

DataKitchen

JANUARY 25, 2022

Ensuring that data is available, secure, correct, and fit for purpose is neither simple nor cheap. Companies end up paying outside consultants enormous fees while still having to suffer the effects of poor data quality and lengthy cycle time. . When a job is automated, there is little advantage to outsourcing. .

Consulting 244

Consulting Testing Data Lake Data Quality 244

DataKitchen

AUGUST 3, 2021

Secure and permissioned – data is protected from unauthorized users. Governed – designed with data quality and management workflows that empower data usage. If you have worked in the data industry, you already know that while decentralization offers many benefits it also comes with a cost.

Data Architecture 246

Data Architecture Data Lake Cost-Benefit Data Warehouse 246

erwin

SEPTEMBER 2, 2024

Added data quality capability ready for an AI era Data quality has never been more important than as we head into this next AI-focused era. erwin Data Quality is the data quality heart of erwin Data Intelligence. erwin Data Quality is the data quality heart of erwin Data Intelligence.

Data Quality 52

Data Quality Data Processing Measurement Metadata 52

BI-Survey

NOVEMBER 4, 2024

Discover the strategic importance of data lineage in modern business ecosystems. Learn how data lineage enhances data quality, ensures compliance with GDPR & CCPA, and boosts operational efficiency for Data & Analytics teams.

Data Quality 52

Data Quality Management Analytics Data-driven 52

Rocket-Powered Data Science

FEBRUARY 15, 2023

I have developed a few rules to help drive quick wins and facilitate success in data-intensive and AI ( e.g., Generative AI and ChatGPT) deployments. Clean it, annotate it, catalog it, and bring it into the data family (connect the dots and see what happens).

Strategy 290

Strategy Experimentation Uncertainty Machine Learning 290

datapine

JANUARY 21, 2020

Enhanced data quality. One of the most clear-cut and powerful benefits of data intelligence for business is the fact that it empowers the user to squeeze every last drop of value from their data. With so much information and such little time, intelligent data analytics can seem like an impossible feat.

Business Intelligence 259

Business Intelligence Reporting Cost-Benefit Dashboards 259