O'Reilly on Data

MARCH 31, 2020

If you’re already a software product manager (PM), you have a head start on becoming a PM for artificial intelligence (AI) or machine learning (ML). You’re responsible for the design, the product-market fit, and ultimately for getting the product out the door. That data is never as stable as we’d like to think.

Management 363

Management Machine Learning Experimentation Metrics 363

DataKitchen

APRIL 18, 2025

Welcome to the Data Quality Coffee Series with Uncle Chip Pull up a chair, pour yourself a fresh cup, and get ready to talk shopbecause its time for Data Quality Coffee with Uncle Chip. This video series is where decades of data experience meet real-world challenges, a dash of humor, and zero fluff.

Data Quality 152

Data Quality Dashboards Testing IT 152

DataKitchen

MAY 14, 2024

Data Observability and Data Quality Testing Certification Series We are excited to invite you to a free four-part webinar series that will elevate your understanding and skills in Data Observation and Data Quality Testing. Don’t miss this opportunity to transform your data practices.

Data Quality 195

Data Quality Testing Metrics Measurement 195

DataKitchen

MARCH 20, 2025

We’ve identified two distinct types of data teams: process-centric and data-centric. Understanding this framework offers valuable insights into team efficiency, operational excellence, and data quality. Process-centric data teams focus their energies predominantly on orchestrating and automating workflows.

Data Quality 161

Data Quality Testing Metrics Management 161

DataKitchen

DECEMBER 9, 2024

A Drug Launch Case Study in the Amazing Efficiency of a Data Team Using DataOps How a Small Team Powered the Multi-Billion Dollar Acquisition of a Pharma Startup When launching a groundbreaking pharmaceutical product, the stakes and the rewards couldnt be higher. data engineers delivered over 100 lines of code and 1.5

Data Quality 161

Data Quality Data Lake Testing Statistics 161

David Menninger's Analyst Perspectives

NOVEMBER 19, 2024

To improve data reliability, enterprises were largely dependent on data-quality tools that required manual effort by data engineers, data architects, data scientists and data analysts.  With the aim of rectifying that situation, Bigeye’s founders set out to build a business around data observability.

Data Quality 130

Data Quality Dashboards Data-driven Software 130

CIO Business Intelligence

NOVEMBER 27, 2024

Once the province of the data warehouse team, data management has increasingly become a C-suite priority, with data quality seen as key for both customer experience and business performance. But along with siloed data and compliance concerns , poor data quality is holding back enterprise AI projects.

Enterprise 141

Enterprise Data Quality Structured Data Modeling 141

AWS Big Data

DECEMBER 4, 2024

Globally, financial institutions have been experiencing similar issues, prompting a widespread reassessment of traditional data management approaches. One major trend, embraced by many financial institutions, has been the adoption of the data mesh architecture and the shift towards treating data as a product.

Metadata 105

Metadata Data Governance Data Quality Data-driven 105

CIO Business Intelligence

DECEMBER 12, 2024

Confidence from business leaders is often focused on the AI models or algorithms, Erolin adds, not the messy groundwork like data quality, integration, or even legacy systems. Data quality is a problem that is going to limit the usefulness of AI technologies for the foreseeable future, Brown adds.

IT 134

IT Data Quality Experimentation Machine Learning 134

David Menninger's Analyst Perspectives

MAY 14, 2025

Data governance is integral to an overall data intelligence strategy. Good data governance provides guardrails that enable enterprises to act fast while protecting the business from risks related to regulatory requirements, data-quality issues and data-reliability concerns.

Data Governance 130

Data Governance Data Quality Data-driven Metadata 130

CIO Business Intelligence

APRIL 8, 2025

As technology and business leaders, your strategic initiatives, from AI-powered decision-making to predictive insights and personalized experiences, are all fueled by data. Yet, despite growing investments in advanced analytics and AI, organizations continue to grapple with a persistent and often underestimated challenge: poor data quality.

Data Quality 102

Data Quality Data-driven Key Performance Indicator Metadata 102

DataKitchen

AUGUST 6, 2024

DataKitchen’s Data Quality TestGen found 18 potential data quality issues in a few minutes (including install time) on data.boston.gov building permit data! Imagine a free tool that you can point at any dataset and find actionable data quality issues immediately! first appeared on DataKitchen.

Data Quality 124

Data Quality Testing Cost-Benefit Software 124

AWS Big Data

AUGUST 8, 2024

They establish data quality rules to ensure the extracted data is of high quality for accurate business decisions. These rules commonly assess the data based on fixed criteria reflecting the current business state. In this post, we demonstrate how this feature works with an example.

Data Quality 116

Data Quality Statistics Visualization Metrics 116

AWS Big Data

APRIL 3, 2024

Today, we are pleased to announce that Amazon DataZone is now able to present data quality information for data assets. Other organizations monitor the quality of their data through third-party solutions. Additionally, Amazon DataZone now offers APIs for importing data quality scores from external systems.

Data Quality 119

Data Quality Visualization Metadata Metrics 119

DataKitchen

NOVEMBER 18, 2022

Question: What is the difference between Data Quality and Observability in DataOps? Data Quality is static. It is the measure of data sets at any point in time. A financial analogy: Data Quality is your Balance Sheet, Data Observability is your Cash Flow Statement.

Data Quality 130

Data Quality Testing Measurement Data Integration 130

Smart Data Collective

APRIL 20, 2022

However, conversion rates aren’t nearly that high for companies that have just started marketing their products on Amazon with the internal PPC platform. It takes a lot of split-testing and data collection to optimize your strategy to approach these types of conversion rates. However, it is important to make sure the data is reliable.

Data Quality 128

Data Quality Analytics Testing Sales 128

CIO Business Intelligence

DECEMBER 10, 2024

times greater productivity improvements than their peers, Accenture notes, which should motivate CIOs to continue investing in AI strategies. Many early gen AI wins have centered around productivity improvements. These reinvention-ready organizations have 2.5 times higher revenue growth and 2.4

Sales 143

Sales Metrics Data-driven Unstructured Data 143

DataKitchen

JULY 12, 2023

The Syntax, Semantics, and Pragmatics Gap in Data Quality Validate Testing Data Teams often have too many things on their ‘to-do’ list. Each unit will have unique data sets with specific data quality test requirements. One of the standout features of DataOps TestGen is the power to auto-generate data tests.

Data Quality 130

Data Quality Testing Manufacturing Finance 130

DataKitchen

MAY 10, 2024

The Five Use Cases in Data Observability: Ensuring Data Quality in New Data Sources (#1) Introduction to Data Evaluation in Data Observability Ensuring their quality and integrity before incorporating new data sources into production is paramount.

Data Quality 124

Data Quality Interactive Dashboards Testing 124

AWS Big Data

AUGUST 15, 2024

Data quality is crucial in data pipelines because it directly impacts the validity of the business insights derived from the data. Today, many organizations use AWS Glue Data Quality to define and enforce data quality rules on their data at rest and in transit.

Data Quality 111

Data Quality Visualization Metadata Key Performance Indicator 111

datapine

NOVEMBER 27, 2019

Spreadsheets finally took a backseat to actionable and insightful data visualizations and interactive business dashboards. The rise of self-service analytics democratized the data product chain. Companies are no longer wondering if data visualizations improve analyses but what is the best way to tell each data-story.

Business Intelligence 361

Business Intelligence Analytics Prescriptive Analytics Data Quality 361

CIO Business Intelligence

MARCH 13, 2024

But hearing those voices, and how to effectively respond, is dictated by the quality of data available, and understanding how to properly utilize it. “We We know in financial services and in a lot of verticals, we have a whole slew of data quality challenges,” he says. Traditionally, AI data quality has been a challenge.”

Data Quality 105

Data Quality Digital Transformation Enterprise Marketing 105

David Menninger's Analyst Perspectives

OCTOBER 2, 2024

Data mesh has four key principles—domain-oriented ownership, data as a product, self-serve data infrastructure and federated governance—each of which is being widely adopted. The terms “data as a product” and “data product” are often used interchangeably but have distinct meanings.

Key Performance Indicator 130

Key Performance Indicator Data Governance Data Warehouse Enterprise 130

CIO Business Intelligence

NOVEMBER 18, 2024

If the data volume is insufficient, it’s impossible to build robust ML algorithms. If the data quality is poor, the generated outcomes will be useless. By partnering with industry leaders, businesses can acquire the resources needed for efficient data discovery, multi-environment management, and strong data protection.

Data-driven 111

Data-driven Machine Learning ROI Uncertainty 111

DataKitchen

APRIL 13, 2021

Companies that implement DataOps find that they are able to reduce cycle times from weeks (or months) to days, virtually eliminate data errors, increase collaboration, and dramatically improve productivity. However, the rush to rebrand existing products with a DataOps message has created some marketplace confusion. Data breaks.

Testing 300

Testing Machine Learning Consulting Data Science 300

CIO Business Intelligence

JANUARY 7, 2025

Transformational CIOs continuously invest in their operating model by developing product management, design thinking, agile, DevOps, change management, and data-driven practices. 2025 will be the year when generative AI needs to generate value, says Louis Landry, CTO at Teradata.

Digital Transformation 143

Digital Transformation Experimentation Cost-Benefit Strategy 143

O'Reilly on Data

MARCH 18, 2020

The update sheds light on what AI adoption looks like in the enterprise— hint: deployments are shifting from prototype to production—the popularity of specific techniques and tools, the challenges experienced by adopters, and so on. Most companies that were evaluating or experimenting with AI are now using it in production deployments.

Enterprise 349

Enterprise Deep Learning Data Governance Risk 349

AWS Big Data

OCTOBER 9, 2024

Some customers build custom in-house data parity frameworks to validate data during migration. Others use open source data quality products for data parity use cases. This takes away important person hours from the actual migration effort into building and maintaining a data parity framework.

Data Quality 114

Data Quality Data Lake Data Warehouse Metrics 114

CIO Business Intelligence

NOVEMBER 4, 2024

Survey respondents ranked ESG reporting as a top area needing AI skills development, even above R&D and product development. Data security, data quality, and data governance still raise warning bells Data security remains a top concern. Cost, by comparison, ranks a distant 10th.

Marketing 128

Marketing Data Quality Data Governance Digital Transformation 128

AWS Big Data

DECEMBER 4, 2024

They’re taking data they’ve historically used for analytics or business reporting and putting it to work in machine learning (ML) models and AI-powered applications. Introducing the next generation of SageMaker The rise of generative AI is changing how data and AI teams work together. Having confidence in your data is key.

Data Analytics 104

Data Analytics Analytics Data Lake Data Quality 104

CIO Business Intelligence

JANUARY 5, 2025

Research from Gartner, for example, shows that approximately 30% of generative AI (GenAI) will not make it past the proof-of-concept phase by the end of 2025, due to factors including poor data quality, inadequate risk controls, and escalating costs. [1] Reliability and security is paramount.

Enterprise 124

Enterprise Cost-Benefit Unstructured Data Data Quality 124

DataKitchen

MAY 10, 2024

The Five Use Cases in Data Observability: Mastering Data Production (#3) Introduction Managing the production phase of data analytics is a daunting challenge. Overseeing multi-tool, multi-dataset, and multi-hop data processes ensures high-quality outputs.

Metrics 124

Metrics Testing Data Quality Dashboards 124

O'Reilly on Data

SEPTEMBER 24, 2018

If this dirty data proliferates and propagates to other systems, we open Pandora’s box of unintended consequences. The DataOps team needs to watch out for data issues and fix them before they get copied around. These data quality issues bring a new level of potential problems for real-time systems.

Enterprise 261

Enterprise Big Data Data Quality Unstructured Data 261

DataKitchen

APRIL 18, 2024

Introducing DataKitchen’s Open Source Data Observability Software Today, we announce that we have open-sourced two complete, feature-rich products that solve the data observability problem: DataOps Observervability and DataOps TestGen. DataOps TestGen is the silent warrior that ensures the integrity of your data.

Testing 117

Testing Data Quality Enterprise Data Analytics 117

O'Reilly on Data

MARCH 24, 2020

You may picture data scientists building machine learning models all day, but the common trope that they spend 80% of their time on data preparation is closer to the truth. This definition of low-quality data defines quality as a function of how much work is required to get the data into an analysis-ready form.

Machine Learning 364

Machine Learning Statistics Data Quality Data Collection 364