Remove Machine Learning Remove Measurement Remove Testing
article thumbnail

Why you should care about debugging machine learning models

O'Reilly on Data

For all the excitement about machine learning (ML), there are serious impediments to its widespread adoption. In addition to newer innovations, the practice borrows from model risk management, traditional model diagnostics, and software testing. Not least is the broadening realization that ML models can fail. Residual analysis.

article thumbnail

Managing machine learning in the enterprise: Lessons from banking and health care

O'Reilly on Data

As companies use machine learning (ML) and AI technologies across a broader suite of products and services, it’s clear that new tools, best practices, and new organizational structures will be needed. What cultural and organizational changes will be needed to accommodate the rise of machine and learning and AI?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

The Race For Data Quality in a Medallion Architecture

DataKitchen

Data is typically organized into project-specific schemas optimized for business intelligence (BI) applications, advanced analytics, and machine learning. This involves setting up automated, column-by-column quality tests to quickly identify deviations from expected values and catch emerging issues before they impact downstream layers.

article thumbnail

Measuring Bias in Machine Learning: The Statistical Bias Test

DataCamp

This tutorial will define statistical bias in a machine learning model and demonstrate how to perform the test on synthetic data.

article thumbnail

The DataOps Vendor Landscape, 2021

DataKitchen

Testing and Data Observability. We have also included vendors for the specific use cases of ModelOps, MLOps, DataGovOps and DataSecOps which apply DataOps principles to machine learning, AI, data governance, and data security operations. . Dagster / ElementL — A data orchestrator for machine learning, analytics, and ETL. .

Testing 304
article thumbnail

What are model governance and model operations?

O'Reilly on Data

A look at the landscape of tools for building and deploying robust, production-ready machine learning models. Our surveys over the past couple of years have shown growing interest in machine learning (ML) among organizations from diverse industries. Model operations, testing, and monitoring.

Modeling 256
article thumbnail

Escaping POC Purgatory: Evaluation-Driven Development for AI Systems

O'Reilly on Data

Weve seen this across dozens of companies, and the teams that break out of this trap all adopt some version of Evaluation-Driven Development (EDD), where testing, monitoring, and evaluation drive every decision from the start. People have been building data products and machine learning products for the past couple of decades.

Testing 174