Remove Measurement Remove Modeling Remove Risk Management
article thumbnail

Why you should care about debugging machine learning models

O'Reilly on Data

Not least is the broadening realization that ML models can fail. And that’s why model debugging, the art and science of understanding and fixing problems in ML models, is so critical to the future of ML. Because all ML models make mistakes, everyone who cares about ML should also care about model debugging. [1]

article thumbnail

Managing machine learning in the enterprise: Lessons from banking and health care

O'Reilly on Data

In recent posts, we described requisite foundational technologies needed to sustain machine learning practices within organizations, and specialized tools for model development, model governance, and model operations/testing/monitoring. Note that the emphasis of SR 11-7 is on risk management.). Image by Ben Lorica.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

AI brings complexity to cybersecurity and fraud

CIO Business Intelligence

The 2024 Security Priorities study shows that for 72% of IT and security decision makers, their roles have expanded to accommodate new challenges, with Risk management, Securing AI-enabled technology and emerging technologies being added to their plate. Ensuring diversity in data sources helps models make impartial decisions.

article thumbnail

5 tips for better business value from gen AI

CIO Business Intelligence

Set clear, measurable metrics around what you want to improve with generative AI, including the pain points and the opportunities, says Shaown Nandi, director of technology at AWS. In HR, measure time-to-hire and candidate quality to ensure AI-driven recruitment aligns with business goals.

Sales 143
article thumbnail

Where CIOs should place their 2025 AI bets

CIO Business Intelligence

Deloittes State of Generative AI in the Enterprise reports nearly 70% have moved 30% or fewer of their gen AI experiments into production, and 41% of organizations have struggled to define and measure the impacts of their gen AI efforts. Even this breakdown leaves out data management, engineering, and security functions.

article thumbnail

Sweat the small stuff: Data protection in the age of AI

CIO Business Intelligence

As concerns about AI security, risk, and compliance continue to escalate, practical solutions remain elusive. as AI adoption and risk increases, its time to understand why sweating the small and not-so-small stuff matters and where we go from here. isnt intentionally or accidentally exfiltrated into a public LLM model?

Risk 105
article thumbnail

What to Do When AI Fails

O'Reilly on Data

This article answers these questions, based on our combined experience as both a lawyer and a data scientist responding to cybersecurity incidents, crafting legal frameworks to manage the risks of AI, and building sophisticated interpretable models to mitigate risk. All predictive models are wrong at times?—just

Risk 364