Remove Consulting Remove Experimentation Remove Uncertainty
article thumbnail

Escaping POC Purgatory: Evaluation-Driven Development for AI Systems

O'Reilly on Data

ML apps needed to be developed through cycles of experimentation (as were no longer able to reason about how theyll behave based on software specs). The skillset and the background of people building the applications were realigned: People who were at home with data and experimentation got involved!

Testing 174
article thumbnail

AI Product Management After Deployment

O'Reilly on Data

AI PMs should consult with Trust & Safety and Security teams to combine the best principles and technical solutions with existing AI product functionality. In some specific domains—such as financial services or medicine—no easy technical solutions exist.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

How to create a culture of innovation

CIO Business Intelligence

Prioritize time for experimentation. It requires bold bets and a willingness to persevere despite setbacks, criticism, and uncertainty,’’ wrote McKinsey senior partners Laura Furstenthal and Erik Roth in a recent blog post. “By Iliya Rybchin, partner, Elixirr Consulting. Elixirr Consulting.

article thumbnail

Lessons from the field: How Generative AI is shaping software development in 2023

CIO Business Intelligence

If care is not taken in the intake process, there could be huge risks if that security scheme or other info are inadvertently pushed to generative AI, says Jim Kohl, Devops Consultant at GAIG. Best practices and education Currently, there are no established best practices for leveraging AI in software development.

Software 119
article thumbnail

The DX roadmap: David Rogers on driving digital transformation success

CIO Business Intelligence

How can enterprises attain these in the face of uncertainty? Rogers: This is one of two fundamental challenges of corporate innovation — managing innovation under high uncertainty and managing innovation far from the core — that I have studied in my work advising companies and try to tackle in my new book The Digital Transformation Roadmap.

article thumbnail

13 IT resolutions for 2024

CIO Business Intelligence

CIOs are readying for another demanding year, anticipating that artificial intelligence, economic uncertainty, business demands, and expectations for ever-increasing levels of speed will all be in play for 2024. Chris Bowers,CIO of Boston Consulting Group, puts it this way: “In 2024, we’re going to go after generative AI very aggressively.

IT 144
article thumbnail

20 issues shaping generative AI strategies today

CIO Business Intelligence

Douglas Merrill, a partner at management consulting firm McKinsey & Co., No good guidance yet As CIOs seek to bring control and risk management to technology that’s generating widespread interest and plenty of experimentation, they’re doing so without pre-existing guidance and support. There’s a lot of uncertainty.