Remove Data Science Remove Experimentation Remove Uncertainty
article thumbnail

Business Strategies for Deploying Disruptive Tech: Generative AI and ChatGPT

Rocket-Powered Data Science

Those F’s are: Fragility, Friction, and FUD (Fear, Uncertainty, Doubt). These changes may include requirements drift, data drift, model drift, or concept drift. encouraging and rewarding) a culture of experimentation across the organization. Fragility occurs when a built system is easily “broken” when some component is changed.

Strategy 290
article thumbnail

Machine Learning Product Management: Lessons Learned

Domino Data Lab

This Domino Data Science Field Note covers Pete Skomoroch ’s recent Strata London talk. Pete indicates, in both his November 2018 and Strata London talks, that ML requires a more experimental approach than traditional software engineering. These steps also reflect the experimental nature of ML product management.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Uncertainties: Statistical, Representational, Interventional

The Unofficial Google Data Science Blog

by AMIR NAJMI & MUKUND SUNDARARAJAN Data science is about decision making under uncertainty. Some of that uncertainty is the result of statistical inference, i.e., using a finite sample of observations for estimation. But there are other kinds of uncertainty, at least as important, that are not statistical in nature.

article thumbnail

Towards optimal experimentation in online systems

The Unofficial Google Data Science Blog

Crucially, it takes into account the uncertainty inherent in our experiments. Experiments, Parameters and Models At Youtube, the relationships between system parameters and metrics often seem simple — straight-line models sometimes fit our data well. It is a big picture approach, worthy of your consideration.

article thumbnail

AI Product Management After Deployment

O'Reilly on Data

Therefore, the PM should consider the team that will reconvene whenever it is necessary to build out or modify product features that: ensure that inputs are present and complete, establish that inputs are from a realistic (expected) distribution of the data, and trigger alarms, model retraining, or shutdowns (when necessary).

article thumbnail

Data for Enterprise AI: at the very forefront of innovation

Cloudera

It’s been a year filled with disruption and uncertainty. Businesses had to literally switch operations, and enable better collaboration and access to data in an instant — while streamlining processes to accommodate a whole new way of doing things. One day we were all going to the office, and the next we were working from home.

article thumbnail

Changing assignment weights with time-based confounders

The Unofficial Google Data Science Blog

Instead, we focus on the case where an experimenter has decided to run a full traffic ramp-up experiment and wants to use the data from all of the epochs in the analysis. When there are changing assignment weights and time-based confounders, this complication must be considered either in the analysis or the experimental design.