O'Reilly on Data

MARCH 31, 2020

You’re responsible for the design, the product-market fit, and ultimately for getting the product out the door. Instead of writing code with hard-coded algorithms and rules that always behave in a predictable manner, ML engineers collect a large number of examples of input and output pairs and use them as training data for their models.

Management 363

Management Machine Learning Experimentation Metrics 363

Occam's Razor

MAY 22, 2006

This post is a primer on the delightful world of testing and experimentation (A/B, Multivariate, and a new term from me: Experience Testing). Experimentation and testing help us figure out we are wrong, quickly and repeatedly and if you think about it that is a great thing for our customers, and for our employers. Counter claims?

Experimentation 103

Experimentation Testing Optimization Measurement 103

CIO Business Intelligence

OCTOBER 24, 2024

In some cases, the AI add-ons will be subscription models, like Microsoft Copilot, and sometimes, they will be free, like Salesforce Einstein, he says. Forrester also recently predicted that 2025 would see a shift in AI strategies , away from experimentation and toward near-term bottom-line gains. growth in device spending.

IT 133

IT Data-driven Recreation/Entertainment Experimentation 133

Rocket-Powered Data Science

FEBRUARY 15, 2023

While generative AI has been around for several years , the arrival of ChatGPT (a conversational AI tool for all business occasions, built and trained from large language models) has been like a brilliant torch brought into a dark room, illuminating many previously unseen opportunities. So, if you have 1 trillion data points (g.,

Strategy 290

Strategy Experimentation Uncertainty Machine Learning 290

Occam's Razor

JULY 18, 2011

To not have it as an active part of your marketing portfolio is sub-optimal. The only requirement is that your mental model (and indeed, company culture) should be solidly rooted in permission marketing. Embrace permission marketing and email will be a surprising and loyal BFF. Every fiber of your being.

Metrics 138

Metrics Marketing Measurement Cost-Benefit 138

O'Reilly on Data

APRIL 4, 2024

The race to the top is no longer driven by who has the best product or the best business model, but by who has the blessing of the venture capitalists with the deepest pockets—a blessing that will allow them to acquire the most customers the most quickly, often by providing services below cost. That is true product-market fit.

Marketing 232

Marketing Finance Modeling Experimentation 232

Occam's Razor

SEPTEMBER 30, 2013

Frameworks, because if I can teach someone a new mental model, a different way of thinking, they can be incredibly successful. 2: The Secret to Content Marketing Success. Content marketing is all the rage these days. Everyone is contenting a lot of content about content marketing. Two things I love a lot: 1. It should be.

Marketing Analytics 156

Marketing Analytics Marketing Visualization Analytics 156

O'Reilly on Data

OCTOBER 13, 2020

Our previous articles in this series introduce our own take on AI product management , discuss the skills that AI product managers need , and detail how to bring an AI product to market. In Bringing an AI Product to Market , we distinguished the debugging phase of product development from pre-deployment evaluation and testing.

Management 308

Management Machine Learning Metrics Modeling 308

O'Reilly on Data

MARCH 18, 2020

Whether it’s controlling for common risk factors—bias in model development, missing or poorly conditioned data, the tendency of models to degrade in production—or instantiating formal processes to promote data governance, adopters will have their work cut out for them as they work to establish reliable AI production lines.

Enterprise 347

Enterprise Deep Learning Data Governance Risk 347

O'Reilly on Data

SEPTEMBER 15, 2020

In my book, I introduce the Technical Maturity Model: I define technical maturity as a combination of three factors at a given point of time. Outputs from trained AI models include numbers (continuous or discrete), categories or classes (e.g., spam or not-spam), probabilities, groups/segments, or a sequence (e.g.,

Advertising 362

Advertising Cost-Benefit ROI Machine Learning 362

CIO Business Intelligence

JANUARY 14, 2025

For CIOs leading enterprise transformations, portfolio health isnt just an operational indicator its a real-time pulse on time-to-market and resilience in a digital-first economy. Understanding and tracking the right software delivery metrics is essential to inform strategic decisions that drive continuous improvement.

Enterprise 119

Enterprise Technology Metrics Measurement 119

DataKitchen

APRIL 13, 2021

As a result, vendors that market DataOps capabilities have grown in pace with the popularity of the practice. Please let us know if we have forgotten anyone or if you have any comments (marketing@datakitchen.io). Hydrosphere.io — Deploys batch Spark functions, machine-learning models, and assures the quality of end-to-end pipelines.

Testing 300

Testing Machine Learning Consulting Data Science 300

Rocket-Powered Data Science

JULY 6, 2021

MLOps takes the modeling, algorithms, and data wrangling out of the experimental “one off” phase and moves the best models into deployment and sustained operational phase. the monitoring of very important operational ML characteristics: data drift, concept drift, and model security).

Machine Learning 279

Machine Learning Data-driven Deep Learning IoT 279

Occam's Razor

OCTOBER 12, 2017

The tiny downside of this is that our parents likely never had to invest as much in constant education, experimentation and self-driven investment in core skills. Like this blog, it will be particularly relevant for those who are in digital analytics and digital marketing. None focusses on digital marketing or analytics.

Marketing 138

Marketing Analytics Machine Learning Strategy 138

CIO Business Intelligence

MARCH 5, 2025

Two years of experimentation may have given rise to several valuable use cases for gen AI , but during the same period, IT leaders have also learned that the new, fast-evolving technology isnt something to jump into blindly. Make sure you know if they use predictive versus generative models. And if it does work, its all upside.

Testing 99

Testing Measurement Technology Experimentation 99

Occam's Razor

AUGUST 13, 2012

A couple weeks back I'd requested the nice folks following me on Google+ and Facebook to submit their most important digital marketing and analytics questions. Some tools do pan-session analysis better than others, and there are a number of relatively new analytics solutions on the market today. What's possible to measure.

Modeling 125

Modeling Metrics Data Quality Data-driven 125

CIO Business Intelligence

JULY 18, 2024

The early bills for generative AI experimentation are coming in, and many CIOs are finding them more hefty than they’d like — some with only themselves to blame. According to IDC’s “ Generative AI Pricing Models: A Strategic Buying Guide ,” the pricing landscape for generative AI is complicated by “interdependencies across the tech stack.”

Cost-Benefit 136

Cost-Benefit Experimentation Consulting Modeling 136

O'Reilly on Data

MARCH 23, 2023

It’s important to understand that ChatGPT is not actually a language model. It’s a convenient user interface built around one specific language model, GPT-3.5, is one of a class of language models that are sometimes called “large language models” (LLMs)—though that term isn’t very helpful. with specialized training.

IT 346

IT Modeling Testing Risk 346

AWS Big Data

JANUARY 15, 2025

EUROGATEs data science team aims to create machine learning models that integrate key data sources from various AWS accounts, allowing for training and deployment across different container terminals. Insights from ML models can be channeled through Amazon DataZone to inform internal key decision makers internally and external partners.

IoT 100

IoT Machine Learning Metadata Data-driven 100

DataRobot Blog

JANUARY 17, 2023

Recently, a prospective customer asked me how I reconcile the fact that DataRobot has multiple very successful investment banks using DataRobot to enhance the P&L of their trading businesses with my comments that machine learning models aren’t always great at predicting financial asset prices. For price discovery (e.g.,

Machine Learning 87

Machine Learning Marketing Experimentation Data-driven 87

CIO Business Intelligence

JULY 31, 2024

This year, however, Salesforce has accelerated its agenda, integrating much of its recent work with large language models (LLMs) and machine learning into a low-code tool called Einstein 1 Studio. Einstein 1 Studio is a set of low-code tools to create, customize, and embed AI models in Salesforce workflows. What is Einstein 1 Studio?

Data Lake 119

Data Lake IT Sales Experimentation 119

CIO Business Intelligence

MAY 21, 2024

With the generative AI gold rush in full swing, some IT leaders are finding generative AI’s first-wave darlings — large language models (LLMs) — may not be up to snuff for their more promising use cases. With this model, patients get results almost 80% faster than before. It’s fabulous.”

IT 131

IT Cost-Benefit Experimentation Forecasting 131

CIO Business Intelligence

AUGUST 29, 2024

Google has updated its Gemini large language model (LLM) with a new feature, dubbed Gems, that allows users to train Gemini on any topic of their choice and use it as a customized AI assistant for various use cases. and later GPT-4 models become popular. These models include — the smaller Gemini 1.5 Flash model.

Experimentation 128

Experimentation Modeling Enterprise Marketing 128

CIO Business Intelligence

AUGUST 20, 2024

Our mental models of what constitutes a high-performance team have evolved considerably over the past five years. Post-pandemic, high-performance teams excelled at remote and hybrid working models, were more empathetic to individual needs, and leveraged automation to reduce manual work.

IT 141

IT Digital Transformation Experimentation Risk 141

CIO Business Intelligence

SEPTEMBER 18, 2024

Even as it designs 3D generative AI models for future customer deployment, CAD/CAM design giant Autodesk is “leaning” into generative AI for its customer service operations, deploying Salesforce’s Einstein for Service with plans to use Agentforce in the future, CIO Prakash Kota says.

Digital Transformation 119

Digital Transformation Experimentation Sales Software 119

CIO Business Intelligence

OCTOBER 5, 2023

Sandeep Davé knows the value of experimentation as well as anyone. Davé and his team’s achievements in AI are due in large part to creating opportunities for experimentation — and ensuring those experiments align with CBRE’s business strategy. Let’s start with the models. And those experiments have paid off.

Experimentation 130

Experimentation Strategy Machine Learning Interactive 130

CIO Business Intelligence

OCTOBER 3, 2024

Rather than pull away from big iron in the AI era, Big Blue is leaning into it, with plans in 2025 to release its next-generation Z mainframe , with a Telum II processor and Spyre AI Accelerator Card, positioned to run large language models (LLMs) and machine learning models for fraud detection and other use cases.

Machine Learning 140

Machine Learning Experimentation Insurance Modeling 140

CIO Business Intelligence

APRIL 24, 2024

But to find ways it can help grow a company’s bottom line, CIOs have to do more to understand a company’s business model and identify opportunities where gen AI can change the playing field. In addition, 66% are making investments this year in AI for marketing, 65% for sales, 62% for service, and 52% for RevOps.

Sales 128

Sales Finance Experimentation Cost-Benefit 128

Domino Data Lab

JANUARY 24, 2019

Before we get too far into 2019, I wanted to take a brief moment to reflect on some of the changes we’ve seen in the market. In 2018 we saw the “data science platform” market rapidly crystallize into three distinct product segments. Reflections. The three segments that have crystallized are: Automation tools. Automation Tools.

Data Science 65

Data Science Marketing Data-driven Statistics 65

CIO Business Intelligence

MAY 9, 2024

Experimentation drives momentum: How do we maximize the value of a given technology? Via experimentation. This can be as simple as a Google Sheet or sharing examples at weekly all-hands meetings Many enterprises do “blameless postmortems” to encourage experimentation without fear of making mistakes and reprisal.

Enterprise 122

Enterprise Experimentation Sales Manufacturing 122

CIO Business Intelligence

AUGUST 14, 2024

Ahead in a broad market In Morgan Stanley’s quarterly CIO survey, 38% of CIOs expected to adopt Microsoft Copilot tools over the next 12 months. It’s embedded in the applications we use every day and the security model overall is pretty airtight. Although competitors have similar model gardens, at 13.8% That’s risky.”

Enterprise 136

Enterprise Cost-Benefit Experimentation Modeling 136

CIO Business Intelligence

SEPTEMBER 12, 2024

Imagine a highly competitive market where the urgency to innovate is high. Generative AI models can perpetuate and amplify biases in training data when constructing output. Models can produce material that may infringe on copyrights. If not properly trained, these models can replicate code that may violate licensing terms.

Experimentation 111

Experimentation Risk Cost-Benefit Strategy 111

CIO Business Intelligence

APRIL 29, 2024

That’s because employees have decidedly mixed feelings about AI coming to their workplaces, according to the recent survey by IT solutions integrator Insight , even as many enterprises are already adopting or experimenting with AI and as AI-enabled phones begin hitting the market. They need to have a culture of experimentation.”

Forecasting 135

Forecasting Experimentation Risk Machine Learning 135

CIO Business Intelligence

MARCH 7, 2023

While many organizations are successful with agile and Scrum, and I believe agile experimentation is the cornerstone of driving digital transformation, there isn’t a one-size-fits-all approach. CIOs should consider technologies that promote their hybrid working models to replace in-person meetings.

Digital Transformation 145

Digital Transformation Data Governance Machine Learning Experimentation 145

datapine

JANUARY 31, 2022

For example, in regards to marketing, traditional advertising methods of spending large amounts of money on TV, radio, and print ads without measuring ROI aren’t working like they used to. They’re about having the mindset of an experimenter and being willing to let data guide a company’s decision-making process.

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

CIO Business Intelligence

AUGUST 15, 2024

When we do planning sessions with our clients, two thirds of the solutions they need don’t necessarily fit the generative AI model. However, foundational models will always have a place as the core backbone for the industry.” The AI market is experiencing a correction, not a burst,” he says.

ROI 143

ROI Cost-Benefit Experimentation Deep Learning 143

CIO Business Intelligence

NOVEMBER 4, 2022

The company’s multicloud infrastructure has since expanded to include Microsoft Azure for business applications and Google Cloud Platform to provide its scientists with a greater array of options for experimentation. Google created some very interesting algorithms and tools that are available in AWS,” McCowan says.

Data Lake 124

Data Lake IT Experimentation Data-driven 124