CIO Business Intelligence

DECEMBER 11, 2024

Research from IDC predicts that we will move from the experimentation phase, the GenAI scramble that we saw in 2023 and 2024, and mature into the adoption phase in 2025/26 before moving into AI-fuelled businesses in 2027 and beyond. These ROI expectations exist despite many surveyed organisations not having a clear AI strategy.

ROI 59

ROI Experimentation Insurance Strategy 59

CIO Business Intelligence

AUGUST 15, 2024

Determining the ROI for “ubiquitous” gen AI uses, such as virtual assistants or intelligent chatbots , can be difficult, says Frances Karamouzis, an analyst in the Gartner AI, hyper-automation, and intelligent automation group. CIOs need to be able to articulate the business value and expected ROI of each project.

ROI 143

ROI Cost-Benefit Experimentation Deep Learning 143

datapine

JANUARY 31, 2022

For example, in regards to marketing, traditional advertising methods of spending large amounts of money on TV, radio, and print ads without measuring ROI aren’t working like they used to. They’re about having the mindset of an experimenter and being willing to let data guide a company’s decision-making process.

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

CIO Business Intelligence

MAY 1, 2024

Ready to roll It’s shorter to make a list of organizations that haven’t announced their gen AI investments, pilots, and plans, but relatively few are talking about the specifics of any productivity gains or ROI. Pilots can offer value beyond just experimentation, of course. Now nearly half of code suggestions are accepted.

Cost-Benefit 143

Cost-Benefit Metrics Insurance Measurement 143

Occam's Razor

AUGUST 13, 2012

Bjoern Sjut3: My main issue at the moment: How will multi-channel funnels and ROI calculations work in a multi device world? That means: All of these metrics are off. This is exactly why the Page Value metric (in the past called $index value) was created. Pick metrics that matter. That is the solution. Hopefully soon!

Modeling 125

Modeling Metrics Data Quality Data-driven 125

Occam's Razor

NOVEMBER 2, 2015

Success Metrics. In my Oct 2011 post, Best Social Media Metrics , I'd created four metrics to quantify this value. I believe the best way to measure success is to measure the above four metrics (actual interaction/action/outcome). It can be a brand metric, say Likelihood to Recommend. It is not that hard.

B2B 167

B2B Metrics Recreation/Entertainment Testing 167

IBM Big Data Hub

MARCH 4, 2024

By becoming an AI+ enterprise, clients can realize the ROI not only for the AI use case but also for improving the related business and technical capabilities required to deliver AI use cases into production at scale. times higher ROI. times higher ROI. This culture encourages experimentation and expertise growth.

Enterprise 96

Enterprise ROI Risk Strategy 96

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. Another pattern that I’ve seen in good PMs is that they’re very metric-driven.

Management 110

Management Machine Learning Experimentation Metrics 110

CIO Business Intelligence

APRIL 18, 2022

They also advise communicating the dashboard’s value consistently since that will drive effective dashboard use, both to increase adoption and to improve company performance on key dashboard metrics, the brief says. They invest in cloud experimentation. They invest in their teams to spur innovation.

Digital Transformation 145

Digital Transformation Dashboards Cost-Benefit Consulting 145

DataRobot Blog

FEBRUARY 28, 2023

Integrating different systems, data sources, and technologies within an ecosystem can be difficult and time-consuming, leading to inefficiencies, data silos, broken machine learning models, and locked ROI. They can enjoy a hosted experience with code snippets, versioning, and simple environment management for rapid AI experimentation.

Data Processing 72

Data Processing Experimentation Machine Learning Data Warehouse 72

IBM Big Data Hub

MAY 17, 2024

Organizations face increased pressure to move to the cloud in a world of real-time metrics, microservices and APIs, all of which benefit from the flexibility and scalability of cloud computing. Teams are comfortable with experimentation and skilled in using data to inform business decisions. Why move to cloud?

Modeling 96

Modeling Cost-Benefit Optimization Digital Transformation 96

Occam's Razor

FEBRUARY 26, 2008

1: Implement a Experimentation & Testing Program. # 1: Implement a Experimentation & Testing Program. Experimentation and Testing: A Primer. Build A Great Web Experimentation & Testing Program. # Be it for in vogue metrics like Conversion Rates or for metrics that should be in vogue like Abandonment Rates.

Management 68

Management Experimentation Testing Metrics 68

Sisense

JULY 1, 2021

“We know in marketing that one of the most powerful ideas is experimentation,” Scott told Sisense. What has held that back is that the gap between idea and implementation has been a real bottleneck for how much experimentation can happen.”. You have to have the ability to experiment with ideas quickly and cheaply.

Marketing 52

Marketing Experimentation Marketing Analytics ROI 52

CIO Business Intelligence

OCTOBER 1, 2024

Many organizations have struggled to find the ROI after launching AI projects, but there’s a danger in demanding too much too soon, according to IT research and advisory firm Forrester. Measure everything Looking for ROI too soon is often a product of poor planning, says Rowan Curran, an AI and data science analyst at Forrester.

ROI 131

ROI IT Measurement Experimentation 131

Occam's Razor

AUGUST 22, 2011

" ~ Web Metrics: "What is a KPI? " + Standard Metrics Revisited Series. "Engagement" Is Not A Metric, It's An Excuse. Defining a "Master Metric", + a Framework to Gain a Competitive Advantage in Web Analytics. Customer Lifetime Value ROI, Buzz Monitoring, Click Fraud.

KPI 125

KPI Metrics Measurement ROI 125

Occam's Razor

MARCH 23, 2010

Because every tool uses its own sweet metrics definitions, cookie rules, session start and end rules and so much more. If you don't kill 25% of your metrics each year, you are doing something wrong. Why do you think introducing a completely different set of numbers is going to make your life easier? Likely not. success measures.

Analytics 119

Analytics Consulting Metrics Experimentation 119

Occam's Razor

OCTOBER 19, 2010

If you can show ROI on a DW it would be a good use of your money to go with Omniture Discover, WebTrends Data Mart, Coremetrics Explore. Mongoose Metrics ~ ifbyphone. I know Mongoose Metrics a bit more and have been impressed with their solution and evolution over the last couple of years. and Google, get a paid solution.

Analytics 136

Analytics Testing Measurement Optimization 136

Corinium

APRIL 25, 2019

Life insurance needs accurate data on consumer health, age and other metrics of risk. What do you recommend to organizations to harness this but also show a solid ROI? And it’s become a hyper-competitive business, so enhancing customer service through data is critical for maintaining customer loyalty.

Insurance 150

Insurance Risk IoT Data-driven 150

Domino Data Lab

FEBRUARY 4, 2019

Spoiler alert: a research field called curiosity-driven learning is emerging at the nexis of experimental cognitive psychology and industry use cases for machine learning, particularly in gaming AI. Given the two points above, that’s okay—there are good ways to direct data exploration toward ROI. Why does this matter?

Data Science 66

Data Science Experimentation Machine Learning Data-driven 66

Domino Data Lab

MAY 8, 2019

So much work in machine learning – either on the academic side which is focused on publishing papers or the industry side which is focused on ROI – tends to emphasize: How much predictive power (precision, recall) does the model have? Let’s unpack that one: it’s quite important. Does it beat existing benchmarks, i.e., is it SOTA?

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Occam's Razor

APRIL 29, 2013

Many used some data, but they unfortunately used silly data strategies/metrics. And silly simply because as soon as the strategy/success metric being obsessed about was mentioned, it was clear they would fail. It is a really good metric. There are many spectacular reasons for why Like (and +1s, Followers) is a horrible metric.

Marketing 166

Marketing Metrics Advertising Measurement 166

CIO Business Intelligence

OCTOBER 10, 2024

On the one side, Forrester recently warned organizations not to look for AI ROI too soon, because they could miss out on AI’s benefits. Still, a 30% failure rate represents a huge amount of time and money, given how widespread AI experimentation is today. The ROI may be coming from many of these less tangible things,” she says.

ROI 135

ROI Experimentation Cost-Benefit Metrics 135

CIO Business Intelligence

FEBRUARY 5, 2025

Half of CFOs say they plan to cut AI funding if it doesnt show measurable ROI within a year, according to a global survey from accounts payable automation firm Basware, which included 400 CFOs and finance leaders. CIOs are under pressure to validate AI investments and assure CFOs of a clear path of implementation that will ensure ROI.

Cost-Benefit 117

Cost-Benefit ROI Metrics Measurement 117

CIO Business Intelligence

MARCH 26, 2025

By presenting clear metrics and success stories illustrating the value of integrating technology into core business strategies, CIOs became involved in broader business discussions and initiatives. Every dollar spent on tech must drive value, no increase cost Enable your IT investments to transform business growth.

Business Objectives 106

Business Objectives Digital Transformation Finance Data-driven 106

CIO Business Intelligence

MAY 9, 2025

After a period of experimentation, launching multiple AI outcomes and learning by doing, he says, weve figured out where the objective AI value is concentrated, and have thus narrowed our focus to delivering fewer but higher impact AI outcomes that deliver ROI for the group.

Cost-Benefit 78

Cost-Benefit Experimentation ROI Data-driven 78

O'Reilly on Data

APRIL 15, 2025

One client proudly showed me this evaluation dashboard: The kind of dashboard that foreshadows failure This is the tools trapthe belief that adopting the right tools or frameworks (in this case, generic metrics) will solve your AI problems. Second, too many metrics fragment your attention. When everything is important, nothing is.

Experimentation 332

Experimentation Testing Metrics Measurement 332

CIO Business Intelligence

MAY 6, 2025

Governance challenges I commonly see: No consistent data definitions between departments No agreed-upon owner for key metrics like revenue or customer lifetime value Shadow IT spinning up their datasets and dashboards These gaps create delays, misalignment and risk. These capabilities are no longer theoretical or experimental.

Prescriptive Analytics 78

Prescriptive Analytics Predictive Analytics Descriptive Analytics ROI 78