CIO Business Intelligence

DECEMBER 5, 2023

Economic uncertainty, increased competition, sustainability concerns, shareholder expectations, and regulatory challenges are also top of mind. CIOs should also periodically review projects in play to reprioritize them based on anticipated ROI and feasibility, says 11:11’s Pratt. But it’s not the only one.

IT 138

IT Cost-Benefit Digital Transformation ROI 138

IBM Big Data Hub

SEPTEMBER 11, 2023

Government executives face several uncertainties as they embark on their journeys of modernization. How to quantify the impact : Quantify, articulate and measure the expected long-term benefit of a capability to justify the investment. time (how much time is lost?)

Data-driven 85

Data-driven IT Measurement Cost-Benefit 85

Andrew White

DECEMBER 16, 2019

After sifting through several year’s worth of formally written data, analytics, and data and analytics strategies, we found about 85% of them did not include a measurable business outcome. As such an ROI would have been impossible. The article notes this as cognitive uncertainty. Or maybe we will just say strategy.

Uncertainty 40

Uncertainty ROI Metrics Strategy 40

IBM Big Data Hub

OCTOBER 18, 2022

Most admit uncertainty around ROI and nearly half struggle with adequate insights from their data. Fewer than 1 in 4 agree that sustainability requires financial tradeoffs, but many acknowledge the need to redefine and re-calibrate how they measure performance.

Uncertainty 52

Uncertainty Strategy Measurement Digital Transformation 52

CIO Business Intelligence

JANUARY 4, 2023

Though composable infrastructure may remove the restrictions of traditional architectures, there’s debate [3] about whether it can scale and whether the ROI would be reached by increased flexibility and utilization. Yes, specific AI workflows require special hardware configurations.

Cost-Benefit 59

Cost-Benefit Machine Learning Uncertainty Modeling 59

IBM Big Data Hub

APRIL 18, 2024

Beyond cost savings, organizations seek tangible ways to measure gen AI’s return on investment (ROI), focusing on factors like revenue generation, cost savings, efficiency gains and accuracy improvements, depending on the use case. The AGI would need to handle uncertainty and make decisions with incomplete information.

Cost-Benefit 89

Cost-Benefit Manufacturing Modeling Interactive 89

Domino Data Lab

JUNE 23, 2019

These measurement-obsessed companies have an advantage when it comes to AI. Google, Facebook, other leaders, they really have set up a culture of extreme measurement where every part of their product experience is instrumented to optimize clicks and drive user engagement. To prioritize, how do we do this?

Management 110

Management Machine Learning Experimentation Metrics 110

CIO Business Intelligence

DECEMBER 18, 2024

The appeal of vertical SaaS lies in its ability to provide out-of-the-box solutions that require minimal customization, leading to faster implementation times and quicker ROI. This shift is partly driven by economic uncertainty and the need for businesses to justify every expense.

ROI 116

ROI Software Finance Uncertainty 116

CIO Business Intelligence

JULY 10, 2024

On top of this, Relex added instructions to its prompt to avoid answering any questions outside the company’s knowledge base, he says, and to express uncertainty when the question was at the limits of its knowledge or skills. Other hyperscalers also offer guardrails that work with their gen AI platforms.

Enterprise 136

Enterprise Risk Modeling Risk Management 136

Insight

FEBRUARY 19, 2020

The genre uniqueness is a measure of how unique a movie’s combination of genre categories is relative to all movies in my data set. Building Models to Predict Movie Profitability Here I use profitability as the metric of success for a film and define profitability as the return on investment (ROI). ROI = Profit/Budget).

Risk 67

Risk ROI Modeling Metrics 67

CIO Business Intelligence

DECEMBER 31, 2024

As AI technologies evolve, organizations can utilize frameworks to measure short-term ROI from AI initiatives against key performance indicators (KPIs) linked to business objectives, says Soumendra Mohanty, chief strategy officer at data science and AI solutions provider Tredence. You get what you measure, she says.

Management 139

Management Key Performance Indicator Business Objectives Digital Transformation 139

CIO Business Intelligence

JANUARY 23, 2025

While building from scratch is out of reach for most, consumption-based models allow CIOs to implement AI incrementally with more measurable ROI. That uncertainty creates a challenge for risk-averse companies that must work within budget constraints. Premium pricing for gen AI services is another CIO concern, IDC and CIOs note.

Strategy 126

Strategy Cost-Benefit ROI Risk 126

CIO Business Intelligence

DECEMBER 5, 2024

When they say they don’t know what their KPIs are, what they’re really saying is, ‘When we determine the proof of concept, we didn’t have a measure of success,’” he adds. It “highlights a lack of clarity and measurement in evaluating AI project success,” he says.

Metrics 125

Metrics Uncertainty Consulting KPI 125

CIO Business Intelligence

FEBRUARY 25, 2025

Typically, election years bring fear, uncertainty, and doubt, causing a slowdown in hiring, Doyle says. CIOs are being viewed as business strategists who can navigate AIs impact, manage outsourced IT functions, and drive ROI and measurable business value, she says. Boards and CEOs arent just looking for IT leaders.

Uncertainty 127

Uncertainty Cost-Benefit Data-driven Marketing 127

CIO Business Intelligence

DECEMBER 23, 2024

AI investment and pressure grew upward As AI has moved from emerging to mainstream, and organizations matured in their ability to harness AIs potential over the past year or two, CEOs now expect less experimentation and more AI projects that deliver outcomes with measurable business value.

IT 134

IT Strategy Technology Experimentation 134

O'Reilly on Data

APRIL 15, 2025

Heres a common scene from my consulting work: AI TEAM Heres our agent architectureweve got RAG here, a router there, and were using this new framework for ME [Holding up my hand to pause the enthusiastic tech lead] Can you show me how youre measuring if any of this actually works? Instead, they obsess over measurement and iteration.

Testing 299

Testing Experimentation Metrics Measurement 299