CIO Business Intelligence

AUGUST 15, 2024

A virtual assistant may save employees time when searching for old documents or composing emails, but most organizations have no idea how much time those tasks have taken historically, having never tracked such metrics before, she says. What comes up must come down.”

ROI 143

ROI Cost-Benefit Experimentation Deep Learning 143

CIO Business Intelligence

OCTOBER 1, 2024

Organizations rolling out AI tools first need to set reasonable expectations and establish key metrics to measure the value of the deployment , he says. Measure everything Looking for ROI too soon is often a product of poor planning, says Rowan Curran, an AI and data science analyst at Forrester.

ROI 131

ROI IT Measurement Experimentation 131

Occam's Razor

AUGUST 13, 2012

That means: All of these metrics are off. A lot of people buy tools and consulting and go love crazy with attribution modeling. If you really want help here, hire a very very good business (not analytics) consultant. This is exactly why the Page Value metric (in the past called $index value) was created.

Modeling 125

Modeling Metrics Data Quality Data-driven 125

DataKitchen

JANUARY 17, 2022

The business analysts creating analytics use the process hub to calculate metrics, segment/filter lists, perform predictive modeling, “what if” analysis and other experimentation. It also minimizes the need for outside consultants who tend to rely upon heroism and tribal knowledge. Requirements continually change.

Experimentation 130

Experimentation Data Lake Predictive Modeling Marketing 130

CIO Business Intelligence

APRIL 18, 2022

While it’s critical for tech leaders to communicate throughout a digital project, it’s also important to communicate appropriately, says Rich Nanda, US strategy and analytics offerings leader, at Deloitte Consulting. Rich Nanda, US strategy and analytics offerings leader, Deloitte Consulting. Deloitte Consulting. “In

Digital Transformation 145

Digital Transformation Dashboards Cost-Benefit Consulting 145

Occam's Razor

AUGUST 12, 2013

We have fought valiant battles, paid expensive consultants, purchased a crazy amount of software, and achieved an implementation high that is quickly, followed by a " gosh darn it where is my return on investment from all this? Then Experimentation. than multi-channel attribution modeling. Do You Have an Attribution Problem?

Modeling 162

Modeling Optimization Marketing Interactive 162

Occam's Razor

OCTOBER 21, 2013

This is a simple custom report I use to look at the aggregated view: As the report above demonstrates, you can still report on your other metrics, like Unique Visitors, Bounce Rates, Per Visit Value and many others, at an aggregated level. And of course our Acquisition, Behavior, Outcome metrics. Controlled experimentation.

Optimization 156

Optimization Reporting Metrics Experimentation 156

CIO Business Intelligence

JULY 8, 2022

After transforming their organization’s operating model, realigning teams to products rather than to projects , CIOs we consult arrive at an inevitable question: “What next?” Road-mapping and transformations also become easier as each group can undertake the work that will most affect its assigned success metrics. Disadvantages.

Cost-Benefit 122

Cost-Benefit Measurement Modeling Metrics 122

CIO Business Intelligence

MARCH 5, 2024

Many other platforms, such as Coveo’s Relative Generative Answering , Quickbase AI , and LaunchDarkly’s Product Experimentation , have embedded virtual assistant capabilities but don’t brand them copilots. As copilot technology capabilities are changing rapidly, leaders should frequently identify metrics and evaluate strategies.

Advertising 124

Advertising Cost-Benefit Experimentation Reporting 124

Occam's Razor

JULY 24, 2018

work (collection, processing, reporting, analysis), processes, org structure, governance models, last-mile gaps , metrics ladders of awesomeness , and… so… much… more. Remember, tools, work, processes, org structure, governance models, last-mile gaps, metrics ladders of awesomeness, and… so… much… more. The Implications of Complexity.

Analytics 95

Analytics Metrics Strategy Measurement 95

CIO Business Intelligence

AUGUST 21, 2024

Our goal is to analyze logs and metrics, connecting them with the source code to gain insights into code fixes, vulnerabilities, performance issues, and security concerns,” he says. But multiagent AI systems are still in the experimental stages, or used in very limited ways. But some companies say they’re moving closer to that point.

Risk 136

Risk Insurance Cost-Benefit Software 136

Occam's Razor

DECEMBER 12, 2016

My answer was: " Look for these two elements, if they are present then it is worth helping the company with free consulting and analysis. If they are not, no matter how much money or how many Analysts they have, helping them is a waste of time because nothing will live after your consulting is done." It is a very sad reality.

Analytics 142

Analytics Data-driven Strategy Consulting 142

Aryng

APRIL 25, 2022

“To consult the statistician after an experiment is finished is often merely to ask him to conduct a post mortem examination. He can perhaps say what the experiment died of.”

Experimentation 52

Experimentation Consulting Testing Metrics 52

Occam's Razor

DECEMBER 9, 2009

In this post let me share with you a common sense framework I use in my consulting engagements to figure out a home for web analysts. When I consult with large companies when they are in this (messy) state my deliverable is a 90 day plan (that relies on the aforementioned accelerators) and a 180 day plan and a 365 day plan.

Analytics 95

Analytics Data-driven Marketing Sales 95

Occam's Razor

NOVEMBER 12, 2006

Focus on the Why (use Surveys or Lab Usability or Experimentation & Testing for example). Is Real Conversion Rate metric a good one? Segment the Visitors in the Opportunity Pie to identify what their true levers are (in getting them to buy). What do you think? Do you already use it and this is old news?

Measurement 99

Measurement Analytics Marketing Optimization 99

Occam's Razor

FEBRUARY 26, 2008

1: Implement a Experimentation & Testing Program. # 1: Implement a Experimentation & Testing Program. Experimentation and Testing: A Primer. Build A Great Web Experimentation & Testing Program. # Be it for in vogue metrics like Conversion Rates or for metrics that should be in vogue like Abandonment Rates.

Management 68

Management Experimentation Testing Metrics 68

Occam's Razor

MAY 27, 2015

In a recent set of keynotes and consulting engagements in the US, UK and Canada, I've had an overwhelming feeling that in very fundamental ways some companies make imprecise choices when it comes to their digital strategy. It is being hyper-conservative when it comes to creativity and experimentation because of quant-issues.

Marketing Analytics 155

Marketing Analytics Marketing Analytics Advertising 155

Occam's Razor

FEBRUARY 7, 2011

If you are a consultant then identifying opportunities is a smidgen harder, but you can use your experience with other clients to quantify value. But each keyword gets "credit" for other metrics. please refer to the controlled experimentation section, page 205, in the book for more. But there is no alternative.

Analytics 94

Analytics Measurement Metrics Predictive Analytics 94

Occam's Razor

JUNE 6, 2007

Bonus: Interactive CD: Contains six podcasts, one video, two web analytics metrics definitions documents and five insightful powerpoint presentations. Experimentation & Testing (A/B, Multivariate, you name it). Should you hire Consultants (and if so when and what to look for and expect)? It is a book about Web Analytics 2.0.

Analytics 60

Analytics Metrics Marketing Dashboards 60

Domino Data Lab

AUGUST 6, 2021

Develop: includes accessing and preparing data and algorithms, researching and development of models and experimentation. Monitor: includes monitoring the performance of the model, tracking metrics, as well as driving adoption of the model by those it was intended to serve. To evaluate it for yourself, register for a free 2-week trial.

Data Science 75

Data Science Testing Modeling Publishing 75

Occam's Razor

JULY 1, 2008

Still some web analytics vendors and consultants are fond of saying, "Yes we can track everything, online and offline and underwear sizes, and you won't have to lift a finger!" Take that as your inspiration (not the failure of Border Bell part, the controlled experimentation part). Nice ain't it?

Analytics 116

Analytics Measurement Marketing Sales 116

CIO Business Intelligence

JANUARY 14, 2025

The 2024 Enterprise AI Readiness Radar report from Infosys , a digital services and consulting firm, found that only 2% of companies were fully prepared to implement AI at scale and that, despite the hype , AI is three to five years away from becoming a reality for most firms. What ROI will AI deliver?

Strategy 141

Strategy ROI Experimentation Risk 141

Occam's Razor

NOVEMBER 2, 2015

Success Metrics. In my Oct 2011 post, Best Social Media Metrics , I'd created four metrics to quantify this value. I believe the best way to measure success is to measure the above four metrics (actual interaction/action/outcome). It can be a brand metric, say Likelihood to Recommend. It is not that hard.

B2B 167

B2B Metrics Recreation/Entertainment Testing 167

CIO Business Intelligence

OCTOBER 10, 2024

Still, a 30% failure rate represents a huge amount of time and money, given how widespread AI experimentation is today. If a project isn’t hitting the metrics, the teams can decide whether to dump it or give it more time. While Gersch recommends tying AI projects to business goals, she also encourages experimentation.

ROI 135

ROI Experimentation Cost-Benefit Metrics 135

CIO Business Intelligence

NOVEMBER 12, 2024

Cultivating high-performance teams , recruiting leaders, retaining talent, and continuously improving digital KPIs are hallmarks of strong IT cultures — but their metrics lag the CIO’s culture-improving programs. CIOs should also consult their HR partners on the procedures for managing performance improvement plans.

IT 140

IT Digital Transformation Management Experimentation 140