CIO Business Intelligence

AUGUST 15, 2024

“The inflated expectations were so inflated from the early days and have kept on, and I think this is going to be a pretty deep trough of disillusionment,” says Chris Stephenson, managing director of intelligent automation, AI, and digital services at IT consulting firm alliantgroup, affirming Gartner’s hype cycle.

ROI 143

ROI Cost-Benefit Experimentation Deep Learning 143

CIO Business Intelligence

OCTOBER 21, 2024

Slow progress frustrates teams and discourages future experimentation.” Roland Carandang, global leader for innovation at consultancy Protiviti, says the fact that organizations “don’t know what they’ve got” in and around those legacy systems can also stymie IT’s efforts to innovate.

IT 137

IT Experimentation Cost-Benefit Consulting 137

CIO Business Intelligence

SEPTEMBER 12, 2022

Prioritize time for experimentation. Today, we come together on Microsoft Teams or Zoom and use tools like Miro and OneNote, but the core principles of open collaboration, free expression of ideas, and experimentation remain at the center of Voya’s innovation culture.” . Iliya Rybchin, partner, Elixirr Consulting.

Experimentation 133

Experimentation Consulting Technology Machine Learning 133

CIO Business Intelligence

JUNE 15, 2023

Despite headlines warning that artificial intelligence poses a profound risk to society , workers are curious, optimistic, and confident about the arrival of AI in the enterprise, and becoming more so with time, according to a recent survey by Boston Consulting Group (BCG). For many, their feelings are based on sound experience.

Management 116

Management Experimentation Optimization Enterprise 116

CIO Business Intelligence

JULY 7, 2023

A security-by-design culture incorporates security measures deeply into the design and development of systems, rather than treating them as an afterthought. Other experts agreed, and provided additional guidance: “Improving the experience of employees while maintaining security can be tricky. Caution is king, however.

Measurement 122

Measurement Risk Experimentation Enterprise 122

CIO Business Intelligence

APRIL 18, 2022

While it’s critical for tech leaders to communicate throughout a digital project, it’s also important to communicate appropriately, says Rich Nanda, US strategy and analytics offerings leader, at Deloitte Consulting. Rich Nanda, US strategy and analytics offerings leader, Deloitte Consulting. Deloitte Consulting. “In

Digital Transformation 145

Digital Transformation Dashboards Cost-Benefit Consulting 145

Occam's Razor

AUGUST 12, 2013

We have fought valiant battles, paid expensive consultants, purchased a crazy amount of software, and achieved an implementation high that is quickly, followed by a " gosh darn it where is my return on investment from all this? There are few things more complicated in analytics (all analytics, big data and huge data!)

Modeling 162

Modeling Optimization Marketing Interactive 162

Alation

DECEMBER 20, 2022

Failing to measure the impact of digital transformation against corporate strategies and OKRs. The measurement of an improvement and transformation is important,” Shaun Guthrie , senior VP of IT at Peavy Industries, points out “[It’s] Not just whether you improved revenue, efficiency, etc., are business problems.”. but by how much.

Digital Transformation 96

Digital Transformation Scorecard Measurement Experimentation 96

CIO Business Intelligence

AUGUST 23, 2024

A closeknit team of about 10 engineers and executives from Bayer, Amazon, and Slalom Consulting cooked up the blueprint for the “Decision Science Ecosystem” roughly 18 months ago and has been building the platform for about a year. Making that available across the division will spur more robust experimentation and innovation, he notes.

Data Science 101

Data Science Experimentation Testing Modeling 101

CIO Business Intelligence

JULY 8, 2022

After transforming their organization’s operating model, realigning teams to products rather than to projects , CIOs we consult arrive at an inevitable question: “What next?” This article was co-authored by Duke Dyksterhouse , an Associate at Metis Strategy. Disadvantages.

Cost-Benefit 122

Cost-Benefit Measurement Modeling Metrics 122

Occam's Razor

AUGUST 13, 2012

Yehoshua Coren: Best ways to measure user behavior in a multi-touch, multi-device digital world. What's possible to measure. What's not possible to measure. We all have smart phones, laptops, tablets and soon Smart TVs – but most of our measurements are usually done in Cookies that are device/browser specific.

Modeling 125

Modeling Metrics Data Quality Data-driven 125

Occam's Razor

JULY 1, 2008

3 ] Provide you with a bushel of specific multichannel measurement ideas to help quantify the offline impact of your online presence. Why should you care about measuring multichannel impact? There are many jobs your website is doing, it is your job to measure the holistic impact. Bonus Tip : But don't stop there.

Analytics 116

Analytics Measurement Marketing Sales 116

CIO Business Intelligence

AUGUST 21, 2024

It wasn’t just a single measurement of particulates,” says Chris Mattmann, NASA JPL’s former chief technology and innovation officer. “It It was many measurements the agents collectively decided was either too many contaminants or not.” They also had extreme measurement sensitivity.

Risk 136

Risk Insurance Cost-Benefit Software 136

CIO Business Intelligence

AUGUST 14, 2024

Measuring costs and value The other major issue with gen AI is the price. After the excitement and experimentation of last year, CIOs are more deliberate about how they implement gen AI, making familiar ROI decisions, and often starting with customer support. But experimentation to achieve significant results takes time.

Enterprise 136

Enterprise Cost-Benefit Experimentation Modeling 136

CIO Business Intelligence

APRIL 26, 2023

Experimentation broadens expertise, particularly in a rapidly evolving field like technology where being able to learn many new skills is key to both career and enterprise success, he says. Ensure there’s an ability to measure training effectiveness during and after the training program’s completion.”

IT 105

IT Experimentation Forecasting Machine Learning 105

CIO Business Intelligence

MAY 2, 2024

You can have the best solution but if you don’t have adoption, it will fail,” says Wayne Tung, managing director of Sendero Consulting. I try and build a culture where everything is hypothesis-driven and experimental,” says Digiterre’s Jethwa. This is true of mergers, acquisitions, divestitures — any type of change.”

IT 138

IT Experimentation Software Management 138

O'Reilly on Data

MARCH 23, 2023

Tokens ChatGPT’s sense of “context”—the amount of text that it considers when it’s in conversation—is measured in “tokens,” which are also used for billing. You could even create digital clones of yourself 5 that could stand in for you in consulting gigs and other business situations. Tokens are significant parts of a word.

IT 346

IT Modeling Testing Risk 346

Occam's Razor

NOVEMBER 2, 2015

For the rest of this post, I'm going to use the first three to capture the essence of social engagement and brand impact, and one to measure impact on the business. I believe the best way to measure success is to measure the above four metrics (actual interaction/action/outcome). Measure all this Social Media activity.

B2B 167

B2B Metrics Recreation/Entertainment Testing 167

Occam's Razor

FEBRUARY 26, 2008

1: Implement a Experimentation & Testing Program. # 1: Implement a Experimentation & Testing Program. Experimentation and Testing: A Primer. Build A Great Web Experimentation & Testing Program. # Often with benchmarks we get into silly arguments like how do they measure this and that etc.

Management 68

Management Experimentation Testing Metrics 68

AWS Big Data

JUNE 12, 2024

By using infrastructure as code (IaC) tools, ODP enables self-service data access with unified data management, metadata management (data catalog), and standard interfaces for analytics tools with a high degree of automation by providing the infrastructure, integrations, and compliance measures out of the box.

Data Architecture 105

Data Architecture Cost-Benefit Data-driven Experimentation 105

Ontotext

MAY 18, 2020

Ever since Hippocrates founded his school of medicine in ancient Greece some 2,500 years ago, writes Hannah Fry in her book Hello World: Being Human in the Age of Algorithms , what has been fundamental to healthcare (as she calls it “the fight to keep us healthy”) was observation, experimentation and the analysis of data. Certainly not!

Knowledge Discovery 72

Knowledge Discovery Experimentation Data-driven Metadata 72

Occam's Razor

JULY 24, 2018

To name a few: Digital Marketing & Measurement Model | Analytics Ecosystem | Web Analytics 2.0. During a discussion around planning for measurement, a peer was struggling with a unique collection of challenges. You see more digital metrics because digital is more measurable. Especially for the non-obvious problem #2 above.

Analytics 95

Analytics Metrics Strategy Measurement 95

bridgei2i

APRIL 28, 2020

My name is Aruna Babu and I’m a transformation consultant who spent a good part of the last decade crafting strategy that marries business, technology and user needs. And obviously, such times call for truly unprecedented measures. Transcript. Aruna: Hi there! Doug Laney: My pleasure. Good to be with you, Aruna. Aruna: Got it.

Enterprise 103

Enterprise Data Analytics Analytics Forecasting 103

Sisense

JULY 15, 2020

This article will focus on the AI Research (AIR) team’s effort, specifically an experimental combination of Sisense BloX (actionable embedded analytics ) and Quest (an advanced analytics add-on for Sisense) which we called the SEIR app. Dozens of Sisensers took part in project SiCo to create this awesome COVID hub. Envisioning the SEIR app.

Analytics 90

Analytics Modeling Visualization Dashboards 90

Occam's Razor

JUNE 6, 2007

Experimentation & Testing (A/B, Multivariate, you name it). Should you hire Consultants (and if so when and what to look for and expect)? The book takes a stand on issues, makes choices and cuts through the fog/FUD, in an attempt to make your life a tiny bit easier. It is a book about Web Analytics 2.0. Clicks and outcomes.

Analytics 60

Analytics Metrics Marketing Dashboards 60

Ontotext

APRIL 3, 2024

So, this is a big driver for the outcome because when you are saving money for the business, you can measure it and see its value. Nimit Mehta: I think that 2024 is going to be a buckle-down year, but, at the same time, we’ll see a rapid explosion of experimentation. It’s not about just hitting the quarterly numbers.

Technology 45

Technology Risk Digital Transformation Measurement 45

Occam's Razor

SEPTEMBER 15, 2014

But why blame others, in this post let's focus on one important reason whose responsibility can be squarely put on your shoulders and mine: Measurement. Create a distinct mobile website and mobile app measurement strategies. Media-Mix Modeling/Experimentation. Remember my stress earlier on measuring micro-outcomes?).

Metrics 143

Metrics Reporting Analytics Marketing 143

CIO Business Intelligence

OCTOBER 1, 2024

Measure everything Looking for ROI too soon is often a product of poor planning, says Rowan Curran, an AI and data science analyst at Forrester. Organizations rolling out AI tools first need to set reasonable expectations and establish key metrics to measure the value of the deployment , he says.

ROI 131

ROI IT Measurement Experimentation 131

Occam's Razor

MARCH 23, 2010

Part of it fueled by some Consultants. Too many new things are happening too fast and those of us charged with measuring it have to change the wheels while the bicycle is moving at 30 miles per hour (and this bicycle will become a car before we know it – all while it keeps moving, ever faster). Part of it fueled by Vendors.

Analytics 119

Analytics Consulting Metrics Experimentation 119

Occam's Razor

OCTOBER 21, 2013

Controlled experimentation. Now its time for the SEO Consultant's awesomely awesome SEO strategy implementation. Measure the impact (remember you can measure at a Search Engine and Organic/Paid level). Measure the impact (remember you can measure at a Search Engine and Organic/Paid level). Carpe diem!

Optimization 156

Optimization Reporting Metrics Experimentation 156

Occam's Razor

DECEMBER 12, 2016

My answer was: " Look for these two elements, if they are present then it is worth helping the company with free consulting and analysis. If they are not, no matter how much money or how many Analysts they have, helping them is a waste of time because nothing will live after your consulting is done." That's it.

Analytics 142

Analytics Data-driven Strategy Consulting 142

Occam's Razor

AUGUST 22, 2011

Key To Your Digital Success: Web Analytics Measurement Model. " Measuring Incrementality: Controlled Experiments to the Rescue! Barriers To An Effective Web Measurement Strategy [+ Solutions!]. Measuring Online Engagement: What Role Does Web Analytics Play? "Engagement" How Do I Measure Success?

KPI 125

KPI Metrics Measurement ROI 125

Occam's Razor

FEBRUARY 7, 2011

If you are a consultant then identifying opportunities is a smidgen harder, but you can use your experience with other clients to quantify value. Brian Krick: Best way to measure and communicate "available demand" from available channels (social, search, display) for forecast modeling. But there is no alternative.

Analytics 94

Analytics Measurement Metrics Predictive Analytics 94

Occam's Razor

MAY 27, 2015

In a recent set of keynotes and consulting engagements in the US, UK and Canada, I've had an overwhelming feeling that in very fundamental ways some companies make imprecise choices when it comes to their digital strategy. In large measure that is because of the rise of programmatic buying. RM+RP+RT is finally possible.

Marketing Analytics 155

Marketing Analytics Marketing Analytics Advertising 155

CIO Business Intelligence

OCTOBER 10, 2024

Still, a 30% failure rate represents a huge amount of time and money, given how widespread AI experimentation is today. One challenge with setting KPIs is measuring the results, adds Kathy Gersch, chief growth and commercial officer at Kotter International, a change management consulting firm.

ROI 135

ROI Experimentation Cost-Benefit Metrics 135

CIO Business Intelligence

OCTOBER 24, 2024

AI projects without clear goals or measurable outcomes are unlikely to deliver real value. Misunderstanding AI A huge part of the problem is a lack of understanding of AI’s capabilities, adds Matt Rosen, CEO of digital consulting firm Allata. This trend is concerning,” he says. “AI The fear of missing out is real.

IT 138

IT Experimentation Measurement Risk 138

CIO Business Intelligence

NOVEMBER 19, 2024

Generative AI (GenAI) is rapidly emerging as a game changer for enterprises, but turning its potential into measurable value remains a significant challenge. This stark contrast between experimentation and execution underscores the difficulties in harnessing AI’s transformative power. Of those, just three are considered successful.

Consulting 137

Consulting Cost-Benefit Experimentation Optimization 137