CIO Business Intelligence

JANUARY 21, 2025

As gen AI heads to Gartners trough of disillusionment , CIOs should consider how to realign their 2025 strategies and roadmaps. The World Economic Forum shares some risks with AI agents , including improving transparency, establishing ethical guidelines, prioritizing data governance, improving security, and increasing education.

Cost-Benefit 142

Cost-Benefit Data-driven Strategy Marketing 142

CIO Business Intelligence

JANUARY 6, 2025

One of them is Katherine Wetmur, CIO for cyber, data, risk, and resilience at Morgan Stanley. Wetmur says Morgan Stanley has been using modern data science, AI, and machine learning for years to analyze data and activity, pinpoint risks, and initiate mitigation, noting that teams at the firm have earned patents in this space.

IT 140

IT Cost-Benefit Measurement Experimentation 140

O'Reilly on Data

MARCH 25, 2025

The coordination tax: LLM outputs are often evaluated by nontechnical stakeholders (legal, brand, support) not just for functionality, but for tone, appropriateness, and risk. ML apps needed to be developed through cycles of experimentation (as were no longer able to reason about how theyll behave based on software specs).

Testing 174

Testing Data-driven Software Measurement 174

CIO Business Intelligence

NOVEMBER 11, 2024

Research firm IDC projects worldwide spending on technology to support AI strategies will reach $337 billion in 2025 — and more than double to $749 billion by 2028. Amazon Web Services, Microsoft Azure, and Google Cloud Platform are enabling the massive amount of gen AI experimentation and planned deployment of AI next year, IDC points out.

ROI 137

ROI Cost-Benefit Risk Experimentation 137

CIO Business Intelligence

DECEMBER 17, 2024

While genAI has been a hot topic for the past couple of years, organizations have largely focused on experimentation. What are the associated risks and costs, including operational, reputational, and competitive? Consultants can help you develop and execute a genAI strategy that will fuel your success into 2025 and beyond.

Experimentation 98

Experimentation ROI Risk Data Quality 98

CIO Business Intelligence

NOVEMBER 27, 2024

People : To implement a successful Operational AI strategy, an organization needs a dedicated ML platform team to manage the tools and processes required to operationalize AI models. Adopting Operational AI Organizations looking to adopt Operational AI must consider three core implementation pillars: people, process, and technology.

Data Architecture 128

Data Architecture Cost-Benefit Machine Learning Experimentation 128

CIO Business Intelligence

OCTOBER 24, 2024

As they look to operationalize lessons learned through experimentation, they will deliver short-term wins and successfully play the gen AI — and other emerging tech — long game,” Leaver said. Determining the optimal level of autonomy to balance risk and efficiency will challenge business leaders,” Le Clair said.

ROI 127

ROI Data-driven Enterprise Experimentation 127

CIO Business Intelligence

JANUARY 14, 2025

Technical foundation Conversation starter : Are we maintaining reliable roads and utilities, or are we risking gridlock? DevSecOps maturity Conversation starter : Are our daily operations stuck in manual processes that slow us down or expose us to risks? This alignment sets the stage for how we execute our transformation.

Enterprise 119

Enterprise Technology Metrics Measurement 119

CIO Business Intelligence

OCTOBER 17, 2024

While tech debt refers to shortcuts taken in implementation that need to be addressed later, digital addiction results in the accumulation of poorly vetted, misused, or unnecessary technologies that generate costs and risks. million machines worldwide, serves as a stark reminder of these risks.

Risk 108

Risk Experimentation Testing Strategy 108

O'Reilly on Data

MARCH 31, 2020

This means that the AI products you build align with your existing business plans and strategies (or that your products are driving change in those plans and strategies), that they are delivering value to the business, and that they are delivered on time. AI product estimation strategies.

Management 363

Management Machine Learning Experimentation Metrics 363

CIO Business Intelligence

AUGUST 21, 2024

Adding smarter AI also adds risk, of course. “At The big risk is you take the humans out of the loop when you let these into the wild.” When it comes to security, though, agentic AI is a double-edged sword with too many risks to count, he says. “We That means the projects are evaluated for the amount of risk they involve.

Risk 136

Risk Insurance Cost-Benefit Software 136

O'Reilly on Data

SEPTEMBER 15, 2020

Technical competence results in reduced risk and uncertainty. AI initiatives may also require significant considerations for governance, compliance, ethics, cost, and risk. Results are typically achieved through a scientific process of discovery, exploration, and experimentation, and these processes are not always predictable.

Advertising 362

Advertising Cost-Benefit ROI Machine Learning 362

CIO Business Intelligence

JULY 5, 2024

So many vendors, applications, and use cases, and so little time, and it permeates everything from business strategy and processes, to products and services. So, to maximize the ROI of gen AI efforts and investments, it’s important to move from ad-hoc experimentation to a more purposeful strategy and systematic approach to implementation.

ROI 124

ROI Experimentation Risk Cost-Benefit 124

CIO Business Intelligence

JANUARY 10, 2025

As leaders work to define the right metrics, those measures must be tightly aligned with the business strategy and should account for the cost of not investing. According to KPMG, 88% of leaders continue to cite external factors as top influencers of AI strategy, underscoring the urgency of measurable results.

ROI 81

ROI Enterprise Broadcasting Metrics 81

CIO Business Intelligence

SEPTEMBER 27, 2023

By suggesting a number of use cases, we further encourage experimentation and creative application.” Before introducing generative AI in the workplace, leaders should begin with a risk assessment to identify what risks are present to them as an organization in the use and potential misuse of the tool, Daly says.

Strategy 126

Strategy Data-driven Risk Technology 126

CIO Business Intelligence

JULY 31, 2023

They note, too, that CIOs — being top technologists within their organizations — will be running point on those concerns as companies establish their gen AI strategies. Here’s a rundown of the top 20 issues shaping gen AI strategies today. says CIOs should apply agile processes to their gen AI strategy. It’s not a hammer.

Strategy 98

Strategy Risk Enterprise Risk Management 98

CIO Business Intelligence

NOVEMBER 7, 2024

Using a defensive and offensive strategy, we’ve taken decisive steps to ensure responsible innovation. This team addresses potential risks, manages AI across the company, provides guidance, implements necessary training, and keeps abreast of emerging regulatory changes. We’ve structured our approach into phases.

Insurance 120

Insurance Experimentation Testing Technology 120

CIO Business Intelligence

SEPTEMBER 23, 2024

From the rise of value-based payment models to the upheaval caused by the pandemic to the transformation of technology used in everything from risk stratification to payment integrity, radical change has been the only constant for health plans. That’s what it’s like to find a GenAI strategy on top of a poor data infrastructure.

Management 115

Management Experimentation Data-driven Strategy 115

CIO Business Intelligence

OCTOBER 15, 2024

Multicloud architectures, applications portfolios that span from mainframes to the cloud, board pressure to accelerate AI and digital outcomes — today’s CIOs face a range of challenges that can impact their DevOps strategies.

Enterprise 143

Enterprise Testing Business Objectives Experimentation 143

CIO Business Intelligence

DECEMBER 11, 2024

Newly released research from SASs Data and AI Pulse Survey 2024 Asia Pacific finds that only 18% of organisations can be categorised as AI leaders, where the organisation has an AI strategy and long-term investment plans in place. These ROI expectations exist despite many surveyed organisations not having a clear AI strategy.

ROI 59

ROI Experimentation Insurance Strategy 59

CIO Business Intelligence

SEPTEMBER 12, 2024

A product manager is under immense pressure to deliver complex customer insights that could pivot the company’s product strategy. The perils of unsanctioned generative AI The added risks of shadow generative AI are specific and tangible and can threaten organizations’ integrity and security.

Experimentation 111

Experimentation Risk Cost-Benefit Strategy 111

CIO Business Intelligence

OCTOBER 5, 2023

Sandeep Davé knows the value of experimentation as well as anyone. Davé and his team’s achievements in AI are due in large part to creating opportunities for experimentation — and ensuring those experiments align with CBRE’s business strategy. This is partly why partnerships have been integral to CBRE’s strategy.

Experimentation 130

Experimentation Strategy Machine Learning Interactive 130

O'Reilly on Data

APRIL 4, 2024

As Bill Janeway noted in his critique of the capital-fueled bubbles that resulted from the ultra-low interest rates of the decade following the 2007–2009 financial crisis, “ capital is not a strategy.” Venture capitalists don’t have a crystal ball.

Marketing 236

Marketing Finance Modeling Experimentation 236

CIO Business Intelligence

AUGUST 20, 2024

CIOs have a new opportunity to communicate a gen AI vision for using copilots and improve their collaborative cultures to help accelerate AI adoption while avoiding risks. This shift in focus requires teams to understand business strategy, market trends, customer needs, and value propositions. What is a high-performance team today?

IT 141

IT Digital Transformation Experimentation Risk 141

Smart Data Collective

OCTOBER 13, 2021

AI technology moves innovation forward by boosting tinkering and experimentation, accelerating the innovation process. Automating processes can be costly, but it’s a worthy long-term investment that helps businesses align their strategies for streamlined operations. As technology improves, the need for businesses to compete increases.

Technology 133

Technology Cost-Benefit Experimentation Machine Learning 133

CIO Business Intelligence

OCTOBER 3, 2024

The high adoption rate of proprietary LLMs through SaaS APIs (cloud-based) in these organizations indicates a preference to rely on third party vendors to drive the AI strategy and implementation. Medium companies Medium-sized companies—501 to 5,000 employees—were characterized by agility and a strong focus on GenAI experimentation.

Testing 129

Testing Cost-Benefit Experimentation Risk 129

CIO Business Intelligence

JULY 12, 2024

“Not only does this particular low-code solution make rapid experimentation possible, it also offers orchestration capabilities so we can plug different services in and out very quickly,” says Pacynski. The omnichannel strategy at Ulta has been strong for many years,” she adds. But this doesn’t mean you can just test forever.

Experimentation 124

Experimentation Testing Enterprise Strategy 124

Corinium

JUNE 6, 2019

Regulations and compliance requirements, especially around pricing, risk selection, etc., Beyond that, we recommend setting up the appropriate data management and engineering framework including infrastructure, harmonization, governance, toolset strategy, automation, and operating model. In addition, the traditional challenges remain.

Insurance 250

Insurance Analytics Forecasting Deep Learning 250

CIO Business Intelligence

MARCH 19, 2025

CIOs have the daunting task of educating it on the various flavors of this capability, and steering them to the most beneficial investments and strategies. When I joined RGA, there was already a recognition that we could grow the business by building an enterprise data strategy. This can cause risk without a clear business case.

Metrics 64

Metrics Enterprise Cost-Benefit Experimentation 64

CIO Business Intelligence

AUGUST 15, 2024

Generative AI has been hyped so much over the past two years that observers see an inevitable course correction ahead — one that should prompt CIOs to rethink their gen AI strategies. Many of those gen AI projects will fail because of poor data quality, inadequate risk controls, unclear business value , or escalating costs , Gartner predicts.

ROI 143

ROI Cost-Benefit Experimentation Deep Learning 143

CIO Business Intelligence

JUNE 21, 2024

The AI data center pod will also be used to power MITRE’s federal AI sandbox and testbed experimentation with AI-enabled applications and large language models (LLMs). We took a risk. based research organization into an “AI-native organization” that provides the most efficient, intelligent, and critical data for government agencies.

Experimentation 134

Experimentation Data mining Reporting Data Processing 134

CIO Business Intelligence

DECEMBER 19, 2023

This year’s technology darling and other machine learning investments have already impacted digital transformation strategies in 2023 , and boards will expect CIOs to update their AI transformation strategies frequently. Luckily, many are expanding budgets to do so. “94%

Digital Transformation 143

Digital Transformation Unstructured Data Machine Learning Risk Management 143

CIO Business Intelligence

OCTOBER 8, 2024

“They must architect technology strategy across data, security, operations, and infrastructure, teaming with business leaders — speaking their language, not tech jargon — to understand needs, imagine possibilities, identify risks, and coordinate investments.” Investing in talent and skills is also critical, he adds. “IT

IT 140

IT Strategy Experimentation Technology 140

CIO Business Intelligence

NOVEMBER 21, 2023

Ask IT leaders about their challenges with shadow IT, and most will cite the kinds of security, operational, and integration risks that give shadow IT its bad rep. That’s not to downplay the inherent risks of shadow IT.

IT 137

IT Risk Cost-Benefit Data Science 137

CIO Business Intelligence

OCTOBER 21, 2024

Slow progress frustrates teams and discourages future experimentation.” That lack of understanding fuels a fear of decommissioning and replacing old systems, as IT and business leaders see a high risk of significant snafus when they don’t understand all the complexities and connections within their legacy tech, he explains.

IT 137

IT Experimentation Cost-Benefit Consulting 137

CIO Business Intelligence

JULY 1, 2024

By documenting cases where automated systems misbehave, glitch or jeopardize users, we can better discern problematic patterns and mitigate risks. Real-time monitoring tools are essential, according to Luke Dash, CEO of risk management platform ISMS.online.

Reporting 129

Reporting Risk Management Experimentation Risk 129

CIO Business Intelligence

NOVEMBER 15, 2022

Experiment with the “highly visible and highly hyped”: Gartner repeatedly pointed out that organisations that innovate during tough economic times “stay ahead of the pack”, with Mesaglio in particular calling for such experimentation to be public and visible.

Digital Transformation 143

Digital Transformation Machine Learning Experimentation Metrics 143