CIO Business Intelligence

SEPTEMBER 23, 2024

From the rise of value-based payment models to the upheaval caused by the pandemic to the transformation of technology used in everything from risk stratification to payment integrity, radical change has been the only constant for health plans. The culprit keeping these aspirations in check? It is still the data.

Management 115

Management Experimentation Strategy Data-driven 115

CIO Business Intelligence

AUGUST 16, 2023

But today, Svevia is driving cross-sector digitization projects where new technology for increased safety for road workers and users is tested. Digital alerts Another project deals with slow-moving vehicles, something that increases the risk of accidents on the roads. This leads to environmental benefits and fewer transports.

Risk 98

Risk Cost-Benefit Digital Transformation Internet of Things 98

CIO Business Intelligence

NOVEMBER 11, 2024

While the ROI of any given AI project remains uncertain , one thing is becoming clear: CIOs will be spending a whole lot more on the technology in the years ahead. Research firm IDC projects worldwide spending on technology to support AI strategies will reach $337 billion in 2025 — and more than double to $749 billion by 2028.

ROI 136

ROI Cost-Benefit Experimentation Risk 136

CIO Business Intelligence

AUGUST 20, 2024

These teams focused on delivering reliable technology capabilities, improving end-user experiences, and establishing data and analytics capabilities. CIOs have a new opportunity to communicate a gen AI vision for using copilots and improve their collaborative cultures to help accelerate AI adoption while avoiding risks.

IT 141

IT Digital Transformation Experimentation Risk 141

CIO Business Intelligence

OCTOBER 15, 2024

Recommendation : CIOs should adopt a risk-informed approach, understanding business, customer, and employee impacts before setting application-specific continuous deployment strategies. Shortchanging end-user and developer experiences Many DevOps practices focus on automation, such as CI/CD and infrastructure as code.

Enterprise 143

Enterprise Testing Business Objectives Experimentation 143

CIO Business Intelligence

OCTOBER 14, 2024

Focused on digitization and innovation and closely aligned with lines of business, some 40% of IT leaders surveyed in CIO.com’s State of the CIO Study 2024 characterize themselves as transformational, while a quarter (23%) consider themselves functional: still optimizing, modernizing, and securing existing technology infrastructure.

Digital Transformation 131

Digital Transformation Experimentation Cost-Benefit Risk 131

CIO Business Intelligence

AUGUST 5, 2024

This is largely due to widespread skepticism regarding ambitious claims about AI’s potential to revolutionize cancer treatment, coupled with the relatively slow integration of AI technologies across various healthcare disciplines. Concerns about data security, privacy, and accuracy have been at the forefront of these discussions.

Experimentation 124

Experimentation Risk Metadata Data-driven 124

CIO Business Intelligence

JUNE 24, 2024

What revolutionary technology were they referring to? But in the short run, we risk building an astonishing, awe-inspiring technology that few use. Just look at Apple’s Vision Pro as a tale of a brilliant piece of technology that the world is still trying to wrap its mind around. The Segway.

Risk 141

Risk Experimentation Enterprise Technology 141

CIO Business Intelligence

NOVEMBER 13, 2024

When asked if AI Companion could put business process analysts at risk, Vietor said, to the contrary, it will help them “concentrate on the value creation part of the job, like optimizing the process and managing/governing the change. We reduce the manual (not loved) efforts and improve the quality dramatically.”

Experimentation 113

Experimentation Testing Software Risk 113

CIO Business Intelligence

NOVEMBER 4, 2024

IDC, for instance, recommends the NIST AI Risk Management Framework as a suitable standard to help CIOs develop AI governance in house, as well as EU AI ACT provisions, says Trinidad, who cites best practices for some aspects of AI governance in “ IDC PeerScape: Practices for Securing AI Models and Applications.”

Uncertainty 137

Uncertainty Cost-Benefit Risk Experimentation 137

CIO Business Intelligence

SEPTEMBER 12, 2024

The familiar narrative illustrates the double-edged sword of “shadow AI”—technologies used to accomplish AI-powered tasks without corporate approval or oversight, bringing quick wins but potentially exposing organizations to significant risks. Establish continuous training emphasizing ethical considerations and potential risks.

Experimentation 111

Experimentation Risk Cost-Benefit Strategy 111

Rocket-Powered Data Science

FEBRUARY 15, 2023

Third, any commitment to a disruptive technology (including data-intensive and AI implementations) must start with a business strategy. 3) How do we get started, when, who will be involved, and what are the targeted benefits, results, outcomes, and consequences (including risks)?

Strategy 290

Strategy Experimentation Uncertainty Machine Learning 290

O'Reilly on Data

MAY 14, 2020

AI PMs should enter feature development and experimentation phases only after deciding what problem they want to solve as precisely as possible, and placing the problem into one of these categories. Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model.

Management 363

Management Experimentation B2B Machine Learning 363

CIO Business Intelligence

OCTOBER 3, 2024

As the technology matures, we’re also learning more about its potential, shortcomings, and barriers to entry—ethical considerations, accuracy, hallucinations, and more. A recently conducted survey by Gradient Flow explores the state of GenAI in healthcare, an industry that’s been on the pulse of the technology since inception.

Testing 129

Testing Cost-Benefit Experimentation Risk 129

CIO Business Intelligence

AUGUST 15, 2024

Many of those gen AI projects will fail because of poor data quality, inadequate risk controls, unclear business value , or escalating costs , Gartner predicts. As the gen AI hype subsides, Stephenson sees IT leaders reevaluating their strategies in favor of other AI technologies.

ROI 143

ROI Cost-Benefit Experimentation Deep Learning 143

CIO Business Intelligence

JULY 12, 2024

About six years ago, Ulta Beauty formed a dedicated innovation team to identify technologies that resonate to improve the customer experience. Not only does this particular low-code solution make rapid experimentation possible, it also offers orchestration capabilities so we can plug different services in and out very quickly,” says Pacynski.

Experimentation 124

Experimentation Testing Enterprise Strategy 124

O'Reilly on Data

JULY 28, 2020

Without clarity in metrics, it’s impossible to do meaningful experimentation. The Ethical OS also provides excellent tools for thinking through the impact of technologies. Experimentation should show you how your customers use your site, and whether a recommendation engine would help the business.

Marketing 363

Marketing Experimentation Metrics Testing 363

CIO Business Intelligence

APRIL 12, 2024

This anticipated move could completely transform how these companies hire new employees and how they manage and deliver the technology employees use. Right now most organizations tend to be in the experimental phases of using the technology to supplement employee tasks, but that is likely to change, and quickly, experts say.

Experimentation 143

Experimentation Reporting Testing Statistics 143

CIO Business Intelligence

OCTOBER 8, 2024

An IBM report based on the survey, “6 blind spots tech leaders must reveal,” describes the huge expectations that modern IT leaders face: “For technology to deliver enterprise-wide business outcomes, tech leaders must be part mastermind, part maestro,” the report says.

IT 140

IT Strategy Experimentation Technology 140

CIO Business Intelligence

JULY 1, 2024

Shortcomings in incident reporting are leaving a dangerous gap in the regulation of AI technologies. By documenting cases where automated systems misbehave, glitch or jeopardize users, we can better discern problematic patterns and mitigate risks. Incident reporting can help AI researchers and developers to learn from past failures.

Reporting 129

Reporting Risk Management Experimentation Risk 129

CIO Business Intelligence

OCTOBER 5, 2023

Sandeep Davé knows the value of experimentation as well as anyone. As chief digital and technology officer at CBRE, Davé recognized early that the commercial real estate industry was ripe for AI and machine learning enhancements, and he and his team have tested countless use cases across the enterprise ever since.

Experimentation 130

Experimentation Strategy Machine Learning Interactive 130

Domino Data Lab

AUGUST 6, 2021

Model Risk Management is about reducing bad consequences of decisions caused by trusting incorrect or misused model outputs. Systematically enabling model development and production deployment at scale entails use of an Enterprise MLOps platform, which addresses the full lifecycle including Model Risk Management. What Is Model Risk?

Risk Management 64

Risk Management Risk Modeling Enterprise 64

CIO Business Intelligence

JUNE 21, 2024

Its researchers have long been working with IBM’s Watson AI technology, and so it would come as little surprise that — when OpenAI released ChatGPT based on GPT 3.5 in late November 2022 — MITRE would be among the first organizations looking to capitalize on the technology, launching MITREChatGPT a month later. We took a risk.

Experimentation 134

Experimentation Data mining Reporting Data Processing 134

CIO Business Intelligence

AUGUST 30, 2023

But as organizations look to quickly leverage the power of emerging digital technologies for business growth, such an approach is falling short on expectations. To capitalize on the gains offered by digital technologies, CIOs are building technology portfolios by allocating diverse investments based on prospective risk, reward, and value.

Digital Transformation 105

Digital Transformation ROI Experimentation Risk 105

CIO Business Intelligence

AUGUST 2, 2023

The survey found tension between business leaders seeking competitive advantage, and IT leaders wanting to limit risks. Interestingly, non-IT leaders were more likely to report actively using generative AI (73%) than IT leaders (59%), suggesting there’s plenty of experimentation going on beyond the purview of the IT department.

Enterprise 98

Enterprise Experimentation Manufacturing Risk 98

CIO Business Intelligence

SEPTEMBER 6, 2023

While the potential of Generative AI in software development is exciting, there are still risks and guardrails that need to be considered. However, despite its intelligence and benefits to automating pipelines, the technology is still far from completely replacing human developers.

Software 119

Software Experimentation Risk Uncertainty 119

IBM Big Data Hub

JUNE 10, 2024

In this blog, we’ll explore how businesses can use both on-premises and cloud XaaS to control budgets in the age of AI, driving financial sustainability without compromising on technological advancement. Embracing a culture of experimentation helps businesses drive innovation while minimizing financial risk.

Experimentation 62

Experimentation Optimization Risk Management Modeling 62

CIO Business Intelligence

APRIL 29, 2024

As organizations roll out AI applications and AI-enabled smartphones and devices, IT leaders may need to sell the benefits to employees or risk those investments falling short of business expectations. They need to have a culture of experimentation.” CIOs should be “change agents” who “embrace the art of the possible,” he says.

Forecasting 135

Forecasting Experimentation Risk Consulting 135

CIO Business Intelligence

APRIL 26, 2023

“Startup” means risk. But despite the high risk/reward framework, these Victory-or-Bust ventures don’t have the market cornered on agility and innovation. More than an experimental group, they hold themselves accountable the same way any startup should. Why not both? The alternative is shuttering for good.

Technology 52

Technology Marketing Experimentation Modeling 52

CIO Business Intelligence

NOVEMBER 21, 2023

Ask IT leaders about their challenges with shadow IT, and most will cite the kinds of security, operational, and integration risks that give shadow IT its bad rep. That’s not to downplay the inherent risks of shadow IT. Following are seven steps to guide this transformation for competitive advantage.

IT 137

IT Risk Cost-Benefit Risk Management 137

CIO Business Intelligence

JUNE 13, 2024

Proof that even the most rigid of organizations are willing to explore generative AI arrived this week when the US Department of the Air Force (DAF) launched an experimental initiative aimed at Guardians, Airmen, civilian employees, and contractors. As tech leaders, we have a responsibility to ensure that models are fit for the purpose.

Testing 119

Testing Experimentation Data Processing Modeling 119

CIO Business Intelligence

SEPTEMBER 12, 2024

It is often suggested that rapid advances in technology are threatening jobs in the IT sector perhaps more than any other. Among the cited factors are the rapid popularity of AI technologies and the desire to automate many processes. As the velocity of change and delivery increases, the technology roles will only have more work to do.”

Management 115

Management IT Experimentation Technology 115

CIO Business Intelligence

OCTOBER 24, 2024

Noting that companies pursued bold experiments in 2024 driven by generative AI and other emerging technologies, the research and advisory firm predicts a pivot to realizing value. Forrester said most technology executives expect their IT budgets to increase in 2025. Others won’t — and will come up against the limits of quick fixes.”

ROI 122

ROI Data-driven Enterprise Experimentation 122

CIO Business Intelligence

OCTOBER 3, 2024

It’s not the technologies they use. It’s a natural fit and will be interesting to see how these ensemble AI models work and what use cases will go from experimentation to production,” says Dyer. Gen AI is a nascent and fast evolving technology. It’s not the cloud provider they use.

Machine Learning 140

Machine Learning Experimentation Insurance Modeling 140

Ontotext

APRIL 3, 2024

Nimit Mehta: I think that 2024 is going to be a buckle-down year, but, at the same time, we’ll see a rapid explosion of experimentation. Nimit Mehta : You are talking about the three big ones: cost, revenue, and risk. And, when you get to the top, it’s about risks and existential threats to the business. They are the best.”

Technology 59

Technology Risk Digital Transformation Measurement 59

Smart Data Collective

MAY 22, 2022

The decisions are based on extensive experimentation and research to improve effectiveness without altering customer experience. With AI, the risk score for a device doesn’t depend on individual indicators. Predicting If a Device Is at Risk. Therefore, the risk score is always being adjusted accordingly.

Data-driven 137

Data-driven Risk Experimentation IT 137

Smarten

MAY 17, 2023

If you are a business owner, technology user or a fan of the news media, it would be difficult to avoid the topic of GPT and artificial intelligence (AI) in today’s news cycle. ” If you are like most businesses, you want to get ahead of the competition but, you don’t want to make a misstep or exposure the enterprise to unnecessary risk.

Digital Transformation 52

Digital Transformation Experimentation Risk Testing 52