CIO Business Intelligence

JANUARY 14, 2025

Its typical for organizations to test out an AI use case, launching a proof of concept and pilot to determine whether theyre placing a good bet. But as CIOs devise their AI strategies, they must ask whether theyre prepared to move a successful AI test into production, Mason says. Am I engaging with the business to answer questions?

Strategy 141

Strategy ROI Experimentation Risk 141

CIO Business Intelligence

JANUARY 14, 2025

By articulating fitness functions automated tests tied to specific quality attributes like reliability, security or performance teams can visualize and measure system qualities that align with business goals. Technical foundation Conversation starter : Are we maintaining reliable roads and utilities, or are we risking gridlock?

Enterprise 119

Enterprise Technology Metrics Measurement 119

O'Reilly on Data

JULY 15, 2019

In recent posts, we described requisite foundational technologies needed to sustain machine learning practices within organizations, and specialized tools for model development, model governance, and model operations/testing/monitoring. Note that the emphasis of SR 11-7 is on risk management.). Sources of model risk.

Machine Learning 52

Machine Learning Management Enterprise Risk Management 52

O'Reilly on Data

DECEMBER 12, 2019

1] This includes C-suite executives, front-line data scientists, and risk, legal, and compliance personnel. These recommendations are based on our experience, both as a data scientist and as a lawyer, focused on managing the risks of deploying ML. 6] Debugging may focus on a variety of failure modes (i.e., Sensitivity analysis.

Machine Learning 282

Machine Learning Modeling Testing Risk Management 282

bridgei2i

NOVEMBER 20, 2020

Episode 2: AI enabled Risk Management for FS powered by BRIDGEi2i Watchtower. AI enabled Risk Management for FS powered by BRIDGEi2i Watchtower. Today the Chief Risk Officers(CROs) struggle with the critical task of monitoring and assessing key risks in real time and firefight to mitigate any critical issues that arise.

Risk Management 92

Risk Management Risk Management Metrics 92

CIO Business Intelligence

MARCH 19, 2025

There are risks around hallucinations and bias, says Arnab Chakraborty, chief responsible AI officer at Accenture. Meanwhile, in December, OpenAIs new O3 model, an agentic model not yet available to the public, scored 72% on the same test. And EY uses AI agents in its third-party risk management service.

Software 143

Software Risk Enterprise Cost-Benefit 143

DataRobot Blog

APRIL 29, 2022

This provides a great amount of benefit, but it also exposes institutions to greater risk and consequent exposure to operational losses. The stakes in managing model risk are at an all-time high, but luckily automated machine learning provides an effective way to reduce these risks.

Risk 111

Risk Modeling IT Risk Management 111

CIO Business Intelligence

APRIL 23, 2024

As CIO, you’re in the risk business. Or rather, every part of your responsibilities entails risk, whether you’re paying attention to it or not. There are, for example, those in leadership roles who, while promoting the value of risk-taking, also insist on “holding people accountable.” You can’t lose.

Risk 116

Risk IT Insurance Risk Management 116

Domino Data Lab

AUGUST 6, 2021

Model Risk Management is about reducing bad consequences of decisions caused by trusting incorrect or misused model outputs. Systematically enabling model development and production deployment at scale entails use of an Enterprise MLOps platform, which addresses the full lifecycle including Model Risk Management.

Risk Management 64

Risk Management Risk Modeling Enterprise 64

CIO Business Intelligence

FEBRUARY 21, 2025

Integration with Oracles systems proved more complex than expected, leading to prolonged testing and spiraling costs, the report stated. Change requests affecting critical aspects of the solution were accepted late in the implementation cycle, creating unnecessary complexity and risk.

Reporting 90

Reporting Risk Testing Risk Management 90

Cloudera

JUNE 29, 2023

To ensure the stability of the US financial system, the implementation of advanced liquidity risk models and stress testing using (MI/AI) could potentially serve as a protective measure. To improve the way they model and manage risk, institutions must modernize their data management and data governance practices.

Data Architecture 85

Data Architecture Risk Management Risk Management 85

CIO Business Intelligence

MARCH 4, 2025

In fact, successful recovery from cyberattacks and other disasters hinges on an approach that integrates business impact assessments (BIA), business continuity planning (BCP), and disaster recovery planning (DRP) including rigorous testing. See also: How resilient CIOs future-proof to mitigate risks.)

Testing 64

Testing Risk Consulting Risk Management 64

Cloudera

JULY 15, 2021

We recently hosted a roundtable focused on o ptimizing risk and exposure management with data insights. For financial institutions and insurers, risk and exposure management has always been a fundamental tenet of the business. Now, risk management has become exponentially complicated in multiple dimensions. .

Risk 100

Risk Optimization Management Insurance 100

Cloudera

MARCH 2, 2022

Risk management is a highly dynamic discipline these days. Stress testing is a particular area that has become even more important throughout the pandemic. Similarly, the European Central Bank is issuing stress testing requirements related to climate risk given the potential economic shifts related to addressing climate change.

Testing 95

Testing Management Risk Management Forecasting 95

CIO Business Intelligence

AUGUST 4, 2023

In collaboration with our peers, we have a solid business sense that carefully weighs innovation and risk in order to gain valuable ROI while protecting the organization from all forms of risk associated with each project. If reversible, then there’s clearly less risk. What’s new and different today?

Risk 98

Risk Risk Management ROI Technology 98

Cloudera

FEBRUARY 4, 2021

Financial services institutions need the ability to analyze and act on massive volumes of data from diverse sources in order to monitor, model, and manage risk across the enterprise. They need a comprehensive data and analytics platform to model risk exposures on-demand. Cloudera is that platform. End-to-end Data Lifecycle.

Risk 88

Risk Marketing Technology Management 88

Cloudera

OCTOBER 20, 2021

As part of these efforts, disclosure requirements will mandate that firms provide “the impact of a company’s activities on the environment and society, as well as the business and financial risks faced by a company due to its sustainability exposures.” What are the key climate risk measurements and impacts? They need to understand;

Risk 80

Risk Modeling Risk Management Measurement 80

CIO Business Intelligence

MARCH 18, 2024

But while there’s plenty of excitement and change underway, security risks and vulnerabilities have continued to follow right alongside that innovation. Digital operational resilience testing : Sets out guidance for testing of existing recovery strategies to identify potential vulnerabilities.

Risk Management 120

Risk Management Insurance Risk Testing 120

CIO Business Intelligence

JANUARY 6, 2025

They protect customers, preserve systemic integrity, and help mitigate risks of financial crises. These regulations mandate strong risk management and incident response frameworks to safeguard financial operations against escalating technological threats.

Risk Management 52

Risk Management Risk Insurance Reporting 52

Smart Data Collective

SEPTEMBER 17, 2020

Financial institutions such as banks have to adhere to such a practice, especially when laying the foundation for back-test trading strategies. Here are a few of the advantages of Big Data in the banking and financial industry: Improvement in risk management operations. The Role of Big Data. Engaging the Workforce.

Big Data 145

Big Data Finance Risk Management Risk 145

Cloudera

MAY 18, 2021

These interactions are captured and the resulting synthetic data sets can be analysed for a number of applications, such as training models to detect emergent fraudulent behavior, or exploring “what-if” scenarios for risk management. Value-at-Risk (VaR) is a widely used metric in risk management. Intraday VaR.

Risk 99

Risk Marketing Risk Management Data-driven 99

Cloudera

MARCH 28, 2019

The trouble is, mortgage lenders persist in relying on historical macro-economic assumptions in their models so they risk repeating the errors of a decade ago when banks – and their regulators – failed to recognize the warning signs from a far richer source: low-level micro-economic data. Risk management 3.0.

Risk 74

Risk Management Risk Management Machine Learning 74

CIO Business Intelligence

SEPTEMBER 18, 2024

To Ragland, who also sits on several state agency and non-profit boards, one of the greatest responsibilities for today’s boards is in governing cyber security risk. And while board members are generally tuned in to the importance of cyber governance, they don’t always understand the true risks with cyber and their own governing role.

Risk 141

Risk Testing Strategy Risk Management 141

DataRobot Blog

JULY 22, 2022

At many organizations, the current framework focuses on the validation and testing of new models, but risk managers and regulators are coming to realize that what happens after model deployment is at least as important. They may not have been documented, tested, or actively monitored and maintained. Legacy Models.

Modeling 105

Modeling Risk Management Testing Risk 105

Domino Data Lab

AUGUST 6, 2021

All models require testing and auditing throughout their deployment and, because models are continually learning, there is always an element of risk that they will drift from their original standards. The primary focus of model governance involves tracking, testing and auditing. First is the data the model is using.

Machine Learning 145

Machine Learning Modeling Testing Data Science 145

CIO Business Intelligence

AUGUST 6, 2024

The incident not only affected the availability of crucial cybersecurity defenses but also laid bare the broader operational risks associated with third-party service dependencies. Vendor risk management Assess vendor capabilities: Regularly evaluate the risk management and disaster recovery capabilities of key vendors.

Risk Management 111

Risk Management Risk Testing Finance 111

Decision Management Solutions

APRIL 23, 2019

, in which he states there are only three levers of value in insurance: Sell More, Manage Risk Better (aka underwriting and adjusting), and Cost Less to Operate. Let’s dive into greater detail on the second lever – Manage Risk Better. Insurers can also manage risk more effectively through continuous improvement.

Insurance 69

Insurance Risk Technology Management 69

CIO Business Intelligence

SEPTEMBER 10, 2024

I built it externally for $50,000 in just five weeks—from concept to market testing. As we navigate this terrain, it’s essential to consider the potential risks and compliance challenges alongside the opportunities for innovation. However, its impact on culture must be carefully considered to maximize benefits and mitigate risks.

IT 122

IT Risk Risk Management Predictive Modeling 122

CIO Business Intelligence

NOVEMBER 7, 2024

This team addresses potential risks, manages AI across the company, provides guidance, implements necessary training, and keeps abreast of emerging regulatory changes. We are also testing it with engineering. Using a defensive and offensive strategy, we’ve taken decisive steps to ensure responsible innovation.

Insurance 120

Insurance Experimentation Testing Technology 120

CIO Business Intelligence

OCTOBER 15, 2024

But continuous deployment isn’t always appropriate for your business , stakeholders don’t always understand the costs of implementing robust continuous testing , and end-users don’t always tolerate frequent app deployments during peak usage. CrowdStrike recently made the news about a failed deployment impacting 8.5

Enterprise 143

Enterprise Testing Business Objectives Experimentation 143

DataRobot

OCTOBER 5, 2021

But the technology’s ability to unleash rapid impact with great scope and unique dimensions can also increase organizational risk. For companies implementing AI systems, that risk extends beyond revenue to the reputational damage of using an algorithm that is perceived to be discriminatory or harmful to vulnerable groups.

Risk Management 95

Risk Management Testing Risk Data Science 95

CIO Business Intelligence

JUNE 25, 2024

Charles Dickens’ Tale of Two Cities contrasts London’s order and safety with the chaos and risk of Paris. The CIO so-what test Given Apple’s status as company with the world’s second-highest market capitalization and second-highest overall profitability it’s hard to be too critical. And therein lies a cautionary tale for all CIOs.

Risk 118

Risk Risk Management Statistics Management 118

CIO Business Intelligence

MARCH 15, 2023

In reality, generative AI presents a number of new and transformed risks to the organization. A second, more pernicious risk is the fact that ChatGPT can write malware. Some of these components have professional teams that test and maintain them, releasing security patches as needed.

Digital Transformation 126

Digital Transformation Risk Risk Management Strategy 126

CIO Business Intelligence

FEBRUARY 20, 2025

If a database already exists, the available data must be tested and corrected. Solid reporting provides transparent, consistent and combined HR metrics essential for strategic planning, risk management and the management of HR measures. Subsequently, the reporting should be set up properly.

Big Data 84

Big Data Measurement Visualization Machine Learning 84

CIO Business Intelligence

APRIL 21, 2022

Combining Agile and DevOps with elements such as cloud, testing, security, risk management and compliance creates a modernized technology delivery approach that can help an organization achieve greater speed, reduced risk, and enhanced quality and experience. All hands on deck .

Digital Transformation 145

Digital Transformation Key Performance Indicator Risk Testing 145

CIO Business Intelligence

JULY 1, 2024

By documenting cases where automated systems misbehave, glitch or jeopardize users, we can better discern problematic patterns and mitigate risks. Real-time monitoring tools are essential, according to Luke Dash, CEO of risk management platform ISMS.online.

Reporting 129

Reporting Risk Management Experimentation Risk 129

CIO Business Intelligence

SEPTEMBER 17, 2024

All this while CIOs are under increased pressure to deliver more competitive capabilities, reduce security risks, connect AI with enterprise data, and automate more workflows — all areas where architecture disciplines have a direct role in influencing outcomes.

Enterprise 145

Enterprise Digital Transformation Cost-Benefit Risk 145