O'Reilly on Data

JANUARY 21, 2025

Security Letting LLMs make runtime decisions about business logic creates unnecessary risk. But the truth is that structured automation simplifies edge-case management by making LLM improvisation safe and measurable. Heres how it works: Low-risk or rare tasks can be handled flexibly by LLMs in the short term.

Cost-Benefit 292

Cost-Benefit Testing Interactive Software 292

datapine

MAY 31, 2022

This increases the risks that can arise during the implementation or management process. The risks of cloud computing have become a reality for every organization, be it small or large. That’s why it is important to implement a secure BI cloud tool that can leverage proper security measures. Cost management and containment.

Risk 237

Risk Cost-Benefit Business Intelligence Data-driven 237

CIO Business Intelligence

JANUARY 14, 2025

How does our AI strategy support our business objectives, and how do we measure its value? Meanwhile, he says establishing how the organization will measure the value of its AI strategy ensures that it is poised to deliver impactful outcomes because, to create such measures, teams must name desired outcomes and the value they hope to get.

Strategy 141

Strategy ROI Experimentation Risk 141

CIO Business Intelligence

OCTOBER 24, 2024

From prompt injections to poisoning training data, these critical vulnerabilities are ripe for exploitation, potentially leading to increased security risks for businesses deploying GenAI. Artificial Intelligence: A turning point in cybersecurity The cyber risks introduced by AI, however, are more than just GenAI-based.

Risk 128

Risk Measurement Optimization Machine Learning 128

CIO Business Intelligence

JANUARY 6, 2025

One of them is Katherine Wetmur, CIO for cyber, data, risk, and resilience at Morgan Stanley. Wetmur says Morgan Stanley has been using modern data science, AI, and machine learning for years to analyze data and activity, pinpoint risks, and initiate mitigation, noting that teams at the firm have earned patents in this space.

IT 140

IT Cost-Benefit Measurement Experimentation 140

Analytics Vidhya

DECEMBER 20, 2023

This comprehensive strategy mainly aims to measure and forecast potential risks associated with AI development. OpenAI, the renowned artificial intelligence research organization, has recently announced the adoption of its new preparedness framework.

Forecasting 337

Forecasting Measurement Strategy Risk 337

CIO Business Intelligence

JANUARY 23, 2024

Regardless of where organizations are in their digital transformation, CIOs must provide their board of directors, executive committees, and employees definitions of successful outcomes and measurable key performance indicators (KPIs). He suggests, “Choose what you measure carefully to achieve the desired results.

Measurement 141

Measurement Digital Transformation KPI Metrics 141

CIO Business Intelligence

JANUARY 14, 2025

By articulating fitness functions automated tests tied to specific quality attributes like reliability, security or performance teams can visualize and measure system qualities that align with business goals. Technical foundation Conversation starter : Are we maintaining reliable roads and utilities, or are we risking gridlock?

Enterprise 119

Enterprise Technology Metrics Measurement 119

Analytics Vidhya

JANUARY 15, 2024

In a startling revelation, researchers at Anthropic have uncovered a disconcerting aspect of Large Language Models (LLMs) – their capacity to behave deceptively in specific situations, eluding conventional safety measures.

Measurement 315

Measurement Risk Modeling Analytics 315

CIO Business Intelligence

OCTOBER 16, 2024

In the executive summary of the updated RSP , Anthropic stated, “in September 2023, we released our Responsible Scaling Policy (RSP), a public commitment not to train or deploy models capable of causing catastrophic harm unless we have implemented safety and security measures that will keep risks below acceptable levels.

Risk 117

Risk IT Measurement Modeling 117

CIO Business Intelligence

SEPTEMBER 17, 2024

CISOs can only know the performance and maturity of their security program by actively measuring it themselves; after all, to measure is to know. However, CISOs aren’t typically measuring their security program proactively or methodically to understand their current security program.

Measurement 111

Measurement Metrics Risk Dashboards 111

CIO Business Intelligence

OCTOBER 23, 2024

Despite AI’s potential to transform businesses, many senior technology leaders find themselves wrestling with unpredictable expenses, uneven productivity gains, and growing risks as AI adoption scales, Gartner said. This creates new risks around data privacy, security, and consistency, making it harder for CIOs to maintain control.

Enterprise 141

Enterprise Cost-Benefit Broadcasting Risk 141

CIO Business Intelligence

NOVEMBER 11, 2024

In today’s fast-paced digital environment, enterprises increasingly leverage AI and analytics to strengthen their risk management strategies. A recent panel on the role of AI and analytics in risk management explored this transformational technology, focusing on how organizations can harness these tools for a more resilient future.

Risk Management 59

Risk Management Risk Management Data-driven 59

CIO Business Intelligence

MAY 24, 2024

GRC certifications validate the skills, knowledge, and abilities IT professionals have to manage governance, risk, and compliance (GRC) in the enterprise. Enter the need for competent governance, risk and compliance (GRC) professionals. What are GRC certifications? Why are GRC certifications important?

Risk 119

Risk Risk Management Management Enterprise 119

CIO Business Intelligence

NOVEMBER 27, 2024

Unfortunately, implementing AI at scale is not without significant risks; whether it’s breaking down entrenched data siloes or ensuring data usage complies with evolving regulatory requirements. The platform also offers a deeply integrated set of security and governance technologies, ensuring comprehensive data management and reducing risk.

Data Governance 132

Data Governance Risk Insurance Metadata 132

CIO Business Intelligence

OCTOBER 22, 2024

Singapore has rolled out new cybersecurity measures to safeguard AI systems against traditional threats like supply chain attacks and emerging risks such as adversarial machine learning, including data poisoning and evasion attacks.

Machine Learning 119

Machine Learning Measurement Risk IT 119

CIO Business Intelligence

AUGUST 21, 2024

It wasn’t just a single measurement of particulates,” says Chris Mattmann, NASA JPL’s former chief technology and innovation officer. “It It was many measurements the agents collectively decided was either too many contaminants or not.” They also had extreme measurement sensitivity. Adding smarter AI also adds risk, of course.

Risk 136

Risk Insurance Cost-Benefit Software 136

CIO Business Intelligence

MARCH 25, 2025

CIOs perennially deal with technical debts risks, costs, and complexities. While the impacts of legacy systems can be quantified, technical debt is also often embedded in subtler ways across the IT ecosystem, making it hard to account for the full list of issues and risks.

Risk 140

Risk Cost-Benefit Data-driven Digital Transformation 140

O'Reilly on Data

JUNE 15, 2023

Should we risk loss of control of our civilization?” If we want prosocial outcomes, we need to design and report on the metrics that explicitly aim for those outcomes and measure the extent to which they have been achieved. Should we automate away all the jobs, including the fulfilling ones?

Metrics 357

Metrics Reporting Measurement Finance 357

CIO Business Intelligence

DECEMBER 20, 2023

This has spurred interest around understanding and measuring developer productivity, says Keith Mann, senior director, analyst, at Gartner. Therefore, engineering leadership should measure software developer productivity, says Mann, but also understand how to do so effectively and be wary of pitfalls.

Measurement 124

Measurement Software IT Metrics 124

CIO Business Intelligence

DECEMBER 3, 2024

The US has announced sweeping new measures targeting China’s semiconductor sector, restricting the export of chipmaking equipment and high-bandwidth memory. Lam Research has said on its website that its initial assessment suggests the impact of the newly announced measures on its business will align largely with its earlier expectations.

Manufacturing 121

Manufacturing Measurement Technology Marketing 121

CIO Business Intelligence

OCTOBER 22, 2024

By 2028, 40% of large enterprises will deploy AI to manipulate and measure employee mood and behaviors, all in the name of profit. “AI By 2027, 70% of healthcare providers will include emotional-AI-related terms and conditions in technology contracts or risk billions in financial harm.

Enterprise 135

Enterprise Risk IoT Cost-Benefit 135

CIO Business Intelligence

APRIL 23, 2024

As CIO, you’re in the risk business. Or rather, every part of your responsibilities entails risk, whether you’re paying attention to it or not. There are, for example, those in leadership roles who, while promoting the value of risk-taking, also insist on “holding people accountable.” You can’t lose.

Risk 116

Risk IT Insurance Risk Management 116

CIO Business Intelligence

DECEMBER 10, 2024

Set clear, measurable metrics around what you want to improve with generative AI, including the pain points and the opportunities, says Shaown Nandi, director of technology at AWS. In HR, measure time-to-hire and candidate quality to ensure AI-driven recruitment aligns with business goals.

Sales 143

Sales Metrics Data-driven Unstructured Data 143

O'Reilly on Data

MARCH 25, 2025

The coordination tax: LLM outputs are often evaluated by nontechnical stakeholders (legal, brand, support) not just for functionality, but for tone, appropriateness, and risk. How will you measure success? So now we have a user persona, several scenarios, and a way to measure success. We asked them: Who are you building it for?

Testing 174

Testing Data-driven Software Measurement 174

CIO Business Intelligence

DECEMBER 20, 2024

As concerns about AI security, risk, and compliance continue to escalate, practical solutions remain elusive. as AI adoption and risk increases, its time to understand why sweating the small and not-so-small stuff matters and where we go from here. AI usage may bring the risk of sensitive data exfiltration through AI interactions.

Risk 105

Risk Measurement Interactive Modeling 105

CIO Business Intelligence

DECEMBER 5, 2024

Tech supply chain risks South Korea’s semiconductor ecosystem, driven by industry leaders like Samsung and SK Hynix, is a cornerstone of global technology supply chains. This approach also involves mitigating risks associated with single points of failure, and the political instability in South Korea underscores this need.

Uncertainty 111

Uncertainty Risk Strategy Manufacturing 111

CIO Business Intelligence

AUGUST 13, 2024

As with any new technology, however, security must be designed into the adoption of AI in order to minimize potential risks. How can you close security gaps related to the surge in AI apps in order to balance both the benefits and risks of AI? The need for robust security measures is underscored by several key factors.

Risk 119

Risk Cost-Benefit Enterprise Modeling 119

CIO Business Intelligence

FEBRUARY 20, 2024

The risks and opportunities of AI AI is opening a new front in this cyberwar. These measures mandate that healthcare organisations adequately protect patient data, and that notification must be given in the event of a data breach. The healthcare sector is far and away the number one target for cybercriminals.

Risk 122

Risk Insurance Measurement Strategy 122

CIO Business Intelligence

APRIL 8, 2025

Fragmented systems, inconsistent definitions, legacy infrastructure and manual workarounds introduce critical risks. The decisions you make, the strategies you implement and the growth of your organizations are all at risk if data quality is not addressed urgently. Manual entries also introduce significant risks.

Data Quality 102

Data Quality Data-driven Key Performance Indicator Metadata 102

CIO Business Intelligence

JANUARY 21, 2025

Deloittes State of Generative AI in the Enterprise reports nearly 70% have moved 30% or fewer of their gen AI experiments into production, and 41% of organizations have struggled to define and measure the impacts of their gen AI efforts.

Cost-Benefit 142

Cost-Benefit Data-driven Strategy Marketing 142

CIO Business Intelligence

MARCH 19, 2024

Ask your average schmo what the biggest risks of artificial intelligence are, and their answers will likely include: (1) AI will make us humans obsolete; (2) Skynet will become real, making us humans extinct; and maybe (3) deepfake authoring tools will be used by bad people to do bad things. Risks perceived by an average schmo 1.

Risk 124

Risk Machine Learning Risk Management Measurement 124

CIO Business Intelligence

DECEMBER 9, 2024

Assuming a technology can capture these risks will fail like many knowledge management solutions did in the 90s by trying to achieve the impossible. Measuring AI ROI As the complexity of deploying AI within the enterprise becomes more apparent in 2025, concerns over ROI will also grow.

Enterprise 116

Enterprise Cost-Benefit ROI Measurement 116

O'Reilly on Data

JULY 15, 2019

After the 2008 financial crisis, the Federal Reserve issued a new set of guidelines governing models— SR 11-7 : Guidance on Model Risk Management. Note that the emphasis of SR 11-7 is on risk management.). Sources of model risk. Machine learning developers are beginning to look at an even broader set of risk factors.

Machine Learning 49

Machine Learning Management Enterprise Risk Management 49

CIO Business Intelligence

OCTOBER 21, 2024

However, the increasing integration of AI and IoT into everyday operations also brings new risks, including the potential for cyberattacks on interconnected devices, data breaches, and vulnerabilities within complex networks. When society and industry become digital the landscape of the threats increases tremendously.

IoT 119

IoT Digital Transformation Measurement Technology 119

CIO Business Intelligence

JANUARY 3, 2024

The risk of going out of business is just one of many disaster scenarios that early adopters have to grapple with. And it’s not just start-ups that can expose an enterprise to AI-related third-party risk. Model training Vendors training their models on customer data isn’t the only training-related risk of generative AI.

Risk 131

Risk Enterprise Modeling Marketing 131

CIO Business Intelligence

MARCH 19, 2025

SpyCloud , the leading identity threat protection company, today released its 2025 SpyCloud Annual Identity Exposure Report , highlighting the rise of darknet-exposed identity data as the primary cyber risk facing enterprises today. SpyClouds collection of recaptured darknet data grew 22% in the past year , now encompassing more than 53.3

Risk 52

Risk Reporting Measurement Enterprise 52