DataKitchen

NOVEMBER 5, 2024

It is a layered approach to managing and transforming data. The need to copy data across layers, manage different schemas, and address data latency issues can complicate data pipelines. The Race For Data Quality In A Medallion Architecture The Medallion architecture pattern is gaining traction among data teams.

Data Quality 195

Data Quality Testing Metrics Reporting 195

CIO Business Intelligence

MARCH 25, 2025

CIOs perennially deal with technical debts risks, costs, and complexities. While the impacts of legacy systems can be quantified, technical debt is also often embedded in subtler ways across the IT ecosystem, making it hard to account for the full list of issues and risks.

Risk 140

Risk Cost-Benefit Data-driven Digital Transformation 140

CIO Business Intelligence

DECEMBER 11, 2024

This organism is the cornerstone of a companys competitive advantage, necessitating careful and responsible nurturing and management. This article proposes a methodology for organizations to implement a modern data management function that can be tailored to meet their unique needs.

Management 111

Management Data Governance Data Science Reporting 111

O'Reilly on Data

MARCH 31, 2020

If you’re already a software product manager (PM), you have a head start on becoming a PM for artificial intelligence (AI) or machine learning (ML). But there’s a host of new challenges when it comes to managing AI projects: more unknowns, non-deterministic outcomes, new infrastructures, new processes and new tools.

Management 363

Management Machine Learning Experimentation Metrics 363

DataKitchen

MARCH 20, 2025

They have demonstrated that robust, well-managed data processing pipelines inevitably yield reliable, high-quality data. Their data tables become dependable by-products of meticulously crafted and managed workflows. Each workflow is managed systematically, simplifying the integration of new data sources.

Data Quality 161

Data Quality Testing Metrics Management 161

O'Reilly on Data

JULY 15, 2019

In recent posts, we described requisite foundational technologies needed to sustain machine learning practices within organizations, and specialized tools for model development, model governance, and model operations/testing/monitoring. Note that the emphasis of SR 11-7 is on risk management.). Sources of model risk.

Machine Learning 52

Machine Learning Management Enterprise Risk Management 52

O'Reilly on Data

MARCH 25, 2025

Weve seen this across dozens of companies, and the teams that break out of this trap all adopt some version of Evaluation-Driven Development (EDD), where testing, monitoring, and evaluation drive every decision from the start. What breaks your app in production isnt always what you tested for in dev! The way out?

Testing 168

Testing Data-driven Software Measurement 168

CIO Business Intelligence

OCTOBER 23, 2024

Despite AI’s potential to transform businesses, many senior technology leaders find themselves wrestling with unpredictable expenses, uneven productivity gains, and growing risks as AI adoption scales, Gartner said. CIOs should create proofs of concept that test how costs will scale, not just how the technology works.”

Enterprise 141

Enterprise Cost-Benefit Broadcasting Risk 141

CIO Business Intelligence

JANUARY 14, 2025

Its typical for organizations to test out an AI use case, launching a proof of concept and pilot to determine whether theyre placing a good bet. But as CIOs devise their AI strategies, they must ask whether theyre prepared to move a successful AI test into production, Mason says. Am I engaging with the business to answer questions?

Strategy 141

Strategy ROI Experimentation Risk 141

CIO Business Intelligence

MARCH 19, 2025

Then in November, the company revealed its Azure AI Agent Service, a fully-managed service that lets enterprises build, deploy and scale agents quickly. Before that, though, ServiceNow announced its AI Agents offering in September, with the first use cases for customer service management and IT service management, available in November.

Software 143

Software Risk Enterprise Cost-Benefit 143

CIO Business Intelligence

SEPTEMBER 9, 2024

As IT landscapes and software delivery processes evolve, the risk of inadvertently creating new vulnerabilities increases. These risks are particularly critical for financial services institutions, which are now under greater scrutiny with the Digital Operational Resilience Act ( DORA ).

Risk Management 115

Risk Management Risk Management IT 115

CIO Business Intelligence

MARCH 25, 2025

The proof of concept (POC) has become a key facet of CIOs AI strategies, providing a low-stakes way to test AI use cases without full commitment. IT managers are leveraging this trend to try to get greenlights for broader technology efforts, Andersen says. Its going to vary dramatically.

ROI 127

ROI IT Experimentation Risk 127

CIO Business Intelligence

JANUARY 6, 2025

But as with any transformative technology, AI comes with risks chief among them, the perpetuation of biases and systemic inequities. If these relationships prioritize profit over fairness or innovation over inclusion, entire communities risk being excluded from the benefits of AI. Black professionals make up just 8.6%

IT 124

IT Risk Technology Testing 124

O'Reilly on Data

JUNE 15, 2023

Should we risk loss of control of our civilization?” They were not imposed from without, but were adopted because they allowed merchants to track and manage their own trading ventures. And they are stress testing and “ red teaming ” them to uncover vulnerabilities.

Metrics 359

Metrics Reporting Measurement Finance 359

datapine

OCTOBER 11, 2023

This is no different in the logistics industry, where warehouse managers track a range of KPIs that help them efficiently manage inventory, transportation, employee safety, and order fulfillment, among others. It allows for informed decision-making and efficient risk mitigation. Let’s dive in with the definition.

Metrics 217

Metrics KPI Management Cost-Benefit 217

CIO Business Intelligence

MAY 24, 2024

GRC certifications validate the skills, knowledge, and abilities IT professionals have to manage governance, risk, and compliance (GRC) in the enterprise. Enter the need for competent governance, risk and compliance (GRC) professionals. What are GRC certifications? Why are GRC certifications important?

Risk 119

Risk Risk Management Management Enterprise 119

CIO Business Intelligence

JANUARY 14, 2025

In todays digital economy, business objectives like becoming a leading global wealth management firm or being a premier destination for top talent demand more than just technical excellence. Most importantly, architects make difficult problems manageable. The stakes have never been higher. Shawn McCarthy 3.

Enterprise 119

Enterprise Technology Metrics Measurement 119

CIO Business Intelligence

JANUARY 7, 2025

Regardless of the driver of transformation, your companys culture, leadership, and operating practices must continuously improve to meet the demands of a globally competitive, faster-paced, and technology-enabled world with increasing security and other operational risks.

Digital Transformation 143

Digital Transformation Experimentation Cost-Benefit Strategy 143

AWS Big Data

JANUARY 9, 2025

In this post, we focus on data management implementation options such as accessing data directly in Amazon Simple Storage Service (Amazon S3), using popular data formats like Parquet, or using open table formats like Iceberg. Data management is the foundation of quantitative research.

Metadata 106

Metadata Snapshot Cost-Benefit Optimization 106

CIO Business Intelligence

JANUARY 21, 2025

Traditionally, the manager from the change advisory board (CAB) coordinates the teams and stakeholders, makes final decisions to approve or reject proposed changes, and directs the implementation of changes. The lack of a single approach to delivering changes increases the risk of introducing bugs or performance issues in production.

Data-driven 98

Data-driven Risk Interactive Management 98

CIO Business Intelligence

FEBRUARY 7, 2024

Key AI companies have told the UK government to speed up its safety testing for their systems, raising questions about future government initiatives that too may hinge on technology providers opening up generative AI models to tests before new releases hit the public.

Testing 124

Testing Reporting Risk Publishing 124

O'Reilly on Data

NOVEMBER 28, 2023

Unexpected outcomes, security, safety, fairness and bias, and privacy are the biggest risks for which adopters are testing. We’re not encouraging skepticism or fear, but companies should start AI products with a clear understanding of the risks, especially those risks that are specific to AI.

Enterprise 339

Enterprise Testing Modeling Reporting 339

CIO Business Intelligence

APRIL 23, 2024

As CIO, you’re in the risk business. Or rather, every part of your responsibilities entails risk, whether you’re paying attention to it or not. There are, for example, those in leadership roles who, while promoting the value of risk-taking, also insist on “holding people accountable.” You can’t lose.

Risk 116

Risk IT Insurance Risk Management 116

CIO Business Intelligence

JANUARY 6, 2025

One of them is Katherine Wetmur, CIO for cyber, data, risk, and resilience at Morgan Stanley. Wetmur says Morgan Stanley has been using modern data science, AI, and machine learning for years to analyze data and activity, pinpoint risks, and initiate mitigation, noting that teams at the firm have earned patents in this space.

IT 140

IT Cost-Benefit Measurement Experimentation 140

CIO Business Intelligence

AUGUST 21, 2024

Adding smarter AI also adds risk, of course. “At The big risk is you take the humans out of the loop when you let these into the wild.” When it comes to security, though, agentic AI is a double-edged sword with too many risks to count, he says. “We That means the projects are evaluated for the amount of risk they involve.

Risk 136

Risk Insurance Cost-Benefit Software 136

O'Reilly on Data

DECEMBER 12, 2019

1] This includes C-suite executives, front-line data scientists, and risk, legal, and compliance personnel. These recommendations are based on our experience, both as a data scientist and as a lawyer, focused on managing the risks of deploying ML. 6] Debugging may focus on a variety of failure modes (i.e., Sensitivity analysis.

Machine Learning 276

Machine Learning Modeling Testing Risk Management 276

CIO Business Intelligence

NOVEMBER 13, 2024

Managers tend to incentivize activity metrics and measure inputs versus outputs,” she adds. Employees who need to submit reports to their managers might be able to get those reports done faster, and increase the number and length of those reports. And we’re at risk of being burned out.” It gets beyond what we can manage.”

IT 141

IT Consulting ROI Cost-Benefit 141

CIO Business Intelligence

JANUARY 30, 2025

These changes can expose businesses to risks and vulnerabilities such as security breaches, data privacy issues and harm to the companys reputation. It also includes managing the risks, quality and accountability of AI systems and their outcomes. AI governance is critical and should never be just a regulatory requirement.

Testing 93

Testing Metrics Cost-Benefit Modeling 93

CIO Business Intelligence

FEBRUARY 21, 2025

In a damning audit report , Grant Thornton has exposed how the project implementation turned into a cautionary tale of project mismanagement, highlighting critical failures in governance, technical oversight, and vendor management that continue to impact the councils core operations.

Reporting 90

Reporting Risk Testing Risk Management 90

Timo Elliott

DECEMBER 10, 2024

One of the sessions I sat in at UKISUG Connect 2024 covered a real-world example of data management using a solution from Bluestonex Consulting , based on the SAP Business Technology Platform (SAP BTP). Impact of Errors : Erroneous data posed immediate risks to operations and long-term damage to customer trust.

Management 52

Management Data Governance Consulting Risk 52

CIO Business Intelligence

NOVEMBER 13, 2023

The challenge some companies face, however, is the change management of the structured approach for handling alterations within a development cycle. Change management is an enabling framework for managing people through a change, in this case, related to a product in production. Change management brings consistency to DevOps.

Management 133

Management Key Performance Indicator Testing Business Objectives 133

CIO Business Intelligence

DECEMBER 2, 2024

Business risk (liabilities): “Our legacy systems increase our cybersecurity exposure by 40%.” So it’s essential to show the ROI to your business from the management of these costs. Don’t get bogged down in testing multiple solutions that never see the light of day. Instead, show how leading companies manage it strategically.

ROI 136

ROI Cost-Benefit Metrics Strategy 136

datapine

SEPTEMBER 29, 2022

1) What Is Data Quality Management? However, with all good things comes many challenges and businesses often struggle with managing their information in the correct way. Enters data quality management. What Is Data Quality Management (DQM)? Why Do You Need Data Quality Management? Table of Contents.

Data Quality 241

Data Quality Metrics Data-driven Management 241

CIO Business Intelligence

OCTOBER 20, 2023

How does a company approach data integration and management when in the throes of an M&A? Organizations may feel the need to consolidate some of the new data they’ve acquired to better manage and glean straightforward insights, but this is not the case.

Data Integration 130

Data Integration Management Testing Cost-Benefit 130

CIO Business Intelligence

OCTOBER 17, 2024

While tech debt refers to shortcuts taken in implementation that need to be addressed later, digital addiction results in the accumulation of poorly vetted, misused, or unnecessary technologies that generate costs and risks. Striking this balance is delicate and requires careful management.

Risk 108

Risk Experimentation Testing Strategy 108

CIO Business Intelligence

MARCH 5, 2025

If they decide a project could solve a big enough problem to merit certain risks, they then make sure they understand what type of data will be needed to address the solution. The next thing is to make sure they have an objective way of testing the outcome and measuring success. But we dont ignore the smaller players.

Testing 99

Testing Measurement Technology Experimentation 99

CIO Business Intelligence

JUNE 13, 2024

They don’t train to fight in zero gravity, though: They are mostly computer experts charged with things like preventing cyberattacks, maintaining computer networks, and managing satellite communications.) (Guardians are enlisted members of the US Space Force, a service created under the DAF umbrella in 2019.

Testing 119

Testing Experimentation Data Processing Modeling 119