DataKitchen

NOVEMBER 5, 2024

It is a layered approach to managing and transforming data. The need to copy data across layers, manage different schemas, and address data latency issues can complicate data pipelines. The Race For Data Quality In A Medallion Architecture The Medallion architecture pattern is gaining traction among data teams.

Data Quality 195

Data Quality Testing Metrics Reporting 195

CIO Business Intelligence

DECEMBER 11, 2024

This organism is the cornerstone of a companys competitive advantage, necessitating careful and responsible nurturing and management. This article proposes a methodology for organizations to implement a modern data management function that can be tailored to meet their unique needs.

Management 111

Management Data Governance Data Science Reporting 111

O'Reilly on Data

MARCH 31, 2020

If you’re already a software product manager (PM), you have a head start on becoming a PM for artificial intelligence (AI) or machine learning (ML). But there’s a host of new challenges when it comes to managing AI projects: more unknowns, non-deterministic outcomes, new infrastructures, new processes and new tools.

Management 363

Management Machine Learning Experimentation Metrics 363

O'Reilly on Data

JULY 15, 2019

In recent posts, we described requisite foundational technologies needed to sustain machine learning practices within organizations, and specialized tools for model development, model governance, and model operations/testing/monitoring. Note that the emphasis of SR 11-7 is on risk management.). Sources of model risk.

Machine Learning 52

Machine Learning Management Enterprise Risk Management 52

CIO Business Intelligence

MAY 20, 2025

Supply chain management (SCM) is a critical focus for companies that sell products, services, hardware, and software. Optimizing the supply chain with AI AI is quickly being implemented across industries with the goal to improve efficiency and productivity, and supply chain management is no exception. was released in 2017 by the ASCM.

Modeling 104

Modeling Management Metrics Measurement 104

CIO Business Intelligence

MARCH 25, 2025

CIOs perennially deal with technical debts risks, costs, and complexities. While the impacts of legacy systems can be quantified, technical debt is also often embedded in subtler ways across the IT ecosystem, making it hard to account for the full list of issues and risks.

Risk 140

Risk Cost-Benefit Data-driven Digital Transformation 140

DataKitchen

MAY 17, 2025

Naturally, the airline’s Wi-Fi was terrible, but I managed to get through to a colleague, who knew little about the project. An embedded test had failed. And I was tempted, so tempted, as the clock kept ticking, to disable the test and let it go. Then it dawned on me that this test wasnt even ours. The takeaway?

Testing 118

Testing Data Quality Data Warehouse Dashboards 118

DataKitchen

MARCH 20, 2025

They have demonstrated that robust, well-managed data processing pipelines inevitably yield reliable, high-quality data. Their data tables become dependable by-products of meticulously crafted and managed workflows. Each workflow is managed systematically, simplifying the integration of new data sources.

Data Quality 161

Data Quality Testing Metrics Management 161

CIO Business Intelligence

OCTOBER 23, 2024

Despite AI’s potential to transform businesses, many senior technology leaders find themselves wrestling with unpredictable expenses, uneven productivity gains, and growing risks as AI adoption scales, Gartner said. CIOs should create proofs of concept that test how costs will scale, not just how the technology works.”

Enterprise 141

Enterprise Cost-Benefit Broadcasting Risk 141

CIO Business Intelligence

JANUARY 14, 2025

Its typical for organizations to test out an AI use case, launching a proof of concept and pilot to determine whether theyre placing a good bet. But as CIOs devise their AI strategies, they must ask whether theyre prepared to move a successful AI test into production, Mason says. Am I engaging with the business to answer questions?

Strategy 141

Strategy ROI Experimentation Risk 141

CIO Business Intelligence

SEPTEMBER 9, 2024

As IT landscapes and software delivery processes evolve, the risk of inadvertently creating new vulnerabilities increases. These risks are particularly critical for financial services institutions, which are now under greater scrutiny with the Digital Operational Resilience Act ( DORA ).

Risk Management 115

Risk Management Risk Management IT 115

O'Reilly on Data

MARCH 25, 2025

Weve seen this across dozens of companies, and the teams that break out of this trap all adopt some version of Evaluation-Driven Development (EDD), where testing, monitoring, and evaluation drive every decision from the start. What breaks your app in production isnt always what you tested for in dev! The way out?

Testing 177

Testing Data-driven Software Measurement 177

CIO Business Intelligence

JANUARY 6, 2025

But as with any transformative technology, AI comes with risks chief among them, the perpetuation of biases and systemic inequities. If these relationships prioritize profit over fairness or innovation over inclusion, entire communities risk being excluded from the benefits of AI. Black professionals make up just 8.6%

IT 124

IT Risk Technology Testing 124

O'Reilly on Data

JUNE 15, 2023

Should we risk loss of control of our civilization?” They were not imposed from without, but were adopted because they allowed merchants to track and manage their own trading ventures. And they are stress testing and “ red teaming ” them to uncover vulnerabilities.

Metrics 360

Metrics Reporting Measurement Finance 360

David Menninger's Analyst Perspectives

MAY 15, 2025

This impending shift not only poses significant risks for individuals but also presents a high-stakes event that every enterprise must anticipate and prepare for; inadequate preparation could lead to substantial data breaches, compromised systems and irrevocable damage to customer trust and organizational reputation.

Enterprise 130

Enterprise Risk Measurement Risk Management 130

CIO Business Intelligence

MARCH 19, 2025

Then in November, the company revealed its Azure AI Agent Service, a fully-managed service that lets enterprises build, deploy and scale agents quickly. Before that, though, ServiceNow announced its AI Agents offering in September, with the first use cases for customer service management and IT service management, available in November.

Software 143

Software Risk Enterprise Cost-Benefit 143

CIO Business Intelligence

MARCH 25, 2025

The proof of concept (POC) has become a key facet of CIOs AI strategies, providing a low-stakes way to test AI use cases without full commitment. IT managers are leveraging this trend to try to get greenlights for broader technology efforts, Andersen says. Its going to vary dramatically.

ROI 127

ROI IT Experimentation Risk 127

datapine

OCTOBER 11, 2023

This is no different in the logistics industry, where warehouse managers track a range of KPIs that help them efficiently manage inventory, transportation, employee safety, and order fulfillment, among others. It allows for informed decision-making and efficient risk mitigation. Let’s dive in with the definition.

Metrics 217

Metrics KPI Management Cost-Benefit 217

CIO Business Intelligence

JANUARY 14, 2025

In todays digital economy, business objectives like becoming a leading global wealth management firm or being a premier destination for top talent demand more than just technical excellence. Most importantly, architects make difficult problems manageable. The stakes have never been higher. Shawn McCarthy 3.

Enterprise 119

Enterprise Technology Metrics Measurement 119

CIO Business Intelligence

MAY 22, 2025

Data processing and management Once data is collected, it must be processed and managed efficiently. Advanced data management techniques, including big data technologies and distributed databases, are integral to handling vast amounts of data. Prototyping and testing. Ensure data quality. Collaborate with stakeholders.

Enterprise 112

Enterprise Visualization Key Performance Indicator Machine Learning 112

CIO Business Intelligence

JANUARY 7, 2025

Regardless of the driver of transformation, your companys culture, leadership, and operating practices must continuously improve to meet the demands of a globally competitive, faster-paced, and technology-enabled world with increasing security and other operational risks.

Digital Transformation 143

Digital Transformation Experimentation Cost-Benefit Strategy 143

AWS Big Data

JANUARY 9, 2025

In this post, we focus on data management implementation options such as accessing data directly in Amazon Simple Storage Service (Amazon S3), using popular data formats like Parquet, or using open table formats like Iceberg. Data management is the foundation of quantitative research.

Metadata 110

Metadata Snapshot Cost-Benefit Optimization 110

David Menninger's Analyst Perspectives

MAY 14, 2025

Good data governance provides guardrails that enable enterprises to act fast while protecting the business from risks related to regulatory requirements, data-quality issues and data-reliability concerns. Additionally, GenAI systems can exacerbate governance risks. Data governance is integral to an overall data intelligence strategy.

Data Governance 130

Data Governance Data Quality Data-driven Metadata 130

O'Reilly on Data

JUNE 19, 2019

One sure sign that companies are getting serious about machine learning is the growing popularity of tools designed specifically for managing the ML model development lifecycle, such as MLflow and Comet.ml. hyperparameter tuning, NAS ) while emphasizing the ease with which one can manage, track, and reproduce such experiments.

Modeling 256

Modeling Machine Learning Testing Metrics 256

CIO Business Intelligence

JANUARY 21, 2025

Traditionally, the manager from the change advisory board (CAB) coordinates the teams and stakeholders, makes final decisions to approve or reject proposed changes, and directs the implementation of changes. The lack of a single approach to delivering changes increases the risk of introducing bugs or performance issues in production.

Data-driven 98

Data-driven Risk Interactive Management 98

CIO Business Intelligence

FEBRUARY 7, 2024

Key AI companies have told the UK government to speed up its safety testing for their systems, raising questions about future government initiatives that too may hinge on technology providers opening up generative AI models to tests before new releases hit the public.

Testing 124

Testing Reporting Risk Publishing 124

O'Reilly on Data

NOVEMBER 28, 2023

Unexpected outcomes, security, safety, fairness and bias, and privacy are the biggest risks for which adopters are testing. We’re not encouraging skepticism or fear, but companies should start AI products with a clear understanding of the risks, especially those risks that are specific to AI.

Enterprise 343

Enterprise Testing Modeling Reporting 343

CIO Business Intelligence

MAY 24, 2024

GRC certifications validate the skills, knowledge, and abilities IT professionals have to manage governance, risk, and compliance (GRC) in the enterprise. Enter the need for competent governance, risk and compliance (GRC) professionals. What are GRC certifications? Why are GRC certifications important?

Risk 119

Risk Risk Management Management Enterprise 119

CIO Business Intelligence

APRIL 30, 2025

Cloud architects are responsible for managing the cloud computing architecture in an organization, especially as cloud technologies grow increasingly complex. These IT pros can help navigate the process, which can take years navigating potential risks and ensuring a smooth transition.

Testing 108

Testing Cost-Benefit Optimization Software 108

O'Reilly on Data

DECEMBER 12, 2019

1] This includes C-suite executives, front-line data scientists, and risk, legal, and compliance personnel. These recommendations are based on our experience, both as a data scientist and as a lawyer, focused on managing the risks of deploying ML. 6] Debugging may focus on a variety of failure modes (i.e., Sensitivity analysis.

Machine Learning 285

Machine Learning Modeling Testing Risk Management 285

CIO Business Intelligence

JANUARY 6, 2025

One of them is Katherine Wetmur, CIO for cyber, data, risk, and resilience at Morgan Stanley. Wetmur says Morgan Stanley has been using modern data science, AI, and machine learning for years to analyze data and activity, pinpoint risks, and initiate mitigation, noting that teams at the firm have earned patents in this space.

IT 140

IT Cost-Benefit Measurement Experimentation 140

CIO Business Intelligence

AUGUST 21, 2024

Adding smarter AI also adds risk, of course. “At The big risk is you take the humans out of the loop when you let these into the wild.” When it comes to security, though, agentic AI is a double-edged sword with too many risks to count, he says. “We That means the projects are evaluated for the amount of risk they involve.

Risk 136

Risk Insurance Cost-Benefit Software 136

CIO Business Intelligence

NOVEMBER 13, 2024

Managers tend to incentivize activity metrics and measure inputs versus outputs,” she adds. Employees who need to submit reports to their managers might be able to get those reports done faster, and increase the number and length of those reports. And we’re at risk of being burned out.” It gets beyond what we can manage.”

IT 141

IT Consulting ROI Cost-Benefit 141

CIO Business Intelligence

JANUARY 30, 2025

These changes can expose businesses to risks and vulnerabilities such as security breaches, data privacy issues and harm to the companys reputation. It also includes managing the risks, quality and accountability of AI systems and their outcomes. AI governance is critical and should never be just a regulatory requirement.

Testing 93

Testing Metrics Cost-Benefit Modeling 93

CIO Business Intelligence

APRIL 30, 2025

At ServiceNow, theyre infusing agentic AI into three core areas: answering customer or employee requests for things like technical support and payroll info; reducing workloads for teams in IT, HR, and customer service; and boosting developer productivity by speeding up coding and testing. High-volume, repetitive tasks are ideal for AI.

IT 139

IT Sales Cost-Benefit Data-driven 139

CIO Business Intelligence

FEBRUARY 21, 2025

In a damning audit report , Grant Thornton has exposed how the project implementation turned into a cautionary tale of project mismanagement, highlighting critical failures in governance, technical oversight, and vendor management that continue to impact the councils core operations.

Reporting 90

Reporting Risk Testing Risk Management 90

Timo Elliott

DECEMBER 10, 2024

One of the sessions I sat in at UKISUG Connect 2024 covered a real-world example of data management using a solution from Bluestonex Consulting , based on the SAP Business Technology Platform (SAP BTP). Impact of Errors : Erroneous data posed immediate risks to operations and long-term damage to customer trust.

Management 52

Management Data Governance Consulting Risk 52