O'Reilly on Data

MARCH 25, 2025

Throughout this article, well explore real-world examples of LLM application development and then consolidate what weve learned into a set of first principlescovering areas like nondeterminism, evaluation approaches, and iteration cyclesthat can guide your work regardless of which models or frameworks you choose. How will you measure success?

Testing 174

Testing Data-driven Software Measurement 174

CIO Business Intelligence

APRIL 30, 2025

Uniteds methodical building of data infrastructure, compliance frameworks, and specialized talent demonstrates how traditional companies can develop true AI readiness that delivers measurable results for both customers and employees. How have you prepared United Airlines for the current state of AI innovation?

Strategy 82

Strategy Data Science Modeling Risk Management 82

CIO Business Intelligence

JANUARY 21, 2025

Deloittes State of Generative AI in the Enterprise reports nearly 70% have moved 30% or fewer of their gen AI experiments into production, and 41% of organizations have struggled to define and measure the impacts of their gen AI efforts. Even this breakdown leaves out data management, engineering, and security functions.

Cost-Benefit 142

Cost-Benefit Data-driven Strategy Marketing 142

CIO Business Intelligence

APRIL 8, 2025

Rule 1: Start with an acceptable risk appetite level Once a CIO understands their organizations risk appetite, everything else strategy, innovation, technology selection can align smoothly, says Paola Saibene, principal consultant at enterprise advisory firm Resultant. Cybersecurity is now a multi-front war, Selby says.

Risk Management 131

Risk Management Risk Management Business Objectives 131

CIO Business Intelligence

APRIL 8, 2025

I aim to outline pragmatic strategies to elevate data quality into an enterprise-wide capability. Key recommendations include investing in AI-powered cleansing tools and adopting federated governance models that empower domains while ensuring enterprise alignment. When financial data is inconsistent, reporting becomes unreliable.

Data Quality 102

Data Quality Data-driven Key Performance Indicator Metadata 102

CIO Business Intelligence

OCTOBER 23, 2024

In a survey of 451 senior technology executives conducted by Gartner in mid-2024, a striking 57% of CIOs reported being tasked with leading AI strategies. You must understand the cost components and pricing model options, and you need to know how to reduce these costs and negotiate with vendors.

Enterprise 141

Enterprise Cost-Benefit Broadcasting Risk 141

O'Reilly on Data

MARCH 31, 2020

This means that the AI products you build align with your existing business plans and strategies (or that your products are driving change in those plans and strategies), that they are delivering value to the business, and that they are delivered on time. Models also become stale and outdated over time.

Management 363

Management Machine Learning Experimentation Metrics 363

CIO Business Intelligence

JANUARY 21, 2025

Well also examine strategies CIOs can use to address these challenges, ensuring their organizations can recognize the rewards of GenAI without compromising financial stability. Excessive infrastructure costs: About 21% of IT executives point to the high cost of training models or running GenAI apps as a major concern.

Cost-Benefit 98

Cost-Benefit ROI Measurement Strategy 98

CIO Business Intelligence

APRIL 30, 2025

Wereinfusing AI agents everywhereto reimagine how we work and drive measurable value. As Xerox continues its reinvention, shifting from its traditional print roots to a services-led model, agentic AI fits well into that journey. Expect tighter AI-human collaboration, where AI handles execution, and humans focus on strategy.

IT 139

IT Sales Cost-Benefit Data-driven 139

CIO Business Intelligence

DECEMBER 18, 2024

Our history is rooted in a traditional distribution model of marketing, selling, and shipping vendor products to our resellers. What were the technical considerations moving from a distribution model to a platform? We divided the technical challenges into a few areas, none of which focused on an ERP rationalization strategy.

Digital Transformation 116

Digital Transformation Metrics Measurement ROI 116

O'Reilly on Data

SEPTEMBER 15, 2020

In my book, I introduce the Technical Maturity Model: I define technical maturity as a combination of three factors at a given point of time. Technical sophistication: Sophistication measures a team’s ability to use advanced tools and techniques (e.g., PyTorch, TensorFlow, reinforcement learning, self-supervised learning).

Advertising 362

Advertising Cost-Benefit ROI Machine Learning 362

O'Reilly on Data

MAY 14, 2020

Experimentation: It’s just not possible to create a product by building, evaluating, and deploying a single model. In reality, many candidate models (frequently hundreds or even thousands) are created during the development process. Modelling: The model is often misconstrued as the most important component of an AI product.

Management 364

Management Experimentation B2B Machine Learning 364

CIO Business Intelligence

FEBRUARY 27, 2024

C R Srinivasan, EVP of cloud and cybersecurity services and chief digital officer at Tata Communications, sees many enterprises “getting more nuanced” with their cloud use and strategies in an effort to balance performance, costs, and security. “As Cloud Computing, Data Center, Edge Computing, Hybrid Cloud, IT Strategy, Multi Cloud

Strategy 144

Strategy Cost-Benefit Data Processing Data-driven 144

CIO Business Intelligence

MAY 6, 2025

There is a clear rise in phishing, and the malicious use of artificial intelligence (AI) is bypassing traditional security measures. Security teams are under immense pressure to adopt strategies and systems that stave off evolving risks. Traditional security models: Whats the risk?

Modeling 71

Modeling Cost-Benefit Risk Technology 71

CIO Business Intelligence

DECEMBER 20, 2024

Its an offshoot of enterprise architecture that comprises the models, policies, rules, and standards that govern the collection, storage, arrangement, integration, and use of data in organizations. AI and machine learning models. Data modeling takes a more focused view of specific systems or business cases. Curate the data.

Data Architecture 122

Data Architecture Management Consulting Internet of Things 122

Rocket-Powered Data Science

MARCH 19, 2021

Focus on the strategies that aim these tools, talents, and technologies on reaching business mission and goals: e.g., data strategy, analytics strategy, observability strategy ( i.e., why and where are we deploying the data-streaming sensors, and what outcomes should they achieve?).

Internet of Things 259

Internet of Things Analytics IoT Prescriptive Analytics 259

CIO Business Intelligence

AUGUST 21, 2024

Given the nature of their business, costs for security are baked into the business model. Defense in depth How the CSP attracts, trains, and retains security professionals is certainly an issue to raise when vetting providers, along with the company’s overall security strategy.

Strategy 124

Strategy Measurement Risk Reporting 124

O'Reilly on Data

JULY 15, 2019

A look at how guidelines from regulated industries can help shape your ML strategy. In recent posts, we described requisite foundational technologies needed to sustain machine learning practices within organizations, and specialized tools for model development, model governance, and model operations/testing/monitoring.

Machine Learning 52

Machine Learning Management Enterprise Risk Management 52

CIO Business Intelligence

JUNE 23, 2023

According to the MIT Technology Review Insights Survey, an enterprise data strategy supports vital business objectives including expanding sales, improving operational efficiency, and reducing time to market. The problem is today, just 13% of organizations excel at delivering on their data strategy.

Data Strategy 116

Data Strategy Strategy Visualization Consulting 116

CIO Business Intelligence

FEBRUARY 15, 2024

Following are ways CIOs can help overcome disconnect in the C-suite on the evolving nature of their role in an effort to better enable support for their digital strategies. The dialogue with the board and with human resources is fruitful, and the managers are receptive, which greatly facilitates the digital strategy.”

Strategy 134

Strategy Digital Transformation Cost-Benefit Forecasting 134

CIO Business Intelligence

JULY 30, 2024

Organizations are under pressure to demonstrate commitment to an actionable sustainability strategy to meet regulatory obligations and to build positive market sentiment. We examine the opportunity to lead both risk mitigation and value creation by helping advance the enterprise sustainability strategy.

Strategy 105

Strategy Scorecard Measurement Cost-Benefit 105

CIO Business Intelligence

NOVEMBER 21, 2024

It’s very easy to get quick success with a prototype, but there is hidden cost involved in making your data AI ready, training your AI models with corporate data, tuning it post deployment, putting the controls to limit abuse, biases, and hallucinations.” The first thing that CIOs need to find is, where are the potential little wins with AI?”

Management 124

Management Interactive ROI Software 124

CIO Business Intelligence

NOVEMBER 2, 2023

Rapid advancements in artificial intelligence (AI), particularly generative AI are putting more pressure on analytics and IT leaders to get their houses in order when it comes to data strategy and data management. If you go out and ask a chief data officer, a head of IT, ‘Is your data strategy aligned?’, I need to know my forecast.

Data Strategy 137

Data Strategy Strategy Sales Data Governance 137

CIO Business Intelligence

MARCH 25, 2025

Using the companys data in LLMs, AI agents, or other generative AI models creates more risk. Build up: Databases that have grown in size, complexity, and usage build up the need to rearchitect the model and architecture to support that growth over time. Playing catch-up with AI models may not be that easy.

Risk 140

Risk Cost-Benefit Data-driven Digital Transformation 140

CIO Business Intelligence

APRIL 27, 2022

Data fabric, data cleansing and tagging, data models, containers, inference at the edge – cloud-enabled platforms are all “go-to” conversation points. This is especially true for those companies that have experienced the impact of the global pandemic, and how that stress-tested their existing business model. The Digitization Agenda.

Strategy 143

Strategy Data-driven Internet of Things Measurement 143

DataKitchen

APRIL 26, 2021

In early April 2021, DataKItchen sat down with Jonathan Hodges, VP Data Management & Analytics, at Workiva ; Chuck Smith, VP of R&D Data Strategy at GlaxoSmithKline (GSK) ; and Chris Bergh, CEO and Head Chef at DataKitchen, to find out about their enterprise DataOps transformation journey, including key successes and lessons learned.

Measurement 246

Measurement Metrics Data-driven Dashboards 246

datapine

JANUARY 24, 2021

It is not just important to gather all the existing information, but to consider the preparation of data and utilize it in the proper way, has become an indispensable value in developing a successful business strategy. For example, you need to develop a sales strategy and increase revenue. Today, big data is about business disruption.

IT 317

IT Statistics KPI Data-driven 317

O'Reilly on Data

APRIL 22, 2020

These strategies contribute to perceptions of trust. For example, payday lending businesses are no doubt compliant with the law, but many aren’t models for good corporate citizenship. These purpose-led strategies boost employee performance and retention , drive deep customer loyalty , and carve legacies. Compliance and ethics.

Cost-Benefit 327

Cost-Benefit Finance Data-driven Strategy 327

AWS Big Data

OCTOBER 21, 2024

As a producer, you can also monetize your data through the subscription model using AWS Data Exchange. Cross-sell and up-sell opportunities – AnyHealth intends to boost sales by implementing cross-selling and up-selling strategies. To achieve this, they plan to use machine learning (ML) models to extract insights from data.

Sales 116

Sales Data-driven Data Processing Key Performance Indicator 116

datapine

OCTOBER 7, 2020

What gets measured gets done.” – Peter Drucker. By setting operational performance measures, you will know what is happening at every stage of your business. Since every business is different, it is essential to establish specific metrics and KPIs to measure, follow, calculate, and evaluate. Who will measure it?

KPI 269

KPI Metrics Sales Visualization 269

BA Learnings

DECEMBER 27, 2020

Business Analysts working in startup environments or in the strategy function of businesses will often be faced with situations where they are required to define the value proposition of products or service, in collaboration with business owners. It's in the hearts and minds of the target audience.

Sales 264

Sales Measurement Strategy Modeling 264

CIO Business Intelligence

JUNE 9, 2023

Such is the case with a data management strategy. Leveraging that data, in AI models, for example, depends entirely on the accessibility, quality, granularity, and latency of your organization’s data. For example, smart hospitals employ effective data management strategies. The important point is to start and keep moving.

Strategy 116

Strategy Management Key Performance Indicator Cost-Benefit 116

CIO Business Intelligence

AUGUST 28, 2024

For example, with several dozen ERPs and general ledgers, and no enterprise-wide, standard process definitions of things as simple as cost categories, a finance system with a common information model upgrade becomes a very big effort. For the technical architecture, we use a cloud-only strategy. This is a multi-year initiative.

Strategy 121

Strategy B2B Finance Enterprise 121

AWS Big Data

OCTOBER 29, 2024

This multi-account strategy promotes a clear separation of concerns, empowering data producers and consumers to operate independently while using the centralized governance and services provided by the solution. At one point, 25% of all data assets in the CDH were duplicates, a natural consequence of these measures.

Data Lake 110

Data Lake Sales Metadata Machine Learning 110

CIO Business Intelligence

JANUARY 24, 2023

A significant number of organizations are operating in a hybrid model — and expect to continue with that hybrid environment for the foreseeable future. And we say what we’re doing, the principle it’s related to, and here’s how we measure it.” Our key focus would be scaling talent development in hybrid work model,” Mazumder adds.

Strategy 142

Strategy Consulting Technology Software 142

CIO Business Intelligence

JULY 10, 2024

So even with leveraging emerging tech, you need to think about your business model congruence.” Dovico just hit the 90-day mark in her CIO role at Beyond Bank, so she’s still in the listening phase while new a new executive team and business strategies are launched and formalized across the broader organization.

Strategy 118

Strategy Cost-Benefit Uncertainty Technology 118

CIO Business Intelligence

MARCH 6, 2024

While the product team was busy doing that, my team worked with the operations functions and our strategy team to completely reimagine our front- and back-office processes and supporting applications to enable this new cloud company. What has IT’s role been in the transformation to a SaaS model? Today, we’re a $1.6

Modeling 116

Modeling Management IT Metrics 116