O'Reilly on Data

OCTOBER 19, 2021

Since software engineers manage to build ordinary software without experiencing as much pain as their counterparts in the ML department, it begs the question: should we just start treating ML projects as software engineering projects as usual, maybe educating ML practitioners about the existing best practices? This approach is not novel.

IT 364

IT Testing Experimentation Software 364

DataKitchen

APRIL 13, 2021

Testing and Data Observability. Sandbox Creation and Management. It orchestrates complex pipelines, toolchains, and tests across teams, locations, and data centers. Apache Oozie — An open-source workflow scheduler system to manage Apache Hadoop jobs. Testing and Data Observability. Meta-Orchestration.

Testing 300

Testing Machine Learning Consulting Data Quality 300

CIO Business Intelligence

DECEMBER 17, 2024

While genAI has been a hot topic for the past couple of years, organizations have largely focused on experimentation. Increase adoption through change management. Change management creates alignment across the enterprise through implementation training and support. In 2025, thats going to change. Track ROI and performance.

Experimentation 98

Experimentation ROI Risk Data Quality 98

Rocket-Powered Data Science

FEBRUARY 15, 2023

Friction occurs when there is resistance to change or to success somewhere in the project lifecycle or management chain. encouraging and rewarding) a culture of experimentation across the organization. FUD occurs when there is too much hype and “management speak” in the discussions. Test early and often.

Strategy 290

Strategy Experimentation Uncertainty Machine Learning 290

CIO Business Intelligence

JANUARY 6, 2025

Deliver value from generative AI As organizations move from experimenting and testing generative AI use cases , theyre looking for gen AI to deliver real business value. I firmly believe continuous learning and experimentation are essential for progress. Ronda Cilsick, CIO of software company Deltek, is aiming to do just that.

IT 140

IT Cost-Benefit Measurement Experimentation 140

CIO Business Intelligence

JUNE 13, 2024

Proof that even the most rigid of organizations are willing to explore generative AI arrived this week when the US Department of the Air Force (DAF) launched an experimental initiative aimed at Guardians, Airmen, civilian employees, and contractors.

Testing 119

Testing Experimentation Data Processing Modeling 119

AWS Big Data

NOVEMBER 19, 2024

Amazon Managed Workflows for Apache Airflow (Amazon MWAA), is a managed Apache Airflow service used to extract business insights across an organization by combining, enriching, and transforming data through a series of tasks called a workflow. This approach offers greater flexibility and control over workflow management.

Metadata 106

Metadata Cost-Benefit Metrics Optimization 106

Smart Data Collective

OCTOBER 13, 2022

These patterns could then be used as the basis for additional experimentation by scientists or engineers. Generative design is a new approach to product development that uses artificial intelligence to generate and test many possible designs. Automated Testing of Features. Generative Design. Quality Assurance.

Testing 128

Testing Cost-Benefit Experimentation Optimization 128

DataKitchen

JANUARY 20, 2021

As DataOps activity takes root within an enterprise, managers face the question of whether to build centralized or decentralized DataOps capabilities. Develop/execute regression testing . Test data management and other functions provided ‘as a service’ . Agile ticketing/Kanban tools. Deploy to production.

Metrics 243

Metrics Experimentation Measurement Testing 243

CIO Business Intelligence

APRIL 2, 2024

Underpinning these initiatives is a slew of technology capabilities and strategies aimed at accelerating delivery cycles, such as establishing product management disciplines, building cloud architectures, developing devops capabilities, and fostering agile cultures. This dip delays when the business can start realizing the value delivered.

Management 140

Management Digital Transformation Testing Experimentation 140

Domino Data Lab

MAY 15, 2019

It focuses on his ML product management insights and lessons learned. If you are interested in hearing more practical insights on ML or AI product management, then consider attending Pete’s upcoming session at Rev. I was fortunate to see an early iteration of Pete Skomoroch ’s ML product management presentation in November 2018.

Machine Learning 111

Machine Learning Management Experimentation Uncertainty 111

CIO Business Intelligence

OCTOBER 24, 2024

As they look to operationalize lessons learned through experimentation, they will deliver short-term wins and successfully play the gen AI — and other emerging tech — long game,” Leaver said. The rest of their time is spent creating designs, writing tests, fixing bugs, and meeting with stakeholders. “So

ROI 127

ROI Data-driven Enterprise Experimentation 127

CIO Business Intelligence

MARCH 5, 2025

Two years of experimentation may have given rise to several valuable use cases for gen AI , but during the same period, IT leaders have also learned that the new, fast-evolving technology isnt something to jump into blindly. The next thing is to make sure they have an objective way of testing the outcome and measuring success.

Testing 99

Testing Measurement Technology Experimentation 99

CIO Business Intelligence

NOVEMBER 7, 2024

This team addresses potential risks, manages AI across the company, provides guidance, implements necessary training, and keeps abreast of emerging regulatory changes. This initiative offers a safe environment for learning and experimentation. We are also testing it with engineering. We have 25% of our employees on Liberty GPT.

Insurance 120

Insurance Experimentation Testing Technology 120

CIO Business Intelligence

JANUARY 14, 2025

In todays digital economy, business objectives like becoming a leading global wealth management firm or being a premier destination for top talent demand more than just technical excellence. Most importantly, architects make difficult problems manageable. The stakes have never been higher.

Enterprise 119

Enterprise Technology Metrics Measurement 119

CIO Business Intelligence

SEPTEMBER 23, 2024

The emergence of generative artificial intelligence (GenAI) is the latest groundbreaking development to put payers to the test when it comes to staying nimble and competitive without taking unnecessary risks. The time is now The time has come for healthcare organizations to shift from GenAI experimentation to implementation.

Management 115

Management Experimentation Data-driven Strategy 115

Domino Data Lab

MARCH 20, 2019

Models are so different from software — e.g., they require much more data during development, they involve a more experimental research process, and they behave non-deterministically — that organizations need new products and processes to enable data science teams to develop, deploy and manage them at scale. Domino 3.3

Management 97

Management Experimentation Data Science Modeling 97

Corinium

JUNE 6, 2019

Moreover, rapid and full adoption of analytics insights can hit speed bumps due to change resistance in the ways processes are managed and decisions are made. Fractal’s recommendation is to take an incremental, test and learn approach to analytics to fully demonstrate the program value before making larger capital investments.

Insurance 250

Insurance Analytics Forecasting Deep Learning 250

CIO Business Intelligence

JUNE 15, 2023

BCG asked 12,898 frontline employees, managers, and leaders in large organizations around the world how they felt about AI: 61% listed curiosity as one of their two strongest feelings, 52% listed optimism, 30% concern, and 26% confidence. This is a massive number,” Bellefonds said. “We We really have to address this upskilling issue.”

Management 116

Management Experimentation Optimization Enterprise 116

datapine

MAY 20, 2020

To ensure that your customer-facing communications and efforts are constantly improving and evolving, investing in customer relationship management (CRM) is vital. A CRM report, or CRM reporting, is the presentational aspect of customer relationship management. Try our professional dashboard software for 14 days, completely free!

Dashboards 265

Dashboards Reporting KPI Visualization 265

Domino Data Lab

JUNE 23, 2019

Pete Skomoroch presented “ Product Management for AI ” at Rev. Pete Skomoroch ’s “ Product Management for AI ”session at Rev provided a “crash course” on what product managers and leaders need to know about shipping machine learning (ML) projects and how to navigate key challenges. Session Summary. It is similar to R&D.

Management 110

Management Machine Learning Experimentation Metrics 110

CIO Business Intelligence

AUGUST 7, 2024

After being in telco and consulting for over 20 years, Lena Jenkins got the change she was looking for when she became the chief digital officer at Waste Management New Zealand, the country’s leading materials recovery, recycling, and waste management provider. So test, learn, and scale from there. But I’m not deeply technical.

Management 110

Management Experimentation Strategy Finance 110

CIO Business Intelligence

OCTOBER 15, 2024

Recommendation : Ask leaders for their understanding of key practices such as agile, DevOps, and product management, and differences in core principles, methodologies, and tools will surface. CrowdStrike recently made the news about a failed deployment impacting 8.5 CrowdStrike recently made the news about a failed deployment impacting 8.5

Enterprise 143

Enterprise Testing Business Objectives Experimentation 143

CIO Business Intelligence

APRIL 12, 2024

This anticipated move could completely transform how these companies hire new employees and how they manage and deliver the technology employees use. Right now most organizations tend to be in the experimental phases of using the technology to supplement employee tasks, but that is likely to change, and quickly, experts say.

Experimentation 143

Experimentation Reporting Testing Statistics 143

CIO Business Intelligence

AUGUST 20, 2024

High performance back then generally focused on delivery — a contrast to previous generations of IT where business and IT alignment was an issue, and teams struggled to deliver with waterfall project management practices.

IT 141

IT Digital Transformation Experimentation Risk 141

CIO Business Intelligence

FEBRUARY 9, 2024

Maintain rigorous testing standards With gen AI most likely being utilized by a large number of the workforce in your organization, it’s important to train and educate employees on the pros and cons and use your corporate use policy as a starting point. The gaslighting, experimentation, and learning along the way are all part of the process.

IT 138

IT Experimentation Risk Testing 138

datapine

JANUARY 31, 2022

Everything is being tested, and then the campaigns that succeed get more money put into them, while the others aren’t repeated. The main use of business intelligence is to help business units, managers, top executives, and other operational workers make better-informed decisions backed up with accurate data.

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

DataKitchen

OCTOBER 5, 2021

DataOps enables: Rapid experimentation and innovation for the fastest delivery of new insights to customers. The Innovation Pipeline includes analytics development, QA, deployment and the rest of the change management processes for the Value Pipeline. Create tests. What is DataOps. Low error rates. Run the factory.

Testing 152

Testing Dashboards Measurement Experimentation 152

CIO Business Intelligence

JANUARY 24, 2025

Focusing on business value before AI Mariza Fotiou, VP for digital product management at bp, emphasizes the importance of focusing on the business value that is being sought, whether AI is involved or not. And it uses AI to automate code testing and other aspects of the digital development lifecycle.

Digital Transformation 59

Digital Transformation B2B Testing Experimentation 59

CIO Business Intelligence

OCTOBER 5, 2023

Sandeep Davé knows the value of experimentation as well as anyone. As chief digital and technology officer at CBRE, Davé recognized early that the commercial real estate industry was ripe for AI and machine learning enhancements, and he and his team have tested countless use cases across the enterprise ever since.

Experimentation 130

Experimentation Strategy Machine Learning Interactive 130

CIO Business Intelligence

MAY 9, 2024

Experimentation drives momentum: How do we maximize the value of a given technology? Via experimentation. This can be as simple as a Google Sheet or sharing examples at weekly all-hands meetings Many enterprises do “blameless postmortems” to encourage experimentation without fear of making mistakes and reprisal.

Enterprise 122

Enterprise Experimentation Sales Manufacturing 122

CIO Business Intelligence

NOVEMBER 4, 2022

The company’s multicloud infrastructure has since expanded to include Microsoft Azure for business applications and Google Cloud Platform to provide its scientists with a greater array of options for experimentation. For McCowan, the key is to give scientists any and all tools that allow them to explore their hypotheses and test theories.

Data Lake 124

Data Lake IT Experimentation Data-driven 124

The Unofficial Google Data Science Blog

JANUARY 16, 2018

We present data from Google Cloud Platform (GCP) as an example of how we use A/B testing when users are connected. Experimentation on networks A/B testing is a standard method of measuring the effect of changes by randomizing samples into different treatment groups. This simulation is based on the actual user network of GCP.

Testing 59

Testing Experimentation Measurement Modeling 59

CIO Business Intelligence

SEPTEMBER 12, 2024

A product manager is under immense pressure to deliver complex customer insights that could pivot the company’s product strategy. His manager praises his efficiency and the depth and breadth of insights he produces. Review and integrate successful experimental AI projects into the company’s main operational framework.

Experimentation 111

Experimentation Risk Cost-Benefit Strategy 111

Occam's Razor

FEBRUARY 26, 2008

" Our Senior Management won't let us do that." " Or " I proposed testing / surveys / competitive intelligence / Analysts but I was shot down." " Or sometimes " My manager simply does not get it / Analytics / Web / Me / Anything." Here is what you do: Embarrass your management!

Management 68

Management Experimentation Testing Metrics 68

CIO Business Intelligence

MARCH 12, 2024

Early use cases include code generation and documentation, test case generation and test automation, as well as code optimization and refactoring, among others. Gen AI is also reducing the time needed to complete testing, via automation, Ramakrishnan says.

Software 131

Software Experimentation Testing Cost-Benefit 131

CIO Business Intelligence

OCTOBER 17, 2024

The CIO dilemma: Fostering innovation while preventing digital addiction CIOs face a complex dilemma in managing their organization’s technology environment. On one hand, they must foster an environment encouraging innovation, allowing for experimentation, evaluation, and learning with new technologies. Assume unknown unknowns.

Risk 108

Risk Experimentation Testing Strategy 108