O'Reilly on Data

MARCH 25, 2025

In this article, were going to share an emerging SDLC for LLM applications that can help you escape POC Purgatory. ML apps needed to be developed through cycles of experimentation (as were no longer able to reason about how theyll behave based on software specs).

Testing 168

Testing Data-driven Software Measurement 168

O'Reilly on Data

OCTOBER 19, 2021

In this article, we want to dig deeper into the fundamentals of machine learning as an engineering discipline and outline answers to key questions: Why does ML need special treatment in the first place? Besides infrastructure, effective A/B testing requires a control plane, a modern experimentation platform, such as StatSig.

IT 364

IT Testing Experimentation Software 364

TDAN

AUGUST 18, 2020

Modern business is all about data, and when it comes to increasing your advantage over competitors, there is nothing like experimentation. Experiments in data science are the future of big data. Innovations can now win the future. Already, data scientists are making big leaps forward.

Experimentation 59

Experimentation Data Science Big Data Internet of Things 59

CIO Business Intelligence

MARCH 4, 2025

This article goes behind the scenes on whats fueling Blocks investment in developer experience, key initiatives including the role of an engineering intelligence platform , and how the company measures and drives success. Rather, Coburns team optimizes for fast experimentation and a metrics-driven approach.

Experimentation 69

Experimentation Metrics Data-driven Measurement 69

O'Reilly on Data

OCTOBER 13, 2020

Our previous articles in this series introduce our own take on AI product management , discuss the skills that AI product managers need , and detail how to bring an AI product to market. The field of AI product management continues to gain momentum.

Management 308

Management Machine Learning Metrics Modeling 308

datapine

MAY 20, 2020

Finally, we will show you a real-life example so you can get a visual overview and a clearer picture of the points discussed in this article. When we say “optimal design,” we don’t mean cramming piles of information into one space or being overly experimental with colors. Let’s begin. What Is A CRM Dashboard?

Dashboards 265

Dashboards Reporting KPI Visualization 265

O'Reilly on Data

MARCH 19, 2020

The chatbot was one of the first applications of AI in experimental and production usage. 1] This article is based on non-personally-identifiable information about the top search terms and most-used topics on O’Reilly online learning. For example, the chatbots topic continues to decline, first by 17% in 2018 and by 34% in 2019.

Deep Learning 356

Deep Learning Machine Learning Data-driven Modeling 356

datapine

FEBRUARY 4, 2020

Below, in the article, we’ve gathered some of the marketing reports templates that can easily be used to perfect the efficiency of generating data and reduce the time needed to create it. As a Forbes article states , “there’s no such thing as ‘set it and forget it’ [in digital marketing]”. Use professional software.

Reporting 280

Reporting Marketing Advertising Metrics 280

Rocket-Powered Data Science

JULY 6, 2021

1) Automated Narrative Text Generation tools became incredibly good in 2020, being able to create scary good “deep fake” articles. MLOps takes the modeling, algorithms, and data wrangling out of the experimental “one off” phase and moves the best models into deployment and sustained operational phase.

Machine Learning 279

Machine Learning Data-driven Deep Learning IoT 279

Smart Data Collective

DECEMBER 24, 2020

Machine learning is being used to write articles in the mainstream news media. The acquired logic of artificial intelligence is sufficient to produce an article on some sports news, but the results are extremely unoriginal. This makes it entirely unsuitable for relatively simplistic articles. Conclusion.

Machine Learning 121

Machine Learning Experimentation Software Reporting 121

O'Reilly on Data

SEPTEMBER 11, 2018

Principles for ethical data handling (and human experimentation in general) always stress "informed consent"; Nissenbaum’s discussion about context suggests that informed consent is less about usage than about data flow. These aren’t problems to be solved in a short article. What might that responsibility mean? How does data flow?

Advertising 241

Advertising Insurance Experimentation Strategy 241

Dataiku

DECEMBER 21, 2023

An article from The Economist titled, “Generative AI Will Go Mainstream in 2024” postulates that 2024 will be the year enterprise adoption of the technology will truly take off. As we step into 2024, the AI landscape is poised for an unprecedented wave of power and transformation.

Experimentation 83

Experimentation Enterprise Technology IT 83

The Unofficial Google Data Science Blog

JULY 22, 2020

Instead, we focus on the case where an experimenter has decided to run a full traffic ramp-up experiment and wants to use the data from all of the epochs in the analysis. Companies like Google [2], Amazon [3], and Microsoft [4] have all published scholarly articles on this topic.

Experimentation 96

Experimentation Statistics Testing Knowledge Discovery 96

CIO Business Intelligence

APRIL 25, 2024

Fits and starts As most CIOs have experienced, embracing emerging technologies comes with its share of experimentation and setbacks. CIOs in every vertical can take a tip or two from the lessons LinkedIn learned along the way. The same technique is also used for calling non-LinkedIn APIs like Bing search and news.”

IT 139

IT Cost-Benefit Experimentation Metrics 139

Occam's Razor

AUGUST 22, 2011

" + Strategic Analysis Articles. Tactical Analysis Articles. Blogging Experience Articles. + Book Articles. Misc Articles. In each section the listing is from the latest article to the earliest. " Strategic Analysis Articles. Tactical Analysis Articles. Blogging Experience Articles.

KPI 125

KPI Metrics Measurement ROI 125

CIO Business Intelligence

OCTOBER 15, 2024

But DevOps struck me as too dev-centric at the time, and my first articles questioned who owned DevOps and how DevOps was a major shift in practices. One example is how DevOps teams use feature flags, which can drive agile experimentation by enabling product managers to test features and user experience variants.

Enterprise 143

Enterprise Testing Business Objectives Experimentation 143

CIO Business Intelligence

MARCH 7, 2023

I’ll be covering more examples of force multipliers in upcoming articles, and here are three to start that should apply to most CIOs and their IT organizations. So what should CIOs look to do today to drive digital transformation, identify force multipliers, and define initiatives that enable smarter, safer, and faster business outcomes?

Digital Transformation 145

Digital Transformation Data Governance Experimentation Machine Learning 145

The Data Visualisation Catalogue

DECEMBER 13, 2021

Read more here in this Stephen Few article. Journal of Experimental Psychology: Applied, 4 (2), 119–138. Make sure to start the value axis at 0, as truncation can exaggerate the differences between bars. Avoid drawing the bars too narrow, as this focuses attention on the negative space more rather than on the bars.

Visualization 121

Visualization Experimentation Publishing Interactive 121

CIO Business Intelligence

JULY 24, 2024

In this article, we’ll dive into each phase, offering actionable strategies to help you master the art of adaptive technology portfolio management. Key strategies for exploration: Experimentation: Conduct small-scale experiments. Take a scientific approach with explicit hypotheses and rigorous analysis to validate potential solutions.

Technology 98

Technology Experimentation Cost-Benefit Digital Transformation 98

Smart Data Collective

OCTOBER 13, 2022

This article explores the possibilities and limits of AI in research and development. These patterns could then be used as the basis for additional experimentation by scientists or engineers. AI helps companies find ways to improve their product development processes. Use of AI in Research. Generative Design.

Testing 128

Testing Cost-Benefit Experimentation Optimization 128

Rocket-Powered Data Science

JULY 7, 2019

Computer Vision: Data Mining: Data Science: Application of scientific method to discovery from data (including Statistics, Machine Learning, data visualization, exploratory data analysis, experimentation, and more). This includes the specific criteria the program uses to arrive at a decision.

Internet of Things 157

Internet of Things Machine Learning Manufacturing IoT 157

CIO Business Intelligence

OCTOBER 26, 2022

Speaking at industry events, connecting with colleagues, and writing articles and white papers are just a few of the ways CIOs can build their brand. They need to become more creative in their delegation of responsibilities so that more time can be devoted to pushing experimentation,” Mains advises.

IT 141

IT Consulting Experimentation Business Objectives 141

Dataiku

FEBRUARY 17, 2022

In this article, we continue our exploration of how expert Dataiku users and administrators can lift Dataiku created APIs into a data mesh, seeking to expose data and inference engines created during the experimental phase as a tissue of governed microservices. A Single Project to a Tissue of Services.

Experimentation 59

Experimentation Enterprise 59

Data Science and Beyond

DECEMBER 23, 2018

The book focuses on randomised controlled trials and well-defined interventions as the basis of causal inference from both experimental and observational data. Hence, the book is full of practical examples. A call for less casual causal inferences.

Deep Learning 103

Deep Learning Experimentation Data Science Data-driven 103

Smart Data Collective

JULY 9, 2023

This article is going to provide some great insights on developing strategies for unlocking additional value from an online business, which can do a lot to boost revenue and catapult the enterprise to new heights. Experimentation is the key to finding the highest-yielding version of your website elements.

Optimization 97

Optimization Data Analytics Analytics Data-driven 97

O'Reilly on Data

JULY 25, 2023

This article summarizes what I learned from that experience. The inspiration (and title) for it comes from Mike Loukides’ Radar article on Real World Programming with ChatGPT , which shares a similar spirit of digging into the potential and limits of AI tools for more realistic end-to-end programming tasks.

Consulting 246

Consulting Interactive Software Metadata 246

CIO Business Intelligence

JUNE 11, 2024

A 1958 Harvard Business Review article coined the term information technology, focusing their definition on rapidly processing large amounts of information, using statistical and mathematical methods in decision-making, and simulating higher order thinking through applications.

IT 136

IT Digital Transformation Broadcasting Business Objectives 136

CIO Business Intelligence

DECEMBER 19, 2023

In researching this article, I found gaps where CIOs promised capabilities to stakeholders, but implementations and business impacts have lagged expectations. If CIOs don’t improve conversions from pilot to production, they may find their investors losing patience in the process and culture of experimentation.

Digital Transformation 143

Digital Transformation Unstructured Data Machine Learning Risk Management 143

Domino Data Lab

APRIL 7, 2019

If you are in research, excellent libraries like Allen NLP and NLP Architect are designed to make experimentation easier, although at the expense of feature completeness, speed and robustness. This article is intended to be a useful cheat sheet for narrowing down your choice. We assume that you need to build production-grade software.

Deep Learning 110

Deep Learning Machine Learning Experimentation Modeling 110

CIO Business Intelligence

SEPTEMBER 12, 2024

I read an article once titled, “AI Won’t Replace Humans – But Humans with AI Will Replace Humans without AI.” A culture of experimentation, learning from failures, and ample resources is essential along with a culture that fosters the space and ability to fail fast, learn, and move on.”

Management 115

Management IT Experimentation Technology 115

Occam's Razor

SEPTEMBER 19, 2011

Bonus: Here's one of my favorite articles… all the way from 2007 but chock full of pithy valuable lessons for all of us regardless of our field: 41 Timeless Ways to Screw Up Direct Marketing. Having read this post what might be the biggest downside to experimentation? What do you find exciting?

Measurement 120

Measurement Advertising Testing Marketing 120

Domino Data Lab

JUNE 23, 2019

Skomoroch proposes that managing ML projects are challenging for organizations because shipping ML projects requires an experimental culture that fundamentally changes how many companies approach building and shipping software. That’s a good article by Steven Levy about this. Yet, this challenge is not insurmountable.

Management 110

Management Machine Learning Experimentation Metrics 110

CIO Business Intelligence

DECEMBER 10, 2024

For example, our employees can use this platform to: Chat with AI models Generate texts Create images Train their own AI agents with specific skills To fully exploit the potential of AI, InnoGames also relies on an open and experimental approach.

Data-driven 98

Data-driven Metadata Interactive KPI 98

FineReport

DECEMBER 11, 2019

The article is interspersed with rich columns and pictures, introduces the basic business principles in a simple way with real cases from many companies and entrepreneurs around the world. – Head First Data Analysis: A learner’s guide to big numbers, statistics, and good decisions. By Michael Milton.

Big Data 98

Big Data Statistics Experimentation Data Strategy 98

Data Science and Beyond

JULY 22, 2018

This article is a short summary of my understanding of the definition of data science in 2018. Numerous articles have been published on the meaning of data science in the past six years. In a recent article , Hernán et al. However, I still call myself a data scientist. But what does it mean? What do I actually do here?

Data Science 79

Data Science Machine Learning Statistics Predictive Modeling 79

Smart Data Collective

JUNE 21, 2023

Last summer, we wrote an article about the ways that artificial intelligence is changing video editing software. This frees up time for experimentation and achieving superior results. The market for AI software is booming. Precedence Research States that the market was worth $138 billion last year and it is growing exponentially.

Software 104

Software Technology Experimentation Data-driven 104

Sisense

MARCH 26, 2021

To achieve this, he says, companies should find ways to lower the cost of experimentation, decrease the time to value, and scale successful experimentation into products quickly. Charles articulated this in a 2019 article in which he considered invisible analytics and embedded insights to be the future of business intelligence.

Analytics 98

Analytics Data-driven Dashboards Experimentation 98