O'Reilly on Data

APRIL 25, 2023

Many of the prompts are about testing: ChatGPT is instructed to generate tests for each function that it generates. At least in theory, test driven development (TDD) is widely practiced among professional programmers. Tests tend to be very simple, and rarely get to the “hard stuff”: corner cases, error conditions, and the like.

Testing 369

Testing Software Strategy Enterprise 369

O'Reilly on Data

APRIL 9, 2024

“Hail the QA Engineer” may be clickbait, but it isn’t controversial to say that testing and debugging will rise in importance. First, one of the cornerstones of QA is testing. Generative AI can generate tests, of course—at least it can generate unit tests, which are fairly simple. Programming culture is another problem.

Testing 301

Testing Software Sales Marketing 301

O'Reilly on Data

OCTOBER 19, 2021

While there isn’t an authoritative definition for the term, it shares its ethos with its predecessor, the DevOps movement in software engineering: by adopting well-defined processes, modern tooling, and automated workflows, we can streamline the process of moving from development to robust production deployments. Why did something break?

IT 364

IT Testing Experimentation Software 364

David Menninger's Analyst Perspectives

SEPTEMBER 23, 2021

Data teams and analysts start by creating common definitions of key performance indicators, which Sisu then utilizes to automatically test thousands of hypotheses to identify differences between groups. The product features fact boards, annotations and the ability to share facts and analysis across teams.

Machine Learning 235

Machine Learning Key Performance Indicator Optimization Analytics 235

CIO Business Intelligence

DECEMBER 11, 2024

Thats a problem, since building commercial products requires a lot of testing and optimization. But overall, theres definitely a cost savings from not having to pay OpenAIs API charges. Why the open source definition matters to business Metas Llama comes up first in any conversation about open source gen AI.

Cost-Benefit 115

Cost-Benefit Modeling Marketing Sales 115

CIO Business Intelligence

JANUARY 14, 2025

By articulating fitness functions automated tests tied to specific quality attributes like reliability, security or performance teams can visualize and measure system qualities that align with business goals. But this definition misses the essence of modern enterprise architecture.

Enterprise 119

Enterprise Technology Metrics Measurement 119

David Menninger's Analyst Perspectives

MAY 14, 2025

As I recently explained, data governance catalogs also enable data stewards, data quality and data governance professionals to define and manage data usage policies, view and manage data profiles, determine and administer data quality rules and define and administer data models and master data definitions.

Data Governance 130

Data Governance Data Quality Data-driven Metadata 130

DataKitchen

NOVEMBER 20, 2021

A DataOps Engineer can make test data available on demand. We have automated testing and a system for exception reporting, where tests identify issues that need to be addressed. A previous post talked about the definition of “done.” It then autogenerates QC tests based on those rules.

Testing 246

Testing Machine Learning Data Warehouse Analytics 246

CIO Business Intelligence

APRIL 8, 2025

Fragmented systems, inconsistent definitions, legacy infrastructure and manual workarounds introduce critical risks. Fragmented systems, inconsistent definitions, outdated architecture and manual processes contribute to a silent erosion of trust in data. Inconsistent business definitions are equally problematic.

Data Quality 102

Data Quality Data-driven Key Performance Indicator Metadata 102

David Menninger's Analyst Perspectives

MAY 15, 2025

While there is no definitive date set for Q-Day, we are approaching a critical juncture where traditional cryptographic techniques may no longer suffice to protect sensitive data, digital communications and transactions. However, they do not yet exist nor could they be tested.

Enterprise 130

Enterprise Risk Measurement Risk Management 130

AWS Big Data

OCTOBER 30, 2024

Collaborating closely with our partners, we have tested and validated Amazon DataZone authentication via the Athena JDBC connection, providing an intuitive and secure connection experience for users. Using Amazon DataZone lets us avoid building and maintaining an in-house platform, allowing our developers to focus on tailored solutions.

Analytics 119

Analytics Visualization Data Governance Data-driven 119

Rocket-Powered Data Science

FEBRUARY 15, 2023

A business-disruptive ChatGPT implementation definitely fits into this category: focus first on the MVP or MLP. Keep it agile, with short design, develop, test, release, and feedback cycles: keep it lean, and build on incremental changes. Test early and often. Test and refine the chatbot. Expect continuous improvement.

Strategy 290

Strategy Experimentation Uncertainty Machine Learning 290

DataKitchen

JANUARY 25, 2022

DataOps converted these manual processes into automated orchestrations that only required human intervention when an automated alert detected that a data source missed its delivery deadline or failed to pass quality tests. It definitely means redeploying internal and outsourcing budgets to higher value-add activities.

Consulting 244

Consulting Testing Data Lake Data Quality 244

O'Reilly on Data

MARCH 7, 2019

The text has its own definition of what sentences are and what parts of speech are. If you don’t believe me, feel free to test it yourself with the six popular NLP cloud services and libraries listed below. Most likely, the first test will immediately uncover the gaps between each offering and your needs. IBM Watson NLU.

Deep Learning 279

Deep Learning Testing Machine Learning Modeling 279

O'Reilly on Data

JULY 11, 2023

Some of that time is spent in pointless meetings, but much of “the rest of the job” is understanding the user’s needs, designing, testing, debugging, reviewing code, finding out what the user really needs (that they didn’t tell you the first time), refining the design, building an effective user interface, auditing for security, and so on.

Testing 267

Testing Software Visualization Interactive 267

datapine

APRIL 15, 2020

That said, in this article, we will go through both agile analytics and BI starting from basic definitions, and continuing with methodologies, tips, and tricks to help you implement these processes and give you a clear overview of how to use them. Your Chance: Want to test an agile business intelligence solution? Finalize testing.

Business Intelligence 276

Business Intelligence Analytics Testing Dashboards 276

AWS Big Data

NOVEMBER 7, 2024

Generative SQL uses query history for better accuracy, and you can further improve accuracy through custom context, such as table descriptions, column descriptions, foreign key and primary key definitions, and sample queries. To test this, let’s ask Amazon Q to “delete data from web_sales table.”

Metadata 105

Metadata Sales Data Warehouse Optimization 105

O'Reilly on Data

JANUARY 9, 2024

We still rely on humans to test and fix the errors. How do you understand what the program is doing if it’s a different program each time you generate and test it? Automated code generation doesn’t yet have the kind of reliability we expect from traditional programming; Simon Willison calls this “ vibes-based development.”

Modeling 348

Modeling Software Testing Optimization 348

O'Reilly on Data

OCTOBER 13, 2020

In Bringing an AI Product to Market , we distinguished the debugging phase of product development from pre-deployment evaluation and testing. This distinction assumes a slightly different definition of debugging than is often used in software development. require not only disclosure, but also monitored testing.

Management 314

Management Machine Learning Metrics Modeling 314

O'Reilly on Data

NOVEMBER 28, 2023

Unexpected outcomes, security, safety, fairness and bias, and privacy are the biggest risks for which adopters are testing. AI users are definitely facing these problems: 7% report that data quality has hindered further adoption, and 4% cite the difficulty of training a model on their data. Only 4% pointed to lower head counts.

Enterprise 342

Enterprise Testing Modeling Reporting 342

Rocket-Powered Data Science

SEPTEMBER 25, 2022

All phases of the MVT process are discussed: strategy, designs, pilot, implementation, test, validation, operations, and monitoring. Beyond being a technical how-to manual (though it is definitely that), this book delivers so much more! 5) Helpful discussions of phased DT deployments, prototypes, pilots, feedback, and validation.

Diagnostic Analytics 216

Diagnostic Analytics Prescriptive Analytics Internet of Things IoT 216

DataKitchen

MAY 10, 2021

Some will argue that observability is nothing more than testing and monitoring applications using tests, metrics, logs, and other artifacts. In our definition of data observability, we put the focus on the important goal of eliminating data errors. Manual testing is performed step-by-step, by a person.

Testing 214

Testing Manufacturing Data Quality Statistics 214

CIO Business Intelligence

FEBRUARY 20, 2025

The exam tests your knowledge of definitions, history, and structure of the framework, as well as your awareness of who should be involved in Six Sigma implementation within the organization. This certification never expires and theres a free self-study guide available to prepare for the test.

Manufacturing 94

Manufacturing Testing Finance Modeling 94

DataKitchen

OCTOBER 11, 2021

Second, you must establish a definition of “done.” In DataOps, the definition of done includes more than just some working code. There are no automated tests , so errors frequently pass through the pipeline. Definition of Done. Adding Tests to Reduce Stress. Below is an example historical balance test.

Testing 152

Testing Metadata Dashboards Statistics 152

AWS Big Data

OCTOBER 30, 2024

Collaborating closely with our partners, we have tested and validated Amazon DataZone authentication via the Athena JDBC connection, providing an intuitive and secure connection experience for users. Choose Test connection. Choose Test Connection. OutputLocation : Amazon S3 path for storing query results.

Visualization 119

Visualization Data Lake Testing Data Governance 119

CIO Business Intelligence

OCTOBER 24, 2024

Over the next 10 years, Forrester believes gen AI and AI coding assistants will change the definition of software development. The rest of their time is spent creating designs, writing tests, fixing bugs, and meeting with stakeholders. Forrester’s 2024 developer survey showed that developers spend about 24% of their time coding.

ROI 127

ROI Data-driven Enterprise Experimentation 127

O'Reilly on Data

JUNE 7, 2022

It seems inappropriate to be talking about AGI when we don’t really have a good definition of “intelligence.” We have a lot of vague notions about the Turing test, but in the final analysis, Turing wasn’t offering a definition of machine intelligence; he was probing the question of what human intelligence means.

Modeling 364

Modeling Interactive Optimization Deep Learning 364

AWS Big Data

NOVEMBER 19, 2024

You can now test the newly created application by running the following command: npm run dev By default, the application is available on port 5173 on your local machine. A cell is marked as Unauthorized if the user has no permissions to access its contents, according to the cell filter definition.

Data Processing 98

Data Processing Metadata Publishing Testing 98

DataKitchen

OCTOBER 5, 2021

Many people who work with data have a narrow definition of being “done.” The narrow definition of “done” used by many data professionals is that it worked in a specific environment, without knowing or caring about the challenges of the people who have to deploy, monitor and maintain that component. Create tests. Run the factory.

Testing 152

Testing Dashboards Measurement Experimentation 152

AWS Big Data

OCTOBER 14, 2024

Prompt with no metadata For the first test, we used a basic prompt containing just the SQL generating instructions and no table metadata. Prompt definition: Human: You are an Amazon Athena query expert whose output is a valid sql query. Prompt definition: Human: You are an Amazon Athena query expert whose output is a valid sql query.

Metadata 105

Metadata Data Lake Modeling Data Warehouse 105

DataKitchen

APRIL 26, 2021

GSK had been pursuing DataOps capabilities such as automation, containerization, automated testing and monitoring, and reusability, for several years. DataOps provides the “continuous delivery equivalent for Machine Learning and enables teams to manage the complexities around continuous training, A/B testing, and deploying without downtime.

Measurement 246

Measurement Metrics Data-driven Dashboards 246

O'Reilly on Data

MARCH 24, 2020

For example, a pre-existing correlation pulled from an organization’s database should be tested in a new experiment and not assumed to imply causation [3] , instead of this commonly encountered pattern in tech: A large fraction of users that do X do Z. In particular, determining causation from correlation can be difficult.

Machine Learning 364

Machine Learning Statistics Data Quality Data Collection 364

O'Reilly on Data

JUNE 24, 2020

We don’t need definitive answers before taking steps. You get the idea; this list could easily go on, possibly including hundreds of factors influencing disease propagation, individual susceptibility, and mortality. What are the many causes that will provide a push in the right direction?

Measurement 335

Measurement Testing Interactive Modeling 335

CIO Business Intelligence

NOVEMBER 13, 2024

The information volume piece is definitely one of the areas where productivity could go down,” says Woolley. Woolley recommends that companies consolidate around the minimum number of tools they need to get things done, and have a sandbox process to test and evaluate new tools that don’t get in the way of people doing actual work.

IT 141

IT Consulting ROI Cost-Benefit 141

datapine

APRIL 13, 2021

Starting with its definition, following with the benefits of agency reports, a list of tools, and a set of agency dashboard examples. Let’s dig in with the definition of agency analytics. Your Chance: Want to test a powerful agency analytics software? Your Chance: Want to test a powerful agency analytics software?

Dashboards 256

Dashboards Reporting Analytics Cost-Benefit 256

O'Reilly on Data

MARCH 26, 2024

But perhaps it should infringe something: even when the collection of data is legal (which, statistically, it won’t entirely be for any web-scale corpus), it doesn’t mean it’s legitimate, and it definitely doesn’t mean there was informed consent. To see this, let’s consider another example, that of MegaFace. joined Flickr. joined Flickr.

Modeling 322

Modeling Machine Learning Risk Advertising 322

O'Reilly on Data

MAY 14, 2020

Lack of a specific role definition doesn’t prevent success, but it does introduce the risk that technical debt will accumulate as the business scales. a deep understanding of A/B testing , and a similarly deep knowledge of model evaluation techniques. Avinash Kaushik’s Web Analytics 2.0

Management 364

Management Experimentation B2B Machine Learning 364