O'Reilly on Data

APRIL 25, 2023

Although I, along with many others, have gotten ChatGPT to write small programs, sometimes correctly, sometimes not, until now I haven’t seen anyone demonstrate what it takes to do professional development with ChatGPT. At a glance, it’s clear that the prompts Xu Hao uses to generate working code are very long and complex.

Testing 369

Testing Software Strategy Enterprise 369

CIO Business Intelligence

NOVEMBER 19, 2024

These correlation IDs can be kept in a text file that the system will read and assign along with the created output. Instead of directly having the LLM output test records, we would have the LMM output Python code. That Python code could be run separately from the agentic AI system that is creating it.

Testing 135

Testing Cost-Benefit Interactive ROI 135

O'Reilly on Data

JANUARY 21, 2025

But look closely and chaos emerges: a false paradise all along. Todays LLMs are very capable of generating the code for a structured workflow given examples of successful conversations. At first glance, its mesmerizinga paradise of potential. AI systems promise seamless conversations, intelligent agents, and effortless integration.

Cost-Benefit 299

Cost-Benefit Testing Interactive Software 299

CIO Business Intelligence

MARCH 19, 2025

At the time, the best AIs couldnt pass the 5% mark on the SWE-bench, a challenging benchmark designed to see how well AI can solve real-world coding problems. According to a Capgemini survey released in mid 2024, 60% of executives at large companies say that AI agents will handle most of the coding in enterprises within three to five years.

Software 143

Software Risk Enterprise Cost-Benefit 143

CIO Business Intelligence

NOVEMBER 27, 2024

But along with siloed data and compliance concerns , poor data quality is holding back enterprise AI projects. For many organizations, preparing their data for AI is the first time they’ve looked at data in a cross-cutting way that shows the discrepancies between systems, says Eren Yahav, co-founder and CTO of AI coding assistant Tabnine.

Enterprise 141

Enterprise Data Quality Structured Data Modeling 141

O'Reilly on Data

DECEMBER 19, 2018

Humans no longer implement code that solves business problems; instead, they define desired behaviors and train algorithms to solve their problems. As he writes, “a neural network is a better piece of code than anything you or I can come up with in a large fraction of valuable verticals.”

Machine Learning 279

Machine Learning Software Metadata Testing 279

AWS Big Data

DECEMBER 4, 2024

Collaborate and build faster using familiar AWS tools for model development, generative AI, data processing, and SQL analytics with Amazon Q Developer , the most capable generative AI assistant for software development, helping you along the way.

Data Analytics 105

Data Analytics Analytics Data Lake Data Quality 105

O'Reilly on Data

JANUARY 17, 2023

Figuring out what kinds of problems are amenable to automation through code. So it behooves a software developer to spot what portions of human activity can be properly automated away through code, and then build that. Because if companies use code to automate business rules, they use ML/AI to automate decisions.

Machine Learning 363

Machine Learning Predictive Modeling Software Modeling 363

Analytics Vidhya

SEPTEMBER 25, 2023

It extracts the entire HTML code along with data stored in the database. Introduction Web scraping is the process of generating content and information from a website with the help of bots. Web scraping has various uses for large business organizations.

Marketing 190

Marketing Analytics IT Data mining 190

O'Reilly on Data

DECEMBER 10, 2019

AutoML Vision allows you to build models without having to code; we’re also seeing code-free model building from startups like MLJAR and Lobe , and tools focused on computer vision, such as Platform.ai Those tools are starting to appear, particularly for building deep learning models. and Matroid.

Software 339

Software Machine Learning Risk Data-driven 339

O'Reilly on Data

OCTOBER 19, 2021

If you peek under the hood of an ML-powered application, these days you will often find a repository of Python code. Let’s start by considering the job of a non-ML software engineer: writing traditional software deals with well-defined, narrowly-scoped inputs, which the engineer can exhaustively and cleanly model in the code.

IT 364

IT Testing Experimentation Software 364

CIO Business Intelligence

DECEMBER 2, 2024

Speak the board’s language Instead of opening the conversation about “code quality,” start talking about business outcomes. Our research shows 52% of organizations are increasing AI investments through 2025 even though, along with enterprise applications, AI is the primary contributor to tech debt.

ROI 136

ROI Cost-Benefit Metrics Strategy 136

O'Reilly on Data

MARCH 31, 2020

A PM for AI needs to do everything a traditional PM does, but they also need an operational understanding of machine learning software development along with a realistic view of its capabilities and limitations. The same neural network code trained with seemingly similar datasets of input and output pairs can give entirely different results.

Management 363

Management Machine Learning Experimentation Metrics 363

O'Reilly on Data

MARCH 23, 2023

It can explain code that you don’t understand, including code that has been intentionally obfuscated. Sydney The internal code name of the chatbot behind Microsoft’s improved search engine, Bing. Bard Google’s code name for its chat-oriented search engine, based on their LaMDA model, and only demoed once in public.

IT 348

IT Modeling Testing Risk 348

AWS Big Data

OCTOBER 14, 2024

The two Jupyter Notebooks ( 0_create_tables_with_metadata.ipynb and 1_text-to-sql-for-athena.ipynb ) provide working code snippets to create the necessary tables and generate the SQL using the Claude AI model on Amazon Bedrock. This function hard codes the model’s parameters and model ID for demonstrating the basic functionality.

Metadata 105

Metadata Data Lake Modeling Data Warehouse 105

O'Reilly on Data

SEPTEMBER 11, 2018

Even worse, none of the major cloud services will give you the same sort of storage, so your code isn’t portable any more. Thus, if you add a node with storage resources, the low-level device interface code will run and will handle talking to the disks. Sidecar containers are ideal for this along with the Flexvolume plugin.

Big Data 234

Big Data Data Processing Statistics Management 234

CIO Business Intelligence

MARCH 4, 2025

The wide range of AI agents from copilots to coding tools to autonomous assistants compounds how enterprise CIOs will ensure agentic AI workflows are monitored and managed properly, he says. IT employees? Not so much.

Management 119

Management IT Cost-Benefit Enterprise 119

AWS Big Data

NOVEMBER 26, 2024

Solution overview We implement the solution with the AWS Cloud Development Kit (AWS CDK), an open source software development framework for defining cloud infrastructure in code, and provide it on GitHub. In our Python code, the XTtable call is as follows: # call java class with configuration files run_sync = jpype.JPackage("org").apache.xtable.utilities.RunSync.main

Metadata 105

Metadata Data Lake Snapshot Data Warehouse 105

O'Reilly on Data

NOVEMBER 28, 2023

The higher percentage of users that are experimenting may reflect OpenAI’s addition of Advanced Data Analysis (formerly Code Interpreter) to ChatGPT’s repertoire of beta features. From a programmer’s perspective, code generation is just another labor-saving tool that keeps them productive in a job that is constantly becoming more complex.

Enterprise 342

Enterprise Testing Modeling Reporting 342

O'Reilly on Data

JULY 18, 2023

We wanted to know: How are computing instructors planning to adapt their courses as more and more students start using AI coding assistance tools such as ChatGPT and GitHub Copilot? For example, one instructor was worried about recent lawsuits around Copilot’s use of open-source code as training data without attribution.

Snapshot 189

Snapshot Strategy Modeling IT 189

O'Reilly on Data

MARCH 24, 2020

era, a new paradigm for software where machine learning and AI require less focus on writing code and more on configuring, selecting inputs, and iterating through data to create higher level models that learn from the data we give them. The model and the data specification become more important than the code.

Machine Learning 364

Machine Learning Statistics Data Quality Data Collection 364

O'Reilly on Data

MARCH 7, 2019

The goal of this article is to share key lessons I learned along the way to help you build similar systems faster and better. What’s the right E/M billing code for this visit? These systems are harder to build than some of the first computer vision deep learning applications (i.e., Meet the language of emergency room triage notes.

Deep Learning 279

Deep Learning Testing Machine Learning Modeling 279

CIO Business Intelligence

SEPTEMBER 12, 2024

Despite mixed early returns , the outcome appears evident: Generative AI coding assistants will remake how software development teams are assembled, with QA and junior developer jobs at risk. Software architects will do less coding and more high-level system design along with keeping an eye on the solution generated by the AI.”

Software 143

Software Cost-Benefit Testing Consulting 143

O'Reilly on Data

JUNE 13, 2023

After fixing some obvious errors, I ran the program–and while it told me (correctly) that my number was non-prime, when compared to a known good implementation of Miller-Rabin, ChatGPT’s code made many mistakes. It didn’t generate any code, but provided a link to the Wolfram Alpha result page that described how to test for primality.

Testing 307

Testing Publishing IT Risk 307

O'Reilly on Data

MARCH 25, 2025

Along the way, well explore: Why defining clear user scenarios and understanding how LLM outputs will be used in the product prevents wasted effort and misalignment. Many thanks to Shreya Shankar, Bryan Bischof, Nathan Danielsen, and Ravin Kumar for their valuable and critical feedback on drafts of this essay along the way.

Testing 174

Testing Data-driven Software Measurement 174

O'Reilly on Data

JUNE 7, 2022

A foundation model like GPT-3 trained to understand and speak human language can be trained more deeply to write computer code. I can imagine “selling children” showing up in sarcastic or frustrated remarks by parents, along with texts discussing slavery. First, LeCun says that there is no such thing as “general intelligence.”

Modeling 364

Modeling Interactive Optimization Deep Learning 364

O'Reilly on Data

APRIL 2, 2019

Along the way, we described a new job role and title—machine learning engineer —focused on creating data products and making data science work in production, a role that was beginning to emerge in the San Francisco Bay Area two years ago. Quality depends not just on code, but also on data, tuning, regular updates, and retraining.

Machine Learning 271

Machine Learning Modeling Data Science Software 271

AWS Big Data

OCTOBER 11, 2024

v Troubleshooting This re:Post article addresses the majority of common errors that arise when attempting to restore a manual snapshot, along with effective solutions to resolve them. Create an IAM role and user Complete the following steps to create your IAM role and user: Create an IAM role to grant permissions to OpenSearch Service.

Snapshot 111

Snapshot Dashboards Management Testing 111

AWS Big Data

MARCH 6, 2025

Streamlit application Streamlit is a widely used open source tool that enables the creation of interactive data applications with minimal code. We use Visual Studio Code integrated development environment (IDE) for this post. A connection to IAM Identity Center with your preferred IdP and users and groups synchronized.

Visualization 104

Visualization Sales Data Warehouse Management 104

AWS Big Data

FEBRUARY 7, 2025

Prerequisites Weve created and open-sourced a GitHub repo with all the code you need to follow along with the post and deploy it for yourself. Python The code has been tested with Python version 3.13. An integrated development environment (IDE) An IDE like Visual Studio Code is helpful, although its not strictly necessary.

Data Processing 69

Data Processing Dashboards Modeling Statistics 69

O'Reilly on Data

MARCH 20, 2019

Consider a scenario where an employee, consultant, contractor, or malicious external actor has access to your model’s production code—that makes real-time predictions. Such an individual could change that code to recognize a strange, or unlikely, combination of input variable values to trigger a desired prediction outcome.

Modeling 278

Modeling Machine Learning Predictive Modeling Consulting 278

CIO Business Intelligence

OCTOBER 26, 2023

Clients are increasingly adopting our watsonx AI and data platform along with our hybrid cloud solutions to unlock productivity and operational efficiency. Based on extensive feedback and trials to date, three have risen to the top: code modernization, customer service, and digital labor.

Consulting 131

Consulting Software Enterprise Modeling 131

O'Reilly on Data

MAY 14, 2020

This role includes everything a traditional PM does, but also requires an operational understanding of machine learning software development, along with a realistic view of its capabilities and limitations. In reality, the model is often the smallest amount of code in the codebase, with the smallest human dependency.

Management 364

Management Experimentation B2B Machine Learning 364

CIO Business Intelligence

DECEMBER 18, 2024

And the ability to build agents using natural language will extend the low code suites usability to a variety of users within an enterprise, Jyoti added. The MuleSoft integration, which uses Flow, will help users to create low-code workflows that span systems, with pre-built connectors for building multi-system workflows, IDCs Jyoti said.

Enterprise 98

Enterprise IT Sales Metadata 98

AWS Big Data

FEBRUARY 21, 2025

Generative AI use cases include chatbots with Retrieval-Augmented Generation (RAG), intelligent log analysis, code generation, document summarization, and AI assistants. When youre building for generative AI, you use FMs such as large language models (LLMs), to generate text, video, audio, images, code, and more from a prompt.

Dashboards 85

Dashboards Modeling Measurement Interactive 85

CIO Business Intelligence

MARCH 4, 2025

Your CEO, not to mention the rest of the executive leadership team and other influential managers and staff, live in the Realm of Pervasive Technology by dint of routinely buying stuff on the internet and not just shopping there, but having easy access to other customers experiences with a product, along with a bunch of other useful capabilities.

Technology 86

Technology Interactive IT Management 86

DataKitchen

NOVEMBER 20, 2021

Individual nuggets of code are fungible from our perspective. In DataOps, the understanding of the word “done” includes more than just some working code. When people become concerned about defending their turf, it leads to less transparency, less reusable logic, and loss of control over source code.

Testing 246

Testing Machine Learning Data Warehouse Analytics 246