article thumbnail

Beyond “Prompt and Pray”

O'Reilly on Data

Its quick to implement and demos well. Security Letting LLMs make runtime decisions about business logic creates unnecessary risk. The prompt-and-pray approach is tempting because it demos well and feels fast. Heres how it works: Low-risk or rare tasks can be handled flexibly by LLMs in the short term.

article thumbnail

Strata San Francisco, 2019: Opportunities and Risks

O'Reilly on Data

Balancing risk and reward is a necessary tension we'll need to understand as we continue our journey into the age of data. But those opportunities were balanced against risksrisks that loom large as we discover more powerful ways to apply data using machine learning and artificial intelligence. What about the risks?

Risk 206
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Escaping POC Purgatory: Evaluation-Driven Development for AI Systems

O'Reilly on Data

Someone hacks together a quick demo with ChatGPT and LlamaIndex. The system is inconsistent, slow, hallucinatingand that amazing demo starts collecting digital dust. Check out the graph belowsee how excitement for traditional software builds steadily while GenAI starts with a flashy demo and then hits a wall of challenges?

Testing 168
article thumbnail

IBM claims $3.5 billion productivity boost through AI agent use

CIO Business Intelligence

Kim Ji-kwan, executive director of client engineering, who took part in the demo, introduced Watsonx Orchestrate as a core platform for agentic AI development. In addition to data connection capabilities, the platform also includes various insights such as prompts and governance, so I believe that this can reduce risks, she said.

Finance 128
article thumbnail

Generative AI in the Real World: Chip Huyen on Finding Business Use Cases for Generative AI

O'Reilly on Data

3:02 : AI is easy to demo, but hard to productize. Consistence, risk, and compliance. Timestamps 0:00: Introductions 0:49 : O’Reilly’s Generative AI in the Enterprise survey reported that people have trouble coming up with appropriate enterprise use cases for AI. Why is it hard to come up with appropriate use cases?

article thumbnail

Building Tax Planning into Enterprise Risk Management Strategies

Jet Global

A study published in the Journal of Management Accounting Research found a clear link between board risk oversight and more effective tax-planning practices. Take Responsibility for Risk Oversight. Take Responsibility for Risk Oversight. Engage in Risk-Monitoring Activities on a Regular and Systematic Basis.

article thumbnail

5 Ways Real-Time Financial Reporting Mitigates Enterprise Risk

Jet Global

2020 brought with it a series of events that have increased volatility and risk for most businesses. Let’s look at some of the key risk categories that are often encountered by growing businesses. Credit Risk. An area of particular concern is credit risk concentration. Revenue Concentration Risk.

Risk 98