O'Reilly on Data

DECEMBER 10, 2024

What about Fermats Little Theorem ? There are more than a few math textbooks online, and its fair to assume that all of them are in the training data. Let me think about this. Think about the size of the models: OpenAI has said nothing about the size of GPT-4 o1, but it is rumored to have over a trillion parameters.

Testing 261

Testing Modeling Software IT 261

Analytics Vidhya

NOVEMBER 18, 2024

Have you ever been curious about what powers some of the best Search Applications such as Elasticsearch and Solr across use cases such e-commerce and several other document retrieval systems that are highly performant? Apache Lucene is a powerful search library in Java and performs super-fast searches on large volumes of data.

Analytics 223

Analytics Data mining 223

CIO Business Intelligence

DECEMBER 12, 2024

Business leaders may be confident that their organizations data is ready for AI, but IT workers tell a much different story, with most spending hours each day massaging the data into shape. Theres a perspective that well just throw a bunch of data at the AI, and itll solve all of our problems, he says.

IT 134

IT Data Quality Experimentation Machine Learning 134

DataKitchen

FEBRUARY 20, 2025

Announcing DataOps Data Quality TestGen 3.0: Open-Source, Generative Data Quality Software. It assesses your data, deploys production testing, monitors progress, and helps you build a constituency within your company for lasting change. Imagine an open-source tool thats free to download but requires minimal time and effort.

Data Quality 183

Data Quality Scorecard Testing Dashboards 183

CIO Business Intelligence

NOVEMBER 27, 2024

Once the province of the data warehouse team, data management has increasingly become a C-suite priority, with data quality seen as key for both customer experience and business performance. But along with siloed data and compliance concerns , poor data quality is holding back enterprise AI projects.

Enterprise 141

Enterprise Data Quality Structured Data Modeling 141

CIO Business Intelligence

OCTOBER 30, 2024

In a recent interview, Bhimani talked about the importance of thinking about ethical uses of AI and how it can benefit both humanity and individual organizations. Now, we have to think about innovation as a way of really reshaping the world so that it works for everybody. What’s the benefit to them and to their organizations?

Technology 131

Technology Strategy Risk Consulting 131

CIO Business Intelligence

DECEMBER 20, 2024

With the core architectural backbone of the airlines gen AI roadmap in place, including United Data Hub and an AI and ML platform dubbed Mars, Birnbaum has released a handful of models into production use for employees and customers alike. As opposed to a canned message, we try to write a specific story about whats going on with your flight.

IT 131

IT Unstructured Data Experimentation Data Lake 131

CIO Business Intelligence

JANUARY 14, 2025

As part of that, theyre asking tough questions about their plans. Here are 10 questions CIOs, researchers, and advisers say are worth asking and answering about your organizations AI strategies. Do we have the data, talent, and governance in place to succeed beyond the sandbox? How confident are we in our data?

Strategy 141

Strategy ROI Experimentation Consulting 141

CIO Business Intelligence

NOVEMBER 26, 2024

Data is the lifeblood of the modern insurance business. Yet, despite the huge role it plays and the massive amount of data that is collected each day, most insurers struggle when it comes to accessing, analyzing, and driving business decisions from that data. There are lots of reasons for this.

Insurance 131

Insurance Data-driven Data Architecture Technology 131

CIO Business Intelligence

FEBRUARY 4, 2025

Consider the following business solutions in their early forms: Workday for HR Salesforce for sales Adobe or Hubspot for marketing SAP for ERP These solutions reformed the way we thought about HR, supply chain, or CRM, but they did not transform the work itself. Data and workflows lived, and still live, disparately within each domain.

Digital Transformation 144

Digital Transformation Sales Optimization Enterprise 144

Analytics Vidhya

JULY 18, 2024

Hackathons are now the new way for companies to find the best data professionals. But it’s not just about bragging rights. […] The post Top 18 Companies Hiring Data Professionals through Hackathons appeared first on Analytics Vidhya.

Analytics 364

Analytics IT Data Science 364

David Menninger's Analyst Perspectives

JANUARY 15, 2025

One of the points that I look at is whether and to what extent the software provider offers out-of-the-box external data useful for forecasting, planning, analysis and evaluation. Until recently, it was adequate for organizations to regard external data as a nice to have item, but that is no longer the case.

Predictive Modeling 130

Predictive Modeling Forecasting Predictive Analytics Statistics 130

O'Reilly on Data

MARCH 25, 2025

We can answer any question about our docs! Two big things: They bring the messiness of the real world into your system through unstructured data. When your system is both ingesting messy real-world data AND producing nondeterministic outputs, you need a different approach. Leadership gets excited. But then reality hits.

Testing 184

Testing Data-driven Software Measurement 184

CIO Business Intelligence

JANUARY 6, 2025

So, in keeping with the New Years spirit, we asked multiple CIOs about their professional resolutions for 2025. Innovate Shane McDaniel, CIO for the City of Seguin, Texas, says his city has grown by about 35% since the 2020 census. One of them is Katherine Wetmur, CIO for cyber, data, risk, and resilience at Morgan Stanley.

IT 140

IT Cost-Benefit Measurement Experimentation 140

AWS Big Data

OCTOBER 17, 2024

Amazon Kinesis Data Analytics for SQL is a data stream processing engine that helps you run your own SQL code against streaming sources to perform time series analytics, feed real-time dashboards, and create real-time metrics. AWS has made the decision to discontinue Kinesis Data Analytics for SQL, effective January 27, 2026.

Data Analytics 137

Data Analytics Management Analytics Recreation/Entertainment 137

O'Reilly on Data

JUNE 11, 2024

At O’Reilly, we’re not just building training materials about AI. You won’t know how people will use your application until you build it and deploy it; there are many questions about Answers for which we are still awaiting answers. Think about how the answers to those questions affect your business model.

Modeling 343

Modeling Experimentation Interactive Data-driven 343

CIO Business Intelligence

MARCH 25, 2025

These areas are considerable issues, but what about data, security, culture, and addressing areas where past shortcuts are fast becoming todays liabilities? Types of data debt include dark data, duplicate records, and data that hasnt been integrated with master data sources.

Risk 140

Risk Cost-Benefit Data-driven Digital Transformation 140

DataKitchen

MARCH 20, 2025

Unlocking Data Team Success: Are You Process-Centric or Data-Centric? Over the years of working with data analytics teams in large and small companies, we have been fortunate enough to observe hundreds of companies. We want to share our observations about data teams, how they work and think, and their challenges.

Data Quality 161

Data Quality Testing Metrics Management 161

Analytics Vidhya

OCTOBER 28, 2023

Introduction The world of data science has numerous candidates with technical expertise, but only a few excel at problem-solving. When it is about communicating and expressing these skills effectively, some people are great at it naturally, while others develop this ability over time.

Data Science 357

Data Science Analytics IT Dashboards 357

Analytics Vidhya

AUGUST 5, 2024

Introduction Think about a situation where you are drawing a plan of a new structure. While people think about an efficient and robust building’s design when they hear an architect’s plan, a schema in SQL is a blueprint into how data in a database will be arranged. appeared first on Analytics Vidhya.

Analytics 288

Analytics IT 288

Analytics Vidhya

JUNE 11, 2024

Introduction Exploratory Data Analysis (EDA) is a process of describing the data by means of statistical and visualization techniques in order to bring important aspects of that data into focus for further analysis. Exploratory Data Analysis […] The post What is Exploratory Data Analysis (EDA) and How Does it Work?

IT 306

IT Statistics Visualization Analytics 306

Analytics Vidhya

APRIL 18, 2024

Do you want to learn Python for data science or tech, but worried about expensive courses? This article is all about a free Python course that’s perfect for you, no matter your experience level. Great news! Even if you are a beginner, this course will help you with foundation building.

Data Science 316

Data Science Analytics 316

CIO Business Intelligence

JANUARY 2, 2025

Nearly nine out of 10 senior decision-makers said they have gen AI pilot fatigue and are shifting their investments to projects that will improve business performance, according to a recent survey from NTT DATA. In other cases, the pilot wasnt commercially viable, he says.

Experimentation 144

Experimentation Digital Transformation Technology Finance 144

CIO Business Intelligence

NOVEMBER 27, 2024

From customer service chatbots to marketing teams analyzing call center data, the majority of enterprises—about 90% according to recent data —have begun exploring AI. For companies investing in data science, realizing the return on these investments requires embedding AI deeply into business processes.

Data Architecture 128

Data Architecture Cost-Benefit Machine Learning Experimentation 128

CIO Business Intelligence

NOVEMBER 1, 2024

Until recently, discussion of this technology was prospective; experts merely developed theories about what AI might be able to do in the future. Developing AI When most people think about artificial intelligence, they likely imagine a coder hunched over their workstation developing AI models.

Recreation/Entertainment 119

Recreation/Entertainment Machine Learning Modeling Data Science 119

O'Reilly on Data

MARCH 26, 2024

TL;DR LLMs and other GenAI models can reproduce significant chunks of training data. Specific prompts seem to “unlock” training data. Generative AI Has a Plagiarism Problem ChatGPT, for example, doesn’t memorize its training data, per se. This is the basis of The New York Times lawsuit against OpenAI. Let me explain.

Modeling 329

Modeling Machine Learning Risk Advertising 329

Analytics Vidhya

JULY 31, 2024

Introduction If you are in your final year of engineering or have completed your data science course, your eagerness to join MNCs is understandable. You’ve probably binged on countless YouTube videos about the best-paying data science companies but still haven’t found the right fit.

Data Science 305

Data Science Analytics 305

CIO Business Intelligence

FEBRUARY 26, 2025

We actually started our AI journey using agents almost right out of the gate, says Gary Kotovets, chief data and analytics officer at Dun & Bradstreet. In addition, because they require access to multiple data sources, there are data integration hurdles and added complexities of ensuring security and compliance.

IT 141

IT Enterprise Interactive Data Quality 141

CIO Business Intelligence

MAY 20, 2025

Here, IT leaders and advisors weigh in on what CIOs need to ask and answer about their IT strategies and execution involving todays most critical IT matters. The AI tools can complete in about 10 minutes the work that typically took staffers a few hours to tackle a significant productivity gain.

Strategy 120

Strategy Risk Experimentation Measurement 120

DataKitchen

DECEMBER 9, 2024

A Drug Launch Case Study in the Amazing Efficiency of a Data Team Using DataOps How a Small Team Powered the Multi-Billion Dollar Acquisition of a Pharma Startup When launching a groundbreaking pharmaceutical product, the stakes and the rewards couldnt be higher. data engineers delivered over 100 lines of code and 1.5

Data Quality 161

Data Quality Data Lake Testing Statistics 161