David Menninger's Analyst Perspectives

OCTOBER 31, 2024

I previously wrote about the importance of open table formats to the evolution of data lakes into data lakehouses. The concept of the data lake was initially proposed as a single environment where data could be combined from multiple sources to be stored and processed to enable analysis by multiple users for multiple purposes.

Data Lake 130

Data Lake Unstructured Data Data Warehouse Software 130

CIO Business Intelligence

MARCH 9, 2022

As a result, users can easily find what they need, and organizations avoid the operational and cost burdens of storing unneeded or duplicate data copies. Newer data lakes are highly scalable and can ingest structured and semi-structured data along with unstructured data like text, images, video, and audio.

Data Lake 119

Data Lake Unstructured Data Data Warehouse Big Data 119

CIO Business Intelligence

FEBRUARY 20, 2025

Stone called outdated apps a multi-trillion-dollar problem, even after organizations have spent the past decade focused on modernizing their infrastructure to deal with big data. This allows for the extraction and integration of data into AI models without overhauling entire platforms, Erolin says. We are in mid-transition, Stone says.

Insurance 108

Insurance Cost-Benefit Unstructured Data Data Lake 108

AWS Big Data

JULY 20, 2023

With data becoming the driving force behind many industries today, having a modern data architecture is pivotal for organizations to be successful. In this post, we describe Orca’s journey building a transactional data lake using Amazon Simple Storage Service (Amazon S3), Apache Iceberg, and AWS Analytics.

Data Lake 98

Data Lake Analytics Snapshot Data Quality 98

Smart Data Collective

OCTOBER 27, 2021

The application presents a massive volume of unstructured data through a graphical or programming interface using the analytical abilities of business intelligence technology to provide instant insight. Interactive analytics applications present vast volumes of unstructured data at scale to provide instant insights.

Interactive 130

Interactive Analytics Unstructured Data Data Warehouse 130

CIO Business Intelligence

AUGUST 18, 2022

Previously, Walgreens was attempting to perform that task with its data lake but faced two significant obstacles: cost and time. Those challenges are well-known to many organizations as they have sought to obtain analytical knowledge from their vast amounts of data. Lakehouses redeem the failures of some data lakes.

Data Lake 140

Data Lake Data Warehouse Unstructured Data Business Intelligence 140

AWS Big Data

AUGUST 3, 2023

With the rapid growth of technology, more and more data volume is coming in many different formats—structured, semi-structured, and unstructured. Data analytics on operational data at near-real time is becoming a common need. Then we can query the data with Amazon Athena visualize it in Amazon QuickSight.

Data Lake 97

Data Lake Visualization Dashboards Insurance 97

Sisense

APRIL 26, 2020

Different types of information are more suited to being stored in a structured or unstructured format. Read on to explore more about structured vs unstructured data, why the difference between structured and unstructured data matters, and how cloud data warehouses deal with them both. Unstructured data.

Unstructured Data 52

Unstructured Data Data Warehouse Structured Data Data mining 52

CIO Business Intelligence

MAY 24, 2022

The Intelligent Data Management Cloud for Financial Services, like Informatica’s other industry-focused platforms, combines vertical-based accelerators with the company’s suite of machine learning tools to help with challenges around unstructured data and quick data-based decision making. .

Finance 140

Finance Management Metadata Machine Learning 140

CIO Business Intelligence

OCTOBER 9, 2024

The data preparation process should take place alongside a long-term strategy built around GenAI use cases, such as content creation, digital assistants, and code generation. Known as data engineering, this involves setting up a data lake or lakehouse, with their data integrated with GenAI models.

Strategy 143

Strategy Modeling Management Data Lake 143

CIO Business Intelligence

NOVEMBER 25, 2022

Now Agusti, who began her Carhartt tenure as a senior programmer analyst, is charged with leading the company’s transformation into its next phase, one that is accelerating daily with the barrage of complex technologies changing the global supply chain and business practices, Agusti says.

Data Lake 128

Data Lake Data Warehouse Unstructured Data Data Architecture 128

AWS Big Data

FEBRUARY 26, 2025

Analytics remained one of the key focus areas this year, with significant updates and innovations aimed at helping businesses harness their data more efficiently and accelerate insights. This zero-ETL integration reduces the complexity and operational burden of data replication to let you focus on deriving insights from your data.

Analytics 60

Analytics Data Lake Metadata Data Warehouse 60

CIO Business Intelligence

AUGUST 9, 2024

At Atlanta’s Hartsfield-Jackson International Airport, an IT pilot has led to a wholesale data journey destined to transform operations at the world’s busiest airport, fueled by machine learning and generative AI. Data integrity presented a major challenge for the team, as there were many instances of duplicate data.

Data Transformation 126

Data Transformation Machine Learning Data Lake Dashboards 126

bridgei2i

SEPTEMBER 23, 2020

Complex business hierarchies, fast changing business scenarios and time-consuming insights require them to be agile and responsive to stay ahead in the game. Bringing in the techno-functional perspective, she handles roadmap, solutioning and delivery of AI accelerators as part of her current responsibilities.

Enterprise 97

Enterprise Unstructured Data Data Lake Digital Transformation 97

CIO Business Intelligence

JUNE 29, 2022

If you’re used to using SQL Server Analysis Services for business intelligence, Analysis Services offers that enterprise-grade analytics engine as a cloud service that you can also connect to Power BI. Azure Data Lake Analytics. The reason Azure has so many analytics services is so you can build your entire stack there.

Data Lake 116

Data Lake Analytics Data Warehouse Machine Learning 116

Sisense

MAY 28, 2019

Every decade, like clockwork, the Business Intelligence (BI) industry welcomes the next generation of BI platform providers. 2019 can best be described as an era of modern cloud data analytics. Two orthogonal approaches to data analytics have developed in this decade of BI: 1. The truth always rises to the surface.

Data Analytics 89

Data Analytics Data Lake Analytics Unstructured Data 89

CIO Business Intelligence

APRIL 25, 2024

For instance, a Data Cloud-triggered flow could update an account manager in Slack when shipments in an external data lake are marked as delayed. Sharing Customer 360 insights back without data replication. Currently, Data Cloud leverages live SQL queries to access data from external data platforms via zero copy.

Data Integration 119

Data Integration Data Lake Data Warehouse Metadata 119

CIO Business Intelligence

FEBRUARY 10, 2023

Deploying new data types for machine learning Mai-Lan Tomsen-Bukovec, vice president of foundational data services at AWS, sees the cloud giant’s enterprise customers deploying more unstructured data, as well as wider varieties of data sets, to inform the accuracy and training of ML models of late.

Unstructured Data 105

Unstructured Data Data Lake Machine Learning Enterprise 105

CIO Business Intelligence

APRIL 25, 2022

The data lakehouse is a relatively new data architecture concept, first championed by Cloudera, which offers both storage and analytics capabilities as part of the same solution, in contrast to the concepts for data lake and data warehouse which, respectively, store data in native format, and structured data, often in SQL format.

Recreation/Entertainment 119

Recreation/Entertainment Data Lake Data Warehouse Unstructured Data 119

CIO Business Intelligence

FEBRUARY 16, 2023

The Basel, Switzerland-based company, which operates in more than 100 countries, has petabytes of data, including highly structured customer data, data about treatments and lab requests, operational data, and a massive, growing volume of unstructured data, particularly imaging data.

Unstructured Data 105

Unstructured Data Data Lake Prescriptive Analytics Data Warehouse 105

CIO Business Intelligence

APRIL 24, 2024

Finally, the flow of AMA reports and activities generates a lot of data for the SAP system, and to be more effective, we’ll start managing it with data and business intelligence.” The goal is to correlate all types of data that affect assets and bring it all into the digital twin to take timely action,” says D’Accolti.

Digital Transformation 105

Digital Transformation Business Intelligence Unstructured Data Data Lake 105

CIO Business Intelligence

MAY 24, 2022

The survey found the mean number of data sources per organisation to be 400, and more than 20 percent of companies surveyed to be drawing from 1,000 or more data sources to feed business intelligence and analytics systems. Today transactional data is the largest segment, which includes streaming and data flows.

Data-driven 98

Data-driven Data Lake Data Warehouse Machine Learning 98

CIO Business Intelligence

MARCH 29, 2024

Modernizing data operations CIOs like Woodring know well that the quality of an AI model depends in large part on the quality of the data involved — and how that data is injected from databases, data warehouses, cloud data lakes, and the like into large language models.

Data Lake 134

Data Lake Machine Learning Data Warehouse Unstructured Data 134

CIO Business Intelligence

JULY 26, 2023

The only thing we have on premise, I believe, is a data server with a bunch of unstructured data on it for our legal team,” says Grady Ligon, who was named Re/Max’s first CIO in October 2022.

Data Lake 98

Data Lake Digital Transformation Machine Learning Data Architecture 98

CIO Business Intelligence

OCTOBER 2, 2024

Collect, filter, and categorize data The first is a series of processes — collecting, filtering, and categorizing data — that may take several months for KM or RAG models. Structured data is relatively easy, but the unstructured data, while much more difficult to categorize, is the most valuable.

Management 141

Management Data Governance Cost-Benefit Structured Data 141

CIO Business Intelligence

OCTOBER 13, 2023

Data architect Armando Vázquez identifies eight common types of data architects: Enterprise data architect: These data architects oversee an organization’s overall data architecture, defining data architecture strategy and designing and implementing architectures.

Data Architecture 132

Data Architecture Data Warehouse Statistics Visualization 132

Sisense

OCTOBER 6, 2020

These programs and systems are great at generating basic visualizations like graphs and charts from static data. The challenge comes when the data becomes huge and fast-changing. Why is quantitative data important? Qualitative data benefits: Unlocking understanding. Qualitative data can go where quantitative data can’t.

Statistics 98

Statistics Unstructured Data Data-driven Visualization 98

IBM Big Data Hub

JANUARY 17, 2023

A data lakehouse is an emerging data management architecture that improves efficiency and converges data warehouse and data lake capabilities driven by a need to improve efficiency and obtain critical insights faster. Let’s start with why data lakehouses are becoming increasingly important.

Data Lake 52

Data Lake Metadata Data Warehouse Data Governance 52

IBM Big Data Hub

SEPTEMBER 19, 2023

Data science is an area of expertise that combines many disciplines such as mathematics, computer science, software engineering and statistics. It focuses on data collection and management of large-scale structured and unstructured data for various academic and business applications.

Data Science 76

Data Science Data Analytics Prescriptive Analytics Analytics 76

Jedox

OCTOBER 22, 2020

Gartner defines “dark data” as the data organizations collect, process, and store during regular business activities, but doesn’t use any further. Gartner also estimates 80% of all data is “dark”, while 93% of unstructured data is “dark.”.

Data Analytics 69

Data Analytics Analytics Unstructured Data Data mining 69

CIO Business Intelligence

JUNE 28, 2023

The R&D laboratories produced large volumes of unstructured data, which were stored in various formats, making it difficult to access and trace. “These stages significantly influence the iterative process of conceptualizing and rolling out a new product,” Gopalan says. This allowed us to derive insights more easily.”

Digital Transformation 105

Digital Transformation Cost-Benefit Informatics Data mining 105

BizAcuity

APRIL 14, 2022

The best way to avoid poor data quality is having a strict data governance system in place. The majority of the data a business has stored is generally unstructured. Most of these are accumulated in data silos or data lakes. Unstructured Data Management. Slow query performance.

Big Data 52

Big Data Data Analytics Management Analytics 52

CIO Business Intelligence

APRIL 4, 2023

Traditionally, data warehouses have stored curated, structured data to support analytics and business intelligence, with fast, easy access to data. Data warehouses, however, were not designed to support the demands of AI or semi-structured and unstructured data sources. Want to learn more?

Data Architecture 52

Data Architecture Data Lake Data Warehouse Cost-Benefit 52

IBM Big Data Hub

JANUARY 5, 2023

The right data architecture can help your organization improve data quality because it provides the framework that determines how data is collected, transported, stored, secured, used and shared for business intelligence and data science use cases.

Data Architecture 52

Data Architecture Data Quality Strategy Data Lake 52

BizAcuity

MAY 10, 2022

Microsoft also releases Power BI, a data visualization and business intelligence tool. Google launches BigQuery, its own data warehousing tool and Microsoft introduces Azure SQL Data Warehouse and Azure Data Lake Store. Data lakes or data lake houses alone cannot solve the efficiency problem.

Data-driven 52

Data-driven IoT Unstructured Data Data Lake 52

AWS Big Data

FEBRUARY 21, 2023

It is a data modeling methodology designed for large-scale data warehouse platforms. What is a data vault? The data vault approach is a method and architectural framework for providing a business with data analytics services to support business intelligence, data warehousing, analytics, and data science needs.

Data Warehouse 85

Data Warehouse Data Lake Cost-Benefit Metadata 85

IBM Big Data Hub

FEBRUARY 2, 2023

In today’s world, data warehouses are a critical component of any organization’s technology ecosystem. They provide the backbone for a range of use cases such as business intelligence (BI) reporting, dashboarding, and machine-learning (ML)-based predictive analytics, that enable faster decision making and insights.

Data Warehouse 56

Data Warehouse Cost-Benefit Unstructured Data Data Architecture 56