CIO Business Intelligence

AUGUST 9, 2024

At Atlanta’s Hartsfield-Jackson International Airport, an IT pilot has led to a wholesale data journey destined to transform operations at the world’s busiest airport, fueled by machine learning and generative AI. Data integrity presented a major challenge for the team, as there were many instances of duplicate data.

Data Transformation 126

Data Transformation Machine Learning Data Lake Dashboards 126

AWS Big Data

FEBRUARY 26, 2025

Analytics remained one of the key focus areas this year, with significant updates and innovations aimed at helping businesses harness their data more efficiently and accelerate insights. From enhancing data lakes to empowering AI-driven analytics, AWS unveiled new tools and services that are set to shape the future of data and analytics.

Analytics 62

Analytics Data Lake Metadata Data Warehouse 62

AWS Big Data

JULY 29, 2024

In the era of big data, data lakes have emerged as a cornerstone for storing vast amounts of raw data in its native format. They support structured, semi-structured, and unstructured data, offering a flexible and scalable environment for data ingestion from multiple sources.

Metadata 126

Metadata Snapshot Data Lake Metrics 126

Smart Data Collective

OCTOBER 27, 2021

The application presents a massive volume of unstructured data through a graphical or programming interface using the analytical abilities of business intelligence technology to provide instant insight. Interactive analytics applications present vast volumes of unstructured data at scale to provide instant insights.

Interactive 130

Interactive Analytics Unstructured Data Data Warehouse 130

AWS Big Data

MARCH 7, 2024

At the same time, they need to optimize operational costs to unlock the value of this data for timely insights and do so with a consistent performance. With this massive data growth, data proliferation across your data stores, data warehouse, and data lakes can become equally challenging.

Data Lake 131

Data Lake Analytics Dashboards Metrics 131

AWS Big Data

FEBRUARY 22, 2023

In this post, we show how Ruparupa implemented an incrementally updated data lake to get insights into their business using Amazon Simple Storage Service (Amazon S3), AWS Glue , Apache Hudi , and Amazon QuickSight. An AWS Glue ETL job, using the Apache Hudi connector, updates the S3 data lake hourly with incremental data.

Data Lake 52

Data Lake Dashboards Cost-Benefit Data Warehouse 52

Cloudera

DECEMBER 11, 2020

Without meeting GxP compliance, the Merck KGaA team could not run the enterprise data lake needed to store, curate, or process the data required to inform business decisions. It established a data governance framework within its enterprise data lake. Driving innovation with secure and governed data .

Data Lake 98

Data Lake Cost-Benefit Unstructured Data Data Governance 98

Sisense

JULY 22, 2020

The trend has been towards using cloud-based applications and tools for different functions, such as Salesforce for sales, Marketo for marketing automation, and large-scale data storage like AWS or data lakes such as Amazon S3 , Hadoop and Microsoft Azure. Sisense provides instant access to your cloud data warehouses.

Slice and Dice 98

Slice and Dice Digital Transformation Data Warehouse Data Lake 98

Sisense

JUNE 30, 2020

Simply put, data visualization means showing data in a visual format that makes insights easier to understand for human users. Data is usually visualized in a pictorial or graphical form such as charts, graphs, lists, maps, and comprehensive dashboards that combine these multiple formats.

Visualization 93

Visualization Analytics Dashboards Data-driven 93

CIO Business Intelligence

APRIL 8, 2025

Inflexible schema, poor for unstructured or real-time data. Data lake Raw storage for all types of structured and unstructured data. Low cost, flexibility, captures diverse data sources. Easy to lose control, risk of becoming a data swamp. Exploratory analytics, raw and diverse data types.

Data Quality 102

Data Quality Data-driven Key Performance Indicator Metadata 102

AWS Big Data

MARCH 25, 2024

This data store provides your organization with the holistic customer records view that is needed for operational efficiency of RAG-based generative AI applications. For building such a data store, an unstructured data store would be best. This is typically unstructured data and is updated in a non-incremental fashion.

Data Lake 122

Data Lake Unstructured Data Management Snapshot 122

Cloudera

NOVEMBER 10, 2020

We have evolved with our users, from early-on Hadoop hackers needing quick access to data in the Data Lake, to a much more sophisticated SQL tool. It, therefore, makes sense to provide a seamless transition from the context of HUE to Cloudera’s new, built-in Data Visualization tool.

Visualization 112

Visualization Optimization Unstructured Data Dashboards 112

AWS Big Data

MARCH 2, 2023

Many organizations are building data lakes to store and analyze large volumes of structured, semi-structured, and unstructured data. In addition, many teams are moving towards a data mesh architecture, which requires them to expose their data sets as easily consumable data products.

Data Lake 98

Data Lake Testing Interactive Unstructured Data 98

Andrew White

DECEMBER 9, 2019

Scope could be: Data (i.e. Information (processed data). Records (files, or what you might all unstructured data). Analytical stewardship is a missing link in analytics, BI and data science. Downstream in the analytics pipeline. Analytic (the analytics itself). Images (i.e. Events or transactions.

Analytics 66

Analytics Data Lake Data Governance Data Warehouse 66

AWS Big Data

JANUARY 8, 2024

In this post, we will review the common architectural patterns of two use cases: Time Series Data Analysis and Event Driven Microservices. All these architecture patterns are integrated with Amazon Kinesis Data Streams. Stream ingestion – The stream ingestion layer is responsible for ingesting data into the stream storage layer.

Analytics 134

Analytics IoT Data-driven Snapshot 134

CIO Business Intelligence

APRIL 24, 2024

In fact, AMA collects a huge amount of structured and unstructured data from bins, collection vehicles, facilities, and user reports, and until now, this data has remained disconnected, managed by disparate systems and interfaces, through Excel spreadsheets.

Digital Transformation 105

Digital Transformation Business Intelligence Unstructured Data Data Lake 105

Cloudera

NOVEMBER 18, 2021

By adopting a custom developed application based on the Cloudera ecosystem, Carrefour has combined the legacy systems into one platform which provides access to customer data in a single data lake. EVA unifies data from MTN’s different operator systems, creating a 360° view of subscribers.

Data Lake 77

Data Lake Cost-Benefit Digital Transformation Risk 77

Jet Global

OCTOBER 30, 2020

Introducing Data Lakes. Microsoft’s next option is called Azure Data Lake Services (ADLS), and it seems to be the company’s favored long-term solution to its D365 F&SCM reporting challenge. Data lake” is a generic term that refers to a fairly new development in the world of big data analytics.

Data Lake 52

Data Lake Unstructured Data Reporting Finance 52

IBM Big Data Hub

SEPTEMBER 19, 2023

Data science is an area of expertise that combines many disciplines such as mathematics, computer science, software engineering and statistics. It focuses on data collection and management of large-scale structured and unstructured data for various academic and business applications.

Data Science 76

Data Science Data Analytics Prescriptive Analytics Analytics 76

AWS Big Data

APRIL 19, 2023

Building an optimal data system As data grows at an extraordinary rate, data proliferation across your data stores, data warehouse, and data lakes can become a challenge. This performance innovation allows Nasdaq to have a multi-use data lake between teams.

Data Warehouse 59

Data Warehouse Data Lake Unstructured Data Optimization 59

Jedox

OCTOBER 22, 2020

Gartner defines “dark data” as the data organizations collect, process, and store during regular business activities, but doesn’t use any further. Gartner also estimates 80% of all data is “dark”, while 93% of unstructured data is “dark.”. Self-service reporting. Drill-down capability. Exception reporting.

Data Analytics 69

Data Analytics Analytics Unstructured Data Data mining 69

AWS Big Data

FEBRUARY 21, 2023

At the heart of all data warehousing is integration, and this layer contains integrated data from multiple sources built around the enterprise-wide business keys. Although data lakes resemble data vaults, a data vault provides more features of a data warehouse.

Data Warehouse 95

Data Warehouse Data Lake Cost-Benefit Metadata 95

IBM Big Data Hub

AUGUST 4, 2023

When effectively implemented, a data democracy simplifies the data stack, eliminates data gatekeepers, and makes the company’s comprehensive data platform easily accessible by different teams via a user-friendly dashboard. Then, it applies these insights to automate and orchestrate the data lifecycle.

Data Architecture 59

Data Architecture Data Lake Machine Learning Data Governance 59

IBM Big Data Hub

FEBRUARY 2, 2023

In today’s world, data warehouses are a critical component of any organization’s technology ecosystem. They provide the backbone for a range of use cases such as business intelligence (BI) reporting, dashboarding, and machine-learning (ML)-based predictive analytics, that enable faster decision making and insights.

Data Warehouse 56

Data Warehouse Cost-Benefit Unstructured Data Data Architecture 56

Cloudera

MAY 16, 2018

This example combines three types of unrelated data: Legal entity data: Two companies with completely unrelated business lines (coffee and waste management) merged together; Unstructured data: Fraudulent promotion campaigns took place through press releases and a fake stock-picking robot.

Data Lake 42

Data Lake Risk Visualization Unstructured Data 42

Sisense

MAY 11, 2021

The reasons for this are simple: Before you can start analyzing data, huge datasets like data lakes must be modeled or transformed to be usable. According to a recent survey conducted by IDC , 43% of respondents were drawing intelligence from 10 to 30 data sources in 2020, with a jump to 64% in 2021!

Modeling 84

Modeling Big Data IoT Data Warehouse 84

IBM Big Data Hub

DECEMBER 16, 2022

For example, data catalogs have evolved to deliver governance capabilities like managing data quality and data privacy and compliance. It uses metadata and data management tools to organize all data assets within your organization.

Metadata 52

Metadata Data Quality Data-driven Data Governance 52

Alation

MARCH 21, 2023

To fully realize data’s value, organizations in the travel industry need to dismantle data silos so that they can securely and efficiently leverage analytics across their organizations. What is big data in the travel and tourism industry? Using Alation, ARC automated the data curation and cataloging process. “So

Data Analytics 52

Data Analytics Analytics Data-driven Big Data 52

CIO Business Intelligence

MAY 24, 2022

Unlocking the value of data with in-depth advanced analytics, focusing on providing drill-through business insights. Providing a platform for fact-based and actionable management reporting, algorithmic forecasting and digital dashboarding. Today transactional data is the largest segment, which includes streaming and data flows.

Data-driven 98

Data-driven Data Lake Data Warehouse Machine Learning 98

Jet Global

MAY 9, 2024

The key components of a data pipeline are typically: Data Sources : The origin of the data, such as a relational database , data warehouse, data lake , file, API, or other data store. This can include tasks such as data ingestion, cleansing, filtering, aggregation, or standardization.

Data Lake 52

Data Lake Data Warehouse Business Intelligence Machine Learning 52

Jet Global

OCTOBER 1, 2024

Trino allows users to run ad hoc queries across massive datasets, making real-time decision-making a reality without needing extensive data transformations. This is particularly valuable for teams that require instant answers from their data. Data Lake Analytics: Trino doesn’t just stop at databases.

Dashboards 52

Dashboards Data Lake Reporting Cost-Benefit 52

David Menninger's Analyst Perspectives

JANUARY 29, 2025

Over time, the worlds of data lakes and data warehouses collided. Databricks introduced the concept of a data lakehouse , adding Databricks SQL as well as open table formats. Databricks also unveiled LakeFlow to bring together all types of data engineering processes into a unified platform.

IT 147

IT Dashboards Unstructured Data Big Data 147

AWS Big Data

APRIL 28, 2025

Many organizations turn to data lakes for the flexibility and scale needed to manage large volumes of structured and unstructured data. Recently, NI embarked on a journey to transition their legacy data lake from Apache Hive to Apache Iceberg. NIs leading brands, Top10.com

Data Lake 74

Data Lake Metadata Cost-Benefit Snapshot 74

BI-Survey

FEBRUARY 27, 2025

AI Model Governance As laid out earlier, the scope of data governance is expanding as AI governance has become an additional requirement. Basic: Does the catalog provide standard data governance features? Advanced capabilities are needed that bring data catalogs closer to the actual data as a side-effect.

Unstructured Data 52

Unstructured Data Metadata Data Quality Data Governance 52

CIO Business Intelligence

MAY 6, 2025

Too often, organizations conflate dashboards with intelligence. These are your standard reports and dashboard visualizations of historical data showing sales last quarter, NPS trends, operational thoughts or marketing campaign performance. The new analytics mandate is descriptive, predictive and prescriptive in context.

Prescriptive Analytics 78

Prescriptive Analytics Predictive Analytics Descriptive Analytics ROI 78