erwin

SEPTEMBER 17, 2020

Replace manual and recurring tasks for fast, reliable data lineage and overall data governance. It’s paramount that organizations understand the benefits of automating end-to-end data lineage. The importance of end-to-end data lineage is widely understood and ignoring it is risky business. Doing Data Lineage Right.

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143

AWS Big Data

DECEMBER 21, 2023

This is a guest post co-written by Alex Naumov, Principal Data Architect at smava. smava believes in and takes advantage of data-driven decisions in order to become the market leader. smava believes in and takes advantage of data-driven decisions in order to become the market leader.

Data Lake 115

Data Lake Data Warehouse Data-driven B2B 115

CIO Business Intelligence

NOVEMBER 7, 2023

For years, IT and business leaders have been talking about breaking down the data silos that exist within their organizations. Given the importance of sharing information among diverse disciplines in the era of digital transformation, this concept is arguably as important as ever. What are the challenges and potential rewards?

Data Warehouse 142

Data Warehouse Digital Transformation Data-driven Reporting 142

CIO Business Intelligence

AUGUST 3, 2023

When global technology company Lenovo started utilizing data analytics, they helped identify a new market niche for its gaming laptops, and powered remote diagnostics so their customers got the most from their servers and other devices.

Analytics 98

Analytics Data Lake Metadata Cost-Benefit 98

Cloudera

JUNE 30, 2022

We are excited to announce the general availability of Apache Iceberg in Cloudera Data Platform (CDP). These tools empower analysts and data scientists to easily collaborate on the same data, with their choice of tools and analytic engines. Why integrate Apache Iceberg with Cloudera Data Platform?

Data Lake 88

Data Lake Data Warehouse Data Architecture Metadata 88

AWS Big Data

APRIL 19, 2023

Data mesh is a new approach to data management. Companies across industries are using a data mesh to decentralize data management to improve data agility and get value from data. This is especially true in a large enterprise with thousands of data products.

Technology 105

Technology Data-driven Machine Learning Sales 105

Cloudera

DECEMBER 21, 2021

Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. Data pipelines are composed of multiple steps with dependencies and triggers.

Snapshot 118

Snapshot Data-driven Optimization Management 118

Sisense

AUGUST 28, 2020

We live in a world of data: There’s more of it than ever before, in a ceaselessly expanding array of forms and locations. Dealing with Data is your window into the ways data teams are tackling the challenges of this new world to help their companies and their customers thrive. What is data integrity? Data integrity risks.

Data Integration 101

Data Integration Testing Data Quality Data-driven 101

AWS Big Data

NOVEMBER 15, 2023

It seamlessly consolidates data from various data sources within AWS, including AWS Cost Explorer (and forecasting with Cost Explorer ), AWS Trusted Advisor , and AWS Compute Optimizer. Overview of the BMW Cloud Data Hub At the BMW Group, Cloud Data Hub (CDH) is the central platform for managing company-wide data and data solutions.

Dashboards 111

Dashboards Analytics Metadata Data Warehouse 111

AWS Big Data

SEPTEMBER 5, 2024

Amazon Redshift , a warehousing service, offers a variety of options for ingesting data from diverse sources into its high-performance, scalable environment. This native feature of Amazon Redshift uses massive parallel processing (MPP) to load objects directly from data sources into Redshift tables.

IoT 111

IoT Data Warehouse Cost-Benefit Reporting 111

AWS Big Data

JULY 20, 2023

With data becoming the driving force behind many industries today, having a modern data architecture is pivotal for organizations to be successful. In this post, we describe Orca’s journey building a transactional data lake using Amazon Simple Storage Service (Amazon S3), Apache Iceberg, and AWS Analytics.

Data Lake 98

Data Lake Analytics Snapshot Data Quality 98

IBM Big Data Hub

FEBRUARY 9, 2023

In our last blog , we delved into the seven most prevalent data challenges that can be addressed with effective data governance. Today we will share our approach to developing a data governance program to drive data transformation and fuel a data-driven culture. Don’t try to do everything at once!

Data Governance 76

Data Governance Business Objectives Data Quality Measurement 76

FineReport

MARCH 31, 2024

In 2024, business intelligence (BI) software has undergone significant advancements, revolutionizing data management and decision-making processes. Harnessing the power of advanced APIs, automation, and AI, these tools simplify data compilation, organization, and visualization, empowering users to extract actionable insights effortlessly.

Dashboards 52

Dashboards Visualization Data mining Data-driven 52

IBM Big Data Hub

JANUARY 18, 2023

Data platform architecture has an interesting history. A read-optimized platform that can integrate data from multiple applications emerged. In another decade, the internet and mobile started the generate data of unforeseen volume, variety and velocity. It required a different data platform solution. Guess what?

Data Lake 52

Data Lake Data Warehouse Data-driven Metadata 52

Anmut

MARCH 24, 2022

A closer look at the importance (and transformational value) of your organisation’s data landscape. After decades in the background, data is currently king of the business world. Over 70% of digital transformations fail, and most CDOs last less than two-and-half years. What is a data landscape?

ROI 52

ROI Measurement Data-driven Data Transformation 52

Ontotext

MARCH 27, 2024

For example, GPS, social media, cell phone handoffs are modeled as graphs while data catalogs, data lineage and MDM tools leverage knowledge graphs for linking metadata with semantics. Both nodes and edges have associated properties modeled as key-values with primitive data types and are single-valued.

Modeling 53

Modeling Metadata Data Quality Enterprise 53

Peter James Thomas

OCTOBER 30, 2018

Where they have, I have normally found the people holding these roles to be better informed about data matters than their peers. Prelude… I recently came across an article in Marketing Week with the clickbait-worthy headline of Why the rise of the chief data officer will be short-lived (their choice of capitalisation).

Marketing 51

Marketing Strategy Data Architecture Data Strategy 51

AWS Big Data

APRIL 5, 2023

In 2021, Showpad set forth the vision to use the power of data to unlock innovations and drive business decisions across its organization. In this post, we share how Showpad used QuickSight to streamline data and insights access across teams and customers. Showpad migrated over 70 dashboards with over 1,000 visuals.

Dashboards 52

Dashboards Reporting Cost-Benefit Visualization 52

Data Virtualization

APRIL 21, 2021

BHP is a global resources company headquartered in Melbourne, Australia. It is among the world’s top producers of major commodities, including iron ore, metallurgical coal, and copper, and has substantial interests in oil and gas. BHP has operations and offices.

IT 52

IT Data-driven Data Architecture Data Transformation 52

CIO Business Intelligence

AUGUST 7, 2024

Its AI/ML-driven predictive analysis enhanced proactive threat hunting and phishing investigations as well as automated case management for swift threat identification. Options included hosting a secondary data center, outsourcing business continuity to a vendor, and establishing private cloud solutions.

IT 119

IT Insurance Cost-Benefit Testing 119

Jet Global

MAY 1, 2023

By leveraging data analysis to solve high-value business problems, they will become more efficient. This is in contrast to traditional BI, which extracts insight from data outside of the app. that gathers data from many sources. These tools prep that data for analysis and then provide reporting on it from a central viewpoint.

Analytics 52

Analytics Cost-Benefit Visualization Dashboards 52

AWS Big Data

DECEMBER 2, 2024

The rapid adoption has enabled them to quickly streamline operations, enhance collaboration, and gain more accessible, scalable solutions for managing their critical data and workflows. From there, they can perform meaningful analytics, gain valuable insights, and optionally push enriched data back to external SaaS platforms.

Data Lake 104

Data Lake Testing Data Integration Metadata 104

AWS Big Data

APRIL 28, 2025

Many organizations turn to data lakes for the flexibility and scale needed to manage large volumes of structured and unstructured data. Recently, NI embarked on a journey to transition their legacy data lake from Apache Hive to Apache Iceberg. Silver layer : Contains cleaned and enriched data, processed using Apache Flink.

Data Lake 67

Data Lake Metadata Cost-Benefit Snapshot 67

DataKitchen

JANUARY 23, 2023

What is data lineage? Data lineage traces data’s origin, history, and movement through various processing, storage, and analysis stages. It is used to understand the provenance of data and how it is transformed and to identify potential errors or issues. What about DataOps Observability? How does it compare?

Testing 130

Testing Data Governance Data Quality Data-driven 130

AWS Big Data

NOVEMBER 14, 2024

Key services in the solution include Amazon API Gateway , Amazon Data Firehose , and Amazon Location Service. The challenge In the event of a disaster e.g. water flood, there is usually a lack of terrestrial data connectivity that prevents monitoring stations from taking actionable measures in real time.

Data Lake 105

Data Lake Metadata Testing Data-driven 105