AWS Big Data

APRIL 24, 2023

Building a data lake on Amazon Simple Storage Service (Amazon S3) provides numerous benefits for an organization. However, many use cases, like performing change data capture (CDC) from an upstream relational database to an Amazon S3-based data lake, require handling data at a record level.

Data Lake 98

Data Lake Data Governance Machine Learning Cost-Benefit 98

AWS Big Data

DECEMBER 4, 2024

This post explores how the shift to a data product mindset is being implemented, the challenges faced, and the early wins that are shaping the future of data management in the Institutional Division. About the Authors Leo Ramsamy is a Platform Architect specializing in data and analytics for ANZ’s Institutional division.

Metadata 105

Metadata Data Governance Data Quality Data-driven 105

AWS Big Data

JUNE 21, 2023

A typical ask for this data may be to identify sales trends as well as sales growth on a yearly, monthly, or even daily basis. A key pillar of AWS’s modern data strategy is the use of purpose-built data stores for specific use cases to achieve performance, cost, and scale. This is achieved by partitioning the data.

Data Warehouse 105

Data Warehouse Data Lake OLAP Cost-Benefit 105

IBM Big Data Hub

OCTOBER 4, 2023

Artificial intelligence (AI) is now at the forefront of how enterprises work with data to help reinvent operations, improve customer experiences, and maintain a competitive advantage. It’s no longer a nice-to-have, but an integral part of a successful data strategy. All of this supports the use of AI.

Data Lake 77

Data Lake Metadata Data Warehouse Cost-Benefit 77

AWS Big Data

JULY 13, 2023

This allows for transparency, speed to action, and collaboration across the group while enabling the platform team to evangelize the use of data: Altron engaged with AWS to seek advice on their data strategy and cloud modernization to bring their vision to fruition.

Optimization 98

Optimization B2B Data Quality Sales 98

AWS Big Data

MARCH 27, 2023

Businesses are using real-time data streams to gain insights into their company’s performance and make informed, data-driven decisions faster. As real-time data has become essential for businesses, a growing number of companies are adapting their data strategy to focus on data in motion.

Visualization 98

Visualization Data Lake Interactive Data-driven 98

Domino Data Lab

APRIL 3, 2019

Look toward the evolving changes in system architecture to understand where data governance will be heading. Definition and Descriptions. We’ll start with standard definitions – the currently accepted wisdom in the industry. That definition plus the one-liner provide good starting points. In other words, #adulting.

Machine Learning 84

Machine Learning Data Governance Metadata Data Science 84

Alation

JANUARY 10, 2023

Starting a data strategy journey. These are companies that have never used any form of data catalog, but recognize the benefits of one. The value of a data catalog means something different to each of these companies — meaning they will each expect something different out of its implementation.

ROI 52

ROI Data Lake Strategy Data-driven 52

Alation

AUGUST 11, 2022

Today, the brightest minds in our industry are targeting the massive proliferation of data volumes and the accompanying but hard-to-find value locked within all that data. A modern data stack gives a neat, closed-loop definition of what is needed. But “customer” is an easy one. It could be gross margin.

Metadata 52

Metadata Data Warehouse Data Quality Data Lake 52

Alation

MARCH 21, 2023

Having been in business for over 50 years, ARC had accumulated a massive amount of data that was stored in siloed, on-premises servers across its 7 business domains. Using Alation, ARC automated the data curation and cataloging process. “So Subscribe to Alation's Blog Get the latest data cataloging news and trends in your inbox.

Data Analytics 52

Data Analytics Analytics Data-driven Big Data 52

Ontotext

MARCH 8, 2023

As such, most large financial organizations have moved their data to a data lake or a data warehouse to understand and manage financial risk in one place. Yet, the biggest challenge for risk analysis continues to suffer from lack of a scalable way of understanding how data is interrelated.

Enterprise 52

Enterprise Knowledge Discovery Risk Machine Learning 52

Cloudera

JUNE 7, 2023

By now, almost everyone across the tech landscape has heard of the Zero Trust (ZT) security model, which assumes that every device, application, or user attempting to access a network is not to be trusted (see NIST definitions below). But as models go, the idea is easier than the execution.

Metadata 83

Metadata Data Lake Optimization Modeling 83

CIO Business Intelligence

MAY 24, 2022

Deloitte lists these as: Creating and shaping a common data foundation. Defining and using single data points for multiple purposes. Building a semantic layer describing unified business and reporting definitions. This is the first post in a series of three on data-driven organisations. Oil and Gas.

Data-driven 98

Data-driven Data Lake Data Warehouse Machine Learning 98

AWS Big Data

DECEMBER 4, 2024

FGAC enables you to granularly control access to your data lake resources at the table, column, and row levels. This level of control is essential for organizations that need to comply with data governance and security regulations, or those that deal with sensitive data. through Lake Formation permissions.

Data Lake 119

Data Lake Big Data Management Software 119

CIO Business Intelligence

APRIL 17, 2025

Its not surprising to see the differences when C-level executives tend to receive PowerPoint-level snapshots of IT problems, including data quality, says Timothy Bates, a professor in the College of Innovation and Technology at the University of Michigan Executives see dashboards clean, aggregated, polished, Bates says.

Data-driven 130

Data-driven Data Quality Snapshot Dashboards 130

AWS Big Data

OCTOBER 30, 2024

This is the final part of a three-part series where we show how to build a data lake on AWS using a modern data architecture. This post shows how to process data with Amazon Redshift Spectrum and create the gold (consumption) layer. The following diagram illustrates the different layers of the data lake.

Data Lake 95

Data Lake Machine Learning Data Architecture Data-driven 95