Remove Dashboards Remove Data Governance Remove Metadata
article thumbnail

How EUROGATE established a data mesh architecture using Amazon DataZone

AWS Big Data

Data landscape in EUROGATE and current challenges faced in data governance The EUROGATE Group is a conglomerate of container terminals and service providers, providing container handling, intermodal transports, maintenance and repair, and seaworthy packaging services. Eliminate centralized bottlenecks and complex data pipelines.

IoT 111
article thumbnail

Enhance data governance with enforced metadata rules in Amazon DataZone

AWS Big Data

We’re excited to announce a new feature in Amazon DataZone that offers enhanced metadata governance for your subscription approval process. With this update, domain owners can define and enforce metadata requirements for data consumers when they request access to data assets.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Monitoring Apache Iceberg metadata layer using AWS Lambda, AWS Glue, and AWS CloudWatch

AWS Big Data

It addresses many of the shortcomings of traditional data lakes by providing features such as ACID transactions, schema evolution, row-level updates and deletes, and time travel. In this blog post, we’ll discuss how the metadata layer of Apache Iceberg can be used to make data lakes more efficient.

Metadata 126
article thumbnail

How BMW streamlined data access using AWS Lake Formation fine-grained access control

AWS Big Data

To achieve this, they aimed to break down data silos and centralize data from various business units and countries into the BMW Cloud Data Hub (CDH). However, the initial version of CDH supported only coarse-grained access control to entire data assets, and hence it was not possible to scope access to data asset subsets.

Data Lake 108
article thumbnail

Cloudera and Snowflake Partner to Deliver the Most Comprehensive Open Data Lakehouse

Cloudera

In August, we wrote about how in a future where distributed data architectures are inevitable, unifying and managing operational and business metadata is critical to successfully maximizing the value of data, analytics, and AI.

article thumbnail

What Does It Mean to Make Data Governance Fun?

Alation

The words “ data governance ” and “fun” are seldom spoken together. The term data governance conjures images of restrictions and control that result in an uphill challenge for most programs and organizations from the beginning. Or they are spending too much time preparing the data for proper use.

article thumbnail

Specialized tools for machine learning development and model governance are becoming essential

O'Reilly on Data

We’ve become accustomed to the need for data governance and provenance, understanding and controlling the many databases that are combined in a modern data-driven application. Metadata and artifacts needed for audits: as an example, the output from the components of MLflow will be very pertinent for audits.