erwin

MAY 13, 2020

The role of data modeling (DM) has expanded to support enterprise data management, including data governance and intelligence efforts. Metadata management is the key to managing and governing your data and drawing intelligence from it. Types of Data Models: Conceptual, Logical and Physical.

Data Governance 93

Data Governance Enterprise Modeling Management 93

AWS Big Data

JANUARY 24, 2023

AWS Lake Formation helps with enterprise data governance and is important for a data mesh architecture. It works with the AWS Glue Data Catalog to enforce data access and governance. This solution only replicates metadata in the Data Catalog, not the actual underlying data.

Data Architecture 94

Data Architecture Metadata Data Lake Snapshot 94

Cloudera

DECEMBER 6, 2024

The AI Forecast: Data and AI in the Cloud Era , sponsored by Cloudera, aims to take an objective look at the impact of AI on business, industry, and the world at large. AI is only as successful as the data behind it. It could be metadata that you weren’t capturing before. That’s context, that’s location.

Manufacturing 82

Manufacturing Forecasting Metadata Data Processing 82

AWS Big Data

APRIL 3, 2024

Businesses are constantly evolving, and data leaders are challenged every day to meet new requirements. For many enterprises and large organizations, it is not feasible to have one processing engine or tool to deal with the various business requirements. This post is co-written with Andries Engelbrecht and Scott Teal from Snowflake.

Data Lake 127

Data Lake Snapshot Metadata Data Architecture 127

Sisense

JULY 6, 2020

Employing Enterprise Data Management (EDM). What is enterprise data management? Companies looking to do more with data and insights need an effective EDM setup in place. The team in charge of your company’s EDM is focused on a set of processes, practices, and activities across the entire data lineage process.

Enterprise 98

Enterprise Management Data Architecture Data-driven 98

CIO Business Intelligence

OCTOBER 13, 2023

Data architect role Data architects are senior visionaries who translate business requirements into technology requirements and define data standards and principles, often in support of data or digital transformations. Data architects are frequently part of a data science team and tasked with leading data system projects.

Data Architecture 132

Data Architecture Data Warehouse Statistics Visualization 132

AWS Big Data

DECEMBER 4, 2024

With this launch, you can query data regardless of where it is stored with support for a wide range of use cases, including analytics, ad-hoc querying, data science, machine learning, and generative AI. We’ve simplified data architectures, saving you time and costs on unnecessary data movement, data duplication, and custom solutions.

Data Analytics 104

Data Analytics Analytics Data Lake Data Quality 104

TDAN

MAY 31, 2022

The main goal of creating an enterprise data fabric is not new. It is the ability to deliver the right data at the right time, in the right shape, and to the right data consumer, irrespective of how and where it is stored. Data fabric is the common “net” that stitches integrated data from multiple data […].

Metadata 98

Metadata Enterprise IT Data Architecture 98

erwin

DECEMBER 6, 2019

Team Resources : Most successful organizations have established a formal data management group at the enterprise level. As a foundational component of enterprise data management, DG would reside in such a group. Enterprise Data Management Methodology : DG is foundational to enterprise data management.

Data Governance 145

Data Governance Metadata Enterprise Data-driven 145

CIO Business Intelligence

FEBRUARY 20, 2024

Brendan Mislin, General Manager, Industry X at Avanade, comments: “Manufacturers looking to use Microsoft Copilot and other generative AI tools first need to enable data use from across operational and enterprise applications and break down legacy OT and IT siloes.

Data Architecture 98

Data Architecture Unstructured Data Manufacturing IT 98

erwin

JULY 12, 2019

With all the advance notice and significant chatter for GDPR/CCPA, why aren’t organizations more prepared to deal with data regulations? The complexity of regulatory requirements in and of themselves is aggravated by the complexity of the business and data landscapes within most enterprises. Complexity. How erwin Can Help.

Data Governance 110

Data Governance Management Metadata Risk Management 110

CIO Business Intelligence

MARCH 24, 2023

Whereas data governance is about the roles, responsibilities, and processes for ensuring accountability for and ownership of data assets, DAMA defines data management as “an overarching term that describes the processes used to plan, specify, enable, create, acquire, maintain, use, archive, retrieve, control, and purge data.”

Data Governance 142

Data Governance Management Metadata Data Quality 142

AWS Big Data

NOVEMBER 16, 2023

As with all AWS services, Amazon Redshift is a customer-obsessed service that recognizes there isn’t a one-size-fits-all for customers when it comes to data models, which is why Amazon Redshift supports multiple data models such as Star Schemas, Snowflake Schemas and Data Vault.

Enterprise 111

Enterprise Data Warehouse Data Lake Optimization 111

erwin

DECEMBER 12, 2019

Metadata is an important part of data governance, and as a result, most nascent data governance programs are rife with project plans for assessing and documenting metadata. But in many scenarios, it seems that the underlying driver of metadata collection projects is that it’s just something you do for data governance.

Metadata 52

Metadata Data Governance Digital Transformation Data Quality 52

AWS Big Data

OCTOBER 25, 2023

Most companies produce and consume unstructured data such as documents, emails, web pages, engagement center phone calls, and social media. By some estimates, unstructured data can make up to 80–90% of all new enterprise data and is growing many times faster than structured data.

Unstructured Data 133

Unstructured Data Metadata Management Analytics 133

Cloudera

FEBRUARY 22, 2022

Over the past decade, the successful deployment of large scale data platforms at our customers has acted as a big data flywheel driving demand to bring in even more data, apply more sophisticated analytics, and on-board many new data practitioners from business analysts to data scientists.

Snapshot 110

Snapshot Metadata Cost-Benefit Data Architecture 110

IBM Big Data Hub

JANUARY 5, 2023

Several factors determine the quality of your enterprise data like accuracy, completeness, consistency, to name a few. But there’s another factor of data quality that doesn’t get the recognition it deserves: your data architecture. How the right data architecture improves data quality.

Data Architecture 52

Data Architecture Data Quality Strategy Data Lake 52

AWS Big Data

DECEMBER 4, 2024

While traditional extract, transform, and load (ETL) processes have long been a staple of data integration due to its flexibility, for common use cases such as replication and ingestion, they often prove time-consuming, complex, and less adaptable to the fast-changing demands of modern data architectures.

Data Integration 115

Data Integration Data Lake Statistics Data-driven 115

AWS Big Data

NOVEMBER 7, 2024

BladeBridge offers a comprehensive suite of tools that automate much of the complex conversion work, allowing organizations to quickly and reliably transition their data analytics capabilities to the scalable Amazon Redshift data warehouse. Amazon Redshift is a fully managed data warehouse service offered by Amazon Web Services (AWS).

Data Warehouse 105

Data Warehouse Reporting Big Data Data Lake 105

Octopai

APRIL 19, 2021

Aptly named, metadata management is the process in which BI and Analytics teams manage metadata, which is the data that describes other data. In other words, data is the context and metadata is the content. Without metadata, BI teams are unable to understand the data’s full story.

Metadata 59

Metadata Management Business Intelligence Data Governance 59

AWS Big Data

JUNE 10, 2024

Enterprises and organizations across the globe want to harness the power of data to make better decisions by putting data at the center of every decision-making process. The open table format accelerates companies’ adoption of a modern data strategy because it allows them to use various tools on top of a single copy of the data.

Data Lake 126

Data Lake Metadata Snapshot Analytics 126

AWS Big Data

OCTOBER 3, 2023

Over the years, data lakes on Amazon Simple Storage Service (Amazon S3) have become the default repository for enterprise data and are a common choice for a large set of users who query data for a variety of analytics and machine leaning use cases. Note that the migrate procedure isn’t supported in AWS Glue Data Catalog.

Data Lake 122

Data Lake Metadata Snapshot Recreation/Entertainment 122

erwin

OCTOBER 16, 2020

There’s a common denominator in what they’re all missing, and that is data intelligence. The result is an automated, real-time, high-quality data pipeline from which accurate insights can be derived. 1 of erwin Insights 2020, our virtual conference on enterprise modeling and data governance/intelligence.

Internet of Things 145

Internet of Things Data-driven Uncertainty Data Governance 145

Alation

AUGUST 18, 2022

The complex challenge here is to have the lineage be intelligently updated as the data landscape and processing dynamically bubbles and changes daily across an enterprise. Active metadata will play a critical role in automating such updates as they arise. Get the latest data cataloging news and trends in your inbox.

Metadata 69

Metadata Visualization Statistics Data Architecture 69

AWS Big Data

FEBRUARY 26, 2025

Amazon SageMaker Lakehouse provides an open data architecture that reduces data silos and unifies data across Amazon Simple Storage Service (Amazon S3) data lakes, Redshift data warehouses, and third-party and federated data sources. connection testing, metadata retrieval, and data preview.

Analytics 61

Analytics Data Lake Metadata Data Warehouse 61

Cloudera

MARCH 23, 2022

In fact, we recently announced the integration with our cloud ecosystem bringing the benefits of Iceberg to enterprises as they make their journey to the public cloud, and as they adopt more converged architectures like the Lakehouse. 4: Enterprise grade. 1: Multi-function analytics . 3: Open Performance.

Metadata 92

Metadata Data Architecture Machine Learning Cost-Benefit 92

Cloudera

JUNE 7, 2022

Leading industry analysts rated Cloudera better at analytic and operational data use cases than many well-known cloud vendors. Companies can now capitalize on the value in all their data, by delivering a hybrid data platform for modern data architectures with data anywhere.

IT 112

IT Data Architecture Unstructured Data Big Data 112

erwin

SEPTEMBER 17, 2020

It’s paramount that organizations understand the benefits of automating end-to-end data lineage. Critically, it makes it easier to get a clear view of how information is created and flows into, across and outside an enterprise. The importance of end-to-end data lineage is widely understood and ignoring it is risky business.

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143

IBM Big Data Hub

SEPTEMBER 12, 2022

Enterprises are dealing with a barrage of upcoming regulations concerning data privacy and data protection, not only at the state and federal level in the US, but also in a dizzying number of jurisdictions around the world. Think of a data fabric as a single pane of glass that creates visibility across an enterprise.

Metadata 91

Metadata Data Governance Enterprise Data Architecture 91

AWS Big Data

APRIL 29, 2024

Based on this example and considering your enterprise requirements, it becomes feasible and flexible to manage permissions in the data warehouse effectively. About the Authors Yuzhu Xiao is a Senior Data Development Engineer at Amber Group with extensive experience in cloud data platform architecture.

Management 116

Management Big Data Data Warehouse Metadata 116

CIO Business Intelligence

MARCH 6, 2024

Jurgen Mueller, SAP CTO and executive board member, called the innovations, which includes an expanded partnership with data governance specialist Collibra, a “quantum leap” in the company’s ability to help customers drive intelligent business transformation through data.

Unstructured Data 129

Unstructured Data Dashboards Business Intelligence Data Governance 129

Cloudera

JUNE 30, 2022

With Cloudera’s vision of hybrid data , enterprises adopting an open data lakehouse can easily get application interoperability and portability to and from on premises environments and any public cloud without worrying about data scaling. Supercharge your data lakehouse, make it open.

Data Lake 88

Data Lake Data Warehouse Data Architecture Metadata 88

Jen Stirrup

MARCH 29, 2023

SAP helps to solve this search problem by offering ways to simplify business data with a solid data foundation that powers SAP Datasphere. It fits neatly with the renewed interest in data architecture, particularly data fabric architecture. They fail to get a grip on their data.

Data Warehouse 121

Data Warehouse Metadata Data Integration Business Intelligence 121

IBM Big Data Hub

APRIL 27, 2022

Data fabric and data mesh are emerging data management concepts that are meant to address the organizational change and complexities of understanding, governing and working with enterprise data in a hybrid multicloud ecosystem. The good news is that both data architecture concepts are complimentary.

Management 79

Management Metadata Data Architecture Data Lake 79

AWS Big Data

JUNE 10, 2024

Organizations have multiple Hive data warehouses across EMR clusters, where the metadata gets generated. To address this challenge, organizations can deploy a data mesh using AWS Lake Formation that connects the multiple EMR clusters. An entity can act both as a producer of data assets and as a consumer of data assets.

Data Lake 117

Data Lake Metadata Data Warehouse Data Processing 117

CIO Business Intelligence

JUNE 23, 2022

Leading industry analysts rated Cloudera better at analytic and operational data use cases than many well-known cloud vendors. Companies can now capitalize on the value in all their data, by delivering a hybrid data platform for modern data architectures with data anywhere. Jonathan Takiff / IDG.

IT 97

IT Data Architecture Unstructured Data Big Data 97

AWS Big Data

OCTOBER 30, 2024

This is part two of a three-part series where we show how to build a data lake on AWS using a modern data architecture. This post shows how to load data from a legacy database (SQL Server) into a transactional data lake ( Apache Iceberg ) using AWS Glue.

Data Lake 105

Data Lake Data Processing Optimization Machine Learning 105