CIO Business Intelligence

MARCH 19, 2025

Yet, while businesses increasingly rely on data-driven decision-making, the role of chief data officers (CDOs) in sustainability remains underdeveloped and underutilized. Collaborating with research institutions can improve ESG data methodologies while engaging with regulators ensures compliance with changing disclosure requirements.

IT 59

IT Data Governance Data-driven Metrics 59

AWS Big Data

JANUARY 31, 2023

Data governance is the collection of policies, processes, and systems that organizations use to ensure the quality and appropriate handling of their data throughout its lifecycle for the purpose of generating business value.

Data Lake 98

Data Lake Data Governance Data Architecture Machine Learning 98

AWS Big Data

JULY 18, 2024

The current method is largely manual, relying on emails and general communication, which not only increases overhead but also varies from one use case to another in terms of data governance. Amazon DataZone projects enable collaboration with teams through data assets and the ability to manage and monitor data assets across projects.

Data Lake 130

Data Lake Publishing Metadata Data-driven 130

AWS Big Data

JUNE 10, 2024

In this post, we delve into the key aspects of using Amazon EMR for modern data management, covering topics such as data governance, data mesh deployment, and streamlined data discovery. Organizations have multiple Hive data warehouses across EMR clusters, where the metadata gets generated.

Data Lake 116

Data Lake Metadata Data Warehouse Data Processing 116

CIO Business Intelligence

NOVEMBER 29, 2022

A sea of complexity For years, data ecosystems have gotten more complex due to discrete (and not necessarily strategic) data-platform decisions aimed at addressing new projects, use cases, or initiatives. Layering technology on the overall data architecture introduces more complexity.

Data Architecture 111

Data Architecture Data Integration IoT Data-driven 111

IBM Big Data Hub

APRIL 27, 2022

Data fabric and data mesh are emerging data management concepts that are meant to address the organizational change and complexities of understanding, governing and working with enterprise data in a hybrid multicloud ecosystem. The good news is that both data architecture concepts are complimentary.

Management 79

Management Metadata Data Architecture Data Lake 79

Cloudera

OCTOBER 7, 2021

Those decentralization efforts appeared under different monikers through time, e.g., data marts versus data warehousing implementations (a popular architectural debate in the era of structured data) then enterprise-wide data lakes versus smaller, typically BU-Specific, “data ponds”.

Metadata 124

Metadata Cost-Benefit Enterprise Interactive 124

Cloudera

NOVEMBER 18, 2020

We also celebrated the first-ever winner of the Data Impact Achievement Award — a new award category that recognizes one customer who has consistently achieved transformation across their business, pursuing a diverse set of use cases and creating a culture of data-driven innovation. . Data Impact Achievement Award.

Internet Publishing and Broadcasting 123

Internet Publishing and Broadcasting Data-driven Broadcasting Digital Transformation 123

IBM Big Data Hub

JULY 5, 2022

In today’s world of complex data architectures and emerging technologies, databases can sometimes be undervalued and unrecognized. Back in the 1960s and 70s, vast amounts of data were stored in the world’s new mainframe computers—many of them IBM System/360 machines—and had become a problem. They were expensive.

Data Lake 86

Data Lake Data Warehouse Publishing Structured Data 86

Alation

MARCH 31, 2023

Actually, with Solomon-like wisdom, Zaidi and Thanaraj suggest a scenario where data fabric and data mesh work together — a Reese’s Peanut Butter Cup of data architecture, representing a “meshy fabric” scenario I presented last year. Data governance. “I He compared governance to the U.S.

Data Analytics 52

Data Analytics Analytics Metadata Data Governance 52

AWS Big Data

JULY 14, 2023

In this post, we discuss how the Amazon Finance Automation team used AWS Lake Formation and the AWS Glue Data Catalog to build a data mesh architecture that simplified data governance at scale and provided seamless data access for analytics, AI, and machine learning (ML) use cases.

Finance 98

Finance Metadata Big Data Recreation/Entertainment 98

Octopai

APRIL 19, 2021

BI teams will have a better handle on their data’s history, its current status, and any changes it may have undergone. Without organized metadata management, the validity of a company’s data is compromised and they won’t achieve adequate compliance, data governance, or generate correct insights. TDWI – David Loshin.

Metadata 59

Metadata Management Business Intelligence Data Governance 59

AWS Big Data

MARCH 10, 2023

Tracking data changes and rollback Build your transactional data lake on AWS You can build your modern data architecture with a scalable data lake that integrates seamlessly with an Amazon Redshift powered cloud warehouse. One important aspect to a successful data strategy for any organization is data governance.

Data Lake 122

Data Lake Sales Data Warehouse Snapshot 122

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

AWS Big Data

FEBRUARY 26, 2025

Amazon SageMaker Lakehouse provides an open data architecture that reduces data silos and unifies data across Amazon Simple Storage Service (Amazon S3) data lakes, Redshift data warehouses, and third-party and federated data sources.

Analytics 61

Analytics Data Lake Metadata Data Warehouse 61

Ontotext

NOVEMBER 16, 2023

Data mesh solves this by promoting data autonomy, allowing users to make decisions about domains without a centralized gatekeeper. It also improves development velocity with better data governance and access with improved data quality aligned with business needs.

Metadata 52

Metadata Data-driven Data Quality Data Architecture 52

erwin

APRIL 16, 2024

The data mesh framework In the dynamic landscape of data management, the search for agility, scalability, and efficiency has led organizations to explore new, innovative approaches. One such innovation gaining traction is the data mesh framework. This empowers individual teams to own and manage their data.

Metadata 52

Metadata Data Quality Data Governance Modeling 52

Ontotext

JANUARY 10, 2024

Overall, RDF graphs are much finer-grained and enable better data governance and flexibility, while LPGs have proven to be more efficient in some graph analytics tasks. To implement a data fabric pattern, on the other hand, we need data management tools for data integration, data quality, and data governance.

Metadata 72

Metadata Slice and Dice Data Integration Enterprise 72

AWS Big Data

JUNE 29, 2023

In the dialog box that appears, enter the data format yyyy-MM-dd'T'HH:mm:ssZZ. Choose PUBLISH & VISUALIZE. Create a governance dashboard with the appropriate visualization type. Additionally, you can extend this solution to include DDL commands used for Amazon Redshift data sharing across clusters.

Data Warehouse 83

Data Warehouse Dashboards Testing Visualization 83

Andrew White

JANUARY 9, 2022

I try to relate as much published research as I can in the time available to draft a response. – In the webinar and Leadership Vision deck for Data and Analytics we called out AI engineering as a big trend. – In the webinar and Leadership Vision deck for Data and Analytics we called out AI engineering as a big trend.

Analytics 64

Analytics Measurement Data-driven Modeling 64

AWS Big Data

APRIL 29, 2025

While enabling organization-wide efficiency, the team also applied these principles to the data architecture, making sure that CLEA itself operates frugally. After evaluating various tools, we built a serverless data transformation pipeline using Amazon Athena and dbt. However, our initial data architecture led to challenges.

Data Transformation 54

Data Transformation Cost-Benefit Testing Data Lake 54

AWS Big Data

APRIL 28, 2025

When the user interacts with resources within SageMaker Unified Studio, it generates IAM session credentials based on the users effective profile in the specific project context, and then users can use tools such as Amazon Athena or Amazon Redshift to query the relevant data. SageMaker Unified Studio supports Lake Formation hybrid mode.

Metadata 61

Metadata Data Lake Big Data Management 61