erwin

JULY 12, 2019

It also helps enterprises put these strategic capabilities into action by: Understanding their business, technology and data architectures and their inter-relationships, aligning them with their goals and defining the people, processes and technologies required to achieve compliance.

Data Governance 110

Data Governance Management Metadata Risk Management 110

DataKitchen

OCTOBER 11, 2021

First, you must understand the existing challenges of the data team, including the data architecture and end-to-end toolchain. Figure 2: Example data pipeline with DataOps automation. In this project, I automated data extraction from SFTP, the public websites, and the email attachments.

Testing 154

Testing Metadata Dashboards Statistics 154

AWS Big Data

DECEMBER 19, 2024

Data has become an invaluable asset for businesses, offering critical insights to drive strategic decision-making and operational optimization. The prod-hema-data-catalog is the production-grade catalog that supports data sharing across production services and, in some cases, pre-production services.

Data Governance 52

Data Governance Publishing Data-driven Metadata 52

CIO Business Intelligence

NOVEMBER 29, 2022

A sea of complexity For years, data ecosystems have gotten more complex due to discrete (and not necessarily strategic) data-platform decisions aimed at addressing new projects, use cases, or initiatives. Layering technology on the overall data architecture introduces more complexity.

Data Architecture 111

Data Architecture Data Integration IoT Data-driven 111

AWS Big Data

JULY 25, 2024

Instead of a central data platform team with a data warehouse or data lake serving as the clearinghouse of all data across the company, a data mesh architecture encourages distributed ownership of data by data producers who publish and curate their data as products, which can then be discovered, requested, and used by data consumers.

Data Lake 115

Data Lake Metadata Sales Publishing 115

AWS Big Data

AUGUST 1, 2024

Migrating to Amazon Redshift offers organizations the potential for improved price-performance, enhanced data processing, faster query response times, and better integration with technologies such as machine learning (ML) and artificial intelligence (AI). When the wave is complete, the people from that wave will move to another wave.

Data Warehouse 115

Data Warehouse KPI Optimization Cost-Benefit 115

IBM Big Data Hub

APRIL 27, 2022

Data fabric and data mesh are emerging data management concepts that are meant to address the organizational change and complexities of understanding, governing and working with enterprise data in a hybrid multicloud ecosystem. The good news is that both data architecture concepts are complimentary.

Management 79

Management Metadata Data Architecture Data Lake 79

AWS Big Data

JANUARY 31, 2023

Data governance is increasingly top-of-mind for customers as they recognize data as one of their most important assets. Effective data governance enables better decision-making by improving data quality, reducing data management costs, and ensuring secure access to data for stakeholders.

Data Lake 98

Data Lake Data Governance Data Architecture Machine Learning 98

Cloudera

JULY 29, 2024

Enterprise stream management is the ability to manage an intermediary that can broker real-time data between any number of “publishing” sources and “subscribing” destinations. This capability is the backbone of building real-time use cases, and it eliminates the need to build sprawling point-to-point connections across the enterprise.

Enterprise 69

Enterprise Data Architecture Manufacturing Key Performance Indicator 69

Sisense

SEPTEMBER 3, 2020

Programming and statistics are two fundamental technical skills for data analysts, as well as data wrangling and data visualization. Data analysts in one organization might be called data scientists or statisticians in another. Database design is often an important part of the business analyst role.

Statistics 97

Statistics Metrics Visualization Finance 97

Octopai

APRIL 19, 2021

Her Twitter page is filled with interesting articles, webinars, reports, and current news surrounding data management. She tweets and retweets about topics such as data governance, data strategy, and data architecture. TDAN stands for The Data Administration Newsletter. It is published by Robert S.

Metadata 59

Metadata Management Business Intelligence Data Governance 59

erwin

APRIL 16, 2024

The data mesh framework In the dynamic landscape of data management, the search for agility, scalability, and efficiency has led organizations to explore new, innovative approaches. One such innovation gaining traction is the data mesh framework. Business Glossaries – what is the business meaning of our data?

Metadata 52

Metadata Data Quality Data Governance Modeling 52

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

Ontotext

NOVEMBER 16, 2023

Data mesh solves this by promoting data autonomy, allowing users to make decisions about domains without a centralized gatekeeper. It also improves development velocity with better data governance and access with improved data quality aligned with business needs.

Metadata 52

Metadata Data-driven Data Quality Data Architecture 52

Ontotext

MARCH 27, 2024

For example, a node in an LPG with a given label does not guarantee anything about its properties and data type (because it is a string and represents no semantics). LPG lacks schema and semantics, which makes it inappropriate for publishing and sharing of data. This makes LPGs inflexible. LPGs are rudimentary knowledge graphs.

Modeling 53

Modeling Metadata Data Quality Enterprise 53

Peter James Thomas

JANUARY 8, 2020

White Papers can be based on themes arising from articles published here, they can feature findings from de novo research commissioned in the data arena, or they can be on a topic specifically requested by the client. Sometimes the labels of these are white [1] as well as the paper.

Consulting 61

Consulting Data-driven Publishing Data Strategy 61

Ontotext

JANUARY 10, 2024

In this way, knowledge graphs make it easy to discover, analyze, and interpret information based on its meaning, even when it’s sourced from hundreds of IT systems, as Gregor Wobbe, Head of Data Architecture of UBS, presented at KGC 2023. They sift through documents, generate metadata, and store it in the knowledge graph.

Metadata 72

Metadata Slice and Dice Data Integration Enterprise 72

Andrew White

JANUARY 9, 2022

I try to relate as much published research as I can in the time available to draft a response. – In the webinar and Leadership Vision deck for Data and Analytics we called out AI engineering as a big trend. – In the webinar and Leadership Vision deck for Data and Analytics we called out AI engineering as a big trend.

Analytics 64

Analytics Measurement Data-driven Modeling 64

AWS Big Data

APRIL 29, 2025

While enabling organization-wide efficiency, the team also applied these principles to the data architecture, making sure that CLEA itself operates frugally. After evaluating various tools, we built a serverless data transformation pipeline using Amazon Athena and dbt. However, our initial data architecture led to challenges.

Data Transformation 54

Data Transformation Cost-Benefit Testing Data Lake 54