TDAN

DECEMBER 20, 2022

It has been eight years plus since the first edition of my book, Non-Invasive Data Governance: The Path of Least Resistance and Greatest Success, was published by long-time TDAN.com contributor, Steve Hoberman, and his publishing company Technics Publications. That seems like a long time ago.

Data Governance 91

Data Governance Publishing Data Quality IT 91

TDAN

FEBRUARY 14, 2023

In the publishing industry, there are a lot of things we can measure. However, if there is no strategy underlining how and why we collect data and who can access it, the value is lost. Ultimately, data governance is central to […] Not only that, but we can put our business at serious risk of non-compliance.

Data Governance 98

Data Governance Data Analytics Analytics Measurement 98

CIO Business Intelligence

MARCH 19, 2025

Yet, while businesses increasingly rely on data-driven decision-making, the role of chief data officers (CDOs) in sustainability remains underdeveloped and underutilized. However, embedding ESG into an enterprise data strategy doesnt have to start as a C-suite directive.

IT 59

IT Data Governance Data-driven Metrics 59

AWS Big Data

OCTOBER 29, 2024

However, the initial version of CDH supported only coarse-grained access control to entire data assets, and hence it was not possible to scope access to data asset subsets. This led to inefficiencies in data governance and access control. After filter packages have been created and published, they can be requested.

Data Lake 108

Data Lake Sales Metadata Machine Learning 108

Alation

NOVEMBER 22, 2022

What Is Data Governance In The Public Sector? Effective data governance for the public sector enables entities to ensure data quality, enhance security, protect privacy, and meet compliance requirements. With so much focus on compliance, democratizing data for self-service analytics can present a challenge.

Data Governance 52

Data Governance Metadata Data-driven Unstructured Data 52

TDAN

OCTOBER 19, 2021

I last published my Data Governance Bill of “Rights” in a TDAN.com article circa 2017. I mentioned in the earlier piece that Data Governance is all about doing the “right” thing when it comes to managing your data. It’s all in the data. That seems like a long time ago.

Data Governance 52

Data Governance Publishing Management IT 52

erwin

JANUARY 3, 2019

With this in mind, the erwin team has compiled a list of the most valuable data governance, GDPR and Big data blogs and news sources for data management and data governance best practice advice from around the web. Top 7 Data Governance, GDPR and Big Data Blogs and News Sources from Around the Web. . —

Data Governance 53

Data Governance Big Data Data-driven Data Processing 53

Alation

MARCH 14, 2023

Data gathering and use pervades almost every business function these days — and it’s widely acknowledged that businesses with a clear strategy around data are best placed to succeed in competitive, challenging markets such as defence. What is a data strategy? Why is a data strategy important?

Data Strategy 52

Data Strategy Strategy Metadata Data Quality 52

CIO Business Intelligence

SEPTEMBER 24, 2024

With generative AI requiring organizations to re-evaluate their data strategies, CDAOs and chief data officers need to step up as leaders and demonstrate business value beyond their standard data management and governance functions, Gartner advises. “To

Data Governance 115

Data Governance Risk Management Risk Data Quality 115

AWS Big Data

JULY 1, 2024

Use case overview To demonstrate these search enhancements, we set up a new Amazon DataZone domain with two projects: Marketing project – Publishes campaign-related data assets from the Marketing department. These data assets have been tagged with relevant business glossary terms corresponding to marketing.

Sales 110

Sales Data Governance Big Data Data-driven 110

AWS Big Data

JANUARY 31, 2023

Data governance is the collection of policies, processes, and systems that organizations use to ensure the quality and appropriate handling of their data throughout its lifecycle for the purpose of generating business value.

Data Lake 98

Data Lake Data Governance Data Architecture Machine Learning 98

AWS Big Data

SEPTEMBER 13, 2024

In this post, we share how we built a well-governed and scalable data engineering platform using Amazon EMR for financial features generation. At this stage, CFM data scientists can perform analytics and extract value from raw data. The interface is tailor-made for our work habits.

Interactive 107

Interactive Strategy Cost-Benefit Data Governance 107

Cloudera

MARCH 14, 2023

They are being asked to deliver not just theoretical data strategies, but to roll up their sleeves and solve for the very real problems of disparate, heterogenous, and rapidly expanding data sources that make it a challenge to meet increasing business demand for data — and do it all while managing costs and ensuring security and data governance.

Cost-Benefit 80

Cost-Benefit Data-driven Risk Data Governance 80

AWS Big Data

AUGUST 14, 2023

In the same way, overly restrictive data governance practices that either prevent data products from taking root at all, or pare them back too aggressively (deforestation), can over time create “data deserts” that drive both the producers and consumers of data within an organization to look elsewhere for their data needs.

Management 98

Management Risk Measurement Optimization 98

CIO Business Intelligence

NOVEMBER 29, 2022

Layering technology on the overall data architecture introduces more complexity. Today, data architecture challenges and integration complexity impact the speed of innovation, data quality, data security, data governance, and just about anything important around generating value from data.

Data Architecture 111

Data Architecture Data Integration IoT Data-driven 111

Octopai

APRIL 19, 2021

BI teams will have a better handle on their data’s history, its current status, and any changes it may have undergone. Without organized metadata management, the validity of a company’s data is compromised and they won’t achieve adequate compliance, data governance, or generate correct insights.

Metadata 59

Metadata Management Business Intelligence Data Governance 59

TDAN

APRIL 20, 2021

Steve Hoberman has been a long-time contributor to The Data Administration Newsletter (TDAN.com), including his The Book Look column since 2016, and his The Data Modeling Addict column years before that.

Data Governance 52

Data Governance Publishing Modeling Data Strategy 52

AWS Big Data

JULY 14, 2023

In this post, we discuss how the Amazon Finance Automation team used AWS Lake Formation and the AWS Glue Data Catalog to build a data mesh architecture that simplified data governance at scale and provided seamless data access for analytics, AI, and machine learning (ML) use cases.

Finance 98

Finance Metadata Big Data Recreation/Entertainment 98

Domino Data Lab

APRIL 3, 2019

Paco Nathan ‘s latest column dives into data governance. This month’s article features updates from one of the early data conferences of the year, Strata Data Conference – which was held just last week in San Francisco. In particular, here’s my Strata SF talk “Overview of Data Governance” presented in article form.

Machine Learning 84

Machine Learning Data Governance Metadata Data Science 84

AWS Big Data

MARCH 10, 2023

They enable transactions on top of data lakes and can simplify data storage, management, ingestion, and processing. These transactional data lakes combine features from both the data lake and the data warehouse. One important aspect to a successful data strategy for any organization is data governance.

Data Lake 122

Data Lake Sales Data Warehouse Snapshot 122

BI-Survey

MARCH 4, 2022

However, when attempting to restructure and reorganize data flows and processes and bring in new ways of working with data, particularly CDOs, CIOs and data teams often run into what feels like a brick wall. More than a third of them have planned specific initiatives for data governance and data access.

Data-driven 52

Data-driven Data Strategy Data Governance Strategy 52

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

Alation

FEBRUARY 13, 2020

Be it the stellar customer and analyst sessions at Tableau Conference in New Orleans or Forrester Data Strategy & Insights 2018 in Orlando, or the professional grade, bullet proof Alation Arena of robots at Strata Data Conference in New York or the Teradata Analytics Universe in Las Vegas, our rockstar avatar didn’t fail to impress.

Metadata 52

Metadata Machine Learning Data Governance Reporting 52

Alation

MARCH 28, 2023

With data becoming more prevalent in every industry, organisations have to determine how to not only manage it but also drive value from it. The MoD identify three key issues: firstly, that ‘Defence data operates in contractual, technical and behavioural silos’. The defence industry is no exception.

Metadata 52

Metadata Data Strategy Data Quality Strategy 52

TDAN

FEBRUARY 14, 2023

The role of the Chief Data Officer (CDO) or the Chief Data Executive continues to gain relevance and importance in today’s corporate C-Suites across all industries.

Management 59

Management Publishing Reporting Data Governance 59

IBM Big Data Hub

MARCH 26, 2024

A company cannot report on scope 3 category 7 of employee commute without employee data from HR or facilities management data, or without the technology platform and data governance to have an auditable view of that data.

Measurement 60

Measurement Metrics Strategy Reporting 60

IBM Big Data Hub

APRIL 6, 2023

This new regulation applies to any “automated employment tool;” so, any computational process derived from machine learning, statistical modeling, data analytics, or artificial intelligence, including homegrown and third-party programs.

Cost-Benefit 56

Cost-Benefit Risk Statistics Machine Learning 56

AWS Big Data

FEBRUARY 26, 2025

By streamlining metadata governance, this capability helps organizations meet compliance standards, maintain audit readiness, and simplify access workflows for greater efficiency and control. Previously, only dashboard owners could create schedules and only on the default (author published) view of the dashboard.

Analytics 61

Analytics Data Lake Metadata Data Warehouse 61

Alation

OCTOBER 27, 2022

We specialize in multiple functions, which include but are not limited to, data governance , dashboarding, data & analytics engineering, and data science. At Alation, we focus most of our time on connecting data sources and building useful data transformations to provide reporting for different teams.

Metrics 52

Metrics Dashboards Sales Reporting 52

CIO Business Intelligence

MARCH 29, 2022

This disconnect between data producers and data consumers leads to a classic type of data waste in the sense of missed opportunity or unnecessary effort and expense required to track down data. . Reducing data waste. How can you address the issues listed above in order to reduce data waste?

Cost-Benefit 52

Cost-Benefit Machine Learning Metadata Data Quality 52

AWS Big Data

NOVEMBER 13, 2024

This post dives into the technical details, highlighting the robust data governance framework that enables ease of access to quality data using Amazon DataZone. The first section of this post discusses how we aligned the technical design of the data solution with the data strategy of Volkswagen Autoeuropa.

Metadata 105

Metadata Data Quality Digital Transformation Data-driven 105

AWS Big Data

OCTOBER 31, 2024

The data mesh, built on Amazon DataZone , simplified data access, improved data quality, and established governance at scale to power analytics, reporting, AI, and machine learning (ML) use cases. After the right data for the use case was found, the IT team provided access to the data through manual configuration.

Digital Transformation 111

Digital Transformation Metadata Data Quality Manufacturing 111

AWS Big Data

APRIL 28, 2025

When the user interacts with resources within SageMaker Unified Studio, it generates IAM session credentials based on the users effective profile in the specific project context, and then users can use tools such as Amazon Athena or Amazon Redshift to query the relevant data. SageMaker Unified Studio supports Lake Formation hybrid mode.

Metadata 61

Metadata Data Lake Big Data Management 61

AWS Big Data

APRIL 29, 2025

The QuickSight step further optimizes data by selecting only necessary columns by using a column-level lineage solution and setting a dynamic date filter with a sliding window to ingest only relevant hot data into SPICE, avoiding unused data in dashboards or reports.

Data Transformation 54

Data Transformation Cost-Benefit Testing Data Lake 54