erwin

FEBRUARY 13, 2020

When an organization’s data governance and metadata management programs work in harmony, then everything is easier. Data governance is a complex but critical practice. There’s always more data to handle, much of it unstructured; more data sources, like IoT, more points of integration, and more regulatory compliance requirements.

Metadata 135

Metadata Data Governance Management Cost-Benefit 135

AWS Big Data

APRIL 3, 2024

Today, we are pleased to announce that Amazon DataZone is now able to present data quality information for data assets. Other organizations monitor the quality of their data through third-party solutions. Additionally, Amazon DataZone now offers APIs for importing data quality scores from external systems.

Data Quality 118

Data Quality Visualization Metadata Metrics 118

erwin

OCTOBER 24, 2019

Untapped data, if mined, represents tremendous potential for your organization. While there has been a lot of talk about big data over the years, the real hero in unlocking the value of enterprise data is metadata , or the data about the data. Metadata Is the Heart of Data Intelligence.

Metadata 104

Metadata Management Data-driven Data Architecture 104

AWS Big Data

JULY 29, 2024

It addresses many of the shortcomings of traditional data lakes by providing features such as ACID transactions, schema evolution, row-level updates and deletes, and time travel. In this blog post, we’ll discuss how the metadata layer of Apache Iceberg can be used to make data lakes more efficient.

Metadata 126

Metadata Snapshot Data Lake Metrics 126

Alation

JULY 19, 2021

What Is Metadata? Metadata is information about data. A clothing catalog or dictionary are both examples of metadata repositories. Indeed, a popular online catalog, like Amazon, offers rich metadata around products to guide shoppers: ratings, reviews, and product details are all examples of metadata.

Metadata 105

Metadata Management Data Governance Machine Learning 105

AWS Big Data

DECEMBER 4, 2024

Our customers are telling us that they are seeing their analytics and AI workloads increasingly converge around a lot of the same data, and this is changing how they are using analytics tools with their data. Introducing the next generation of SageMaker The rise of generative AI is changing how data and AI teams work together.

Data Analytics 103

Data Analytics Analytics Data Lake Data Quality 103

Octopai

DECEMBER 12, 2021

What enables you to use all those gigabytes and terabytes of data you’ve collected? Metadata is the pertinent, practical details about data assets: what they are, what to use them for, what to use them with. Without metadata, data is just a heap of numbers and letters collecting dust. Where does metadata come from?

Metadata 98

Metadata Management Data Quality Data Governance 98

erwin

DECEMBER 12, 2019

Metadata is an important part of data governance, and as a result, most nascent data governance programs are rife with project plans for assessing and documenting metadata. But in many scenarios, it seems that the underlying driver of metadata collection projects is that it’s just something you do for data governance.

Metadata 84

Metadata Data Governance Digital Transformation Data Quality 84

Octopai

JUNE 26, 2020

Why aren’t the numbers in these reports matching up? We’re dealing with data day in and day out, but if isn’t accurate then it’s all for nothing!” In a panic, he went from desk to desk asking his teammates if they had been working on the same reports that day. They deal with tens if not hundreds of reports each day….

Metadata 98

Metadata Data Governance Enterprise Reporting 98

Octopai

OCTOBER 18, 2021

First, what active metadata management isn’t : “Okay, you metadata! Now, what active metadata management is (well, kind of): “Okay, you metadata! Data assets are tools. Metadata are the details on those tools: what they are, what to use them for, what to use them with. . Quit lounging around!

Metadata 98

Metadata Management IT Data Quality 98

Alation

MAY 24, 2022

generally available on May 24, Alation introduces the Open Data Quality Initiative for the modern data stack, giving customers the freedom to choose the data quality vendor that’s best for them with the added confidence that those tools will integrate seamlessly with Alation’s Data Catalog and Data Governance application.

Data Quality 98

Data Quality Data Governance Metadata Metrics 98

AWS Big Data

JANUARY 15, 2025

In the following section, two use cases demonstrate how the data mesh is established with Amazon DataZone to better facilitate machine learning for an IoT-based digital twin and BI dashboards and reporting using Tableau. From here, the metadata is published to Amazon DataZone by using AWS Glue Data Catalog.

IoT 111

IoT Machine Learning Metadata Data-driven 111

CIO Business Intelligence

JANUARY 30, 2024

Corporate ESG reporting is getting real for companies around the globe. Enacted and proposed regulations in the EU, US, and beyond are deepening reporting requirements in an effort to change business behavior. The foundation for ESG reporting, of course, is data. The foundation for ESG reporting, of course, is data.

Reporting 115

Reporting Data Quality Strategy Data-driven 115

Octopai

MARCH 23, 2022

Data lineage tools give you exactly that kind of transparent, x-ray vision into your data quality. Data Supervision. This is why effective data management and governance requires actually appointing people to be data owners and data stewards. Everyone agrees that data quality is important.

Data Quality 98

Data Quality Reporting Modeling Interactive 98

O'Reilly on Data

DECEMBER 19, 2018

Given that the results produced by any model will reflect the data used to create the model, how do you ensure your data collection process is fair, representative, and unbiased? This isn’t surprising; if you’re collecting data from several weather stations and one of them malfunctions, you would expect to see anomalous data.

Machine Learning 279

Machine Learning Software Metadata Testing 279

Octopai

FEBRUARY 12, 2020

Like any good puzzle, metadata management comes with a lot of complex variables. That’s why you need to use data dictionary tools, which can help organize your metadata into an archive that can be navigated with ease and from which you can derive good information to power informed decision-making. Why Have a Data Dictionary? #1

Metadata 72

Metadata Enterprise Management Data Warehouse 72

erwin

JANUARY 30, 2020

The 2020 State of Data Governance and Automation (DGA) report is a follow-up to an initial survey we commissioned two years ago to explore data governance ahead of the European Union’s General Data Protection Regulation (GDPR) going into effect. 1 reason to implement data governance.

Data Governance 145

Data Governance Metadata Cost-Benefit Digital Transformation 145

erwin

APRIL 29, 2020

These tools range from enterprise service bus (ESB) products, data integration tools; extract, transform and load (ETL) tools, procedural code, application program interfaces (API)s, file transfer protocol (FTP) processes, and even business intelligence (BI) reports that further aggregate and transform data. Data Governance.

Key Performance Indicator 111

Key Performance Indicator Data Governance Metadata Data Quality 111

IBM Big Data Hub

NOVEMBER 28, 2022

Metadata management performs a critical role within the modern data management stack. It helps blur data silos, and empowers data and analytics teams to better understand the context and quality of data. This, in turn, builds trust in data and the decision-making to follow. Improve data discovery.

Metadata 56

Metadata Data Quality Data-driven Data Governance 56

erwin

JANUARY 23, 2025

Data intelligence software is continuously evolving to enable organizations to efficiently and effectively advance new data initiatives. With a variety of providers and offerings addressing data intelligence and governance needs, it can be easy to feel overwhelmed in selecting the right solution for your enterprise.

Metadata 52

Metadata Data Quality Data Governance Software 52

erwin

DECEMBER 12, 2019

Metadata is an important part of data governance, and as a result, most nascent data governance programs are rife with project plans for assessing and documenting metadata. But in many scenarios, it seems that the underlying driver of metadata collection projects is that it’s just something you do for data governance.

Metadata 52

Metadata Data Governance Digital Transformation Data Quality 52

DataKitchen

OCTOBER 11, 2021

The delays impact delivery of the reports to senior management, who are responsible for making business decisions based on the dashboard. All the code, Talend job, and the BI report are version controlled using Git. Based on business rules, additional data quality tests check the dimensional model after the ETL job completes.

Testing 152

Testing Metadata Dashboards Statistics 152

DataKitchen

SEPTEMBER 21, 2023

Bridging the Gap: How ‘Data in Place’ and ‘Data in Use’ Define Complete Data Observability In a world where 97% of data engineers report burnout and crisis mode seems to be the default setting for data teams, a Zen-like calm feels like an unattainable dream. What is Data in Use?

Testing 169

Testing Data Quality Predictive Modeling Metrics 169

CIO Business Intelligence

MARCH 24, 2023

The Business Application Research Center (BARC) warns that data governance is a highly complex, ongoing program, not a “big bang initiative,” and it runs the risk of participants losing trust and interest over time. The program must introduce and support standardization of enterprise data.

Data Governance 142

Data Governance Management Metadata Data Quality 142

IBM Big Data Hub

JULY 13, 2023

When we talk about data integrity, we’re referring to the overarching completeness, accuracy, consistency, accessibility, and security of an organization’s data. Together, these factors determine the reliability of the organization’s data. Data quality Data quality is essentially the measure of data integrity.

Data Quality 63

Data Quality Data Integration Metadata Cost-Benefit 63

Smart Data Collective

JULY 15, 2021

A data catalog serves the same purpose. By using metadata (or short descriptions), data catalogs help companies gather, organize, retrieve, and manage information. You can think of a data catalog as an enhanced Access database or library card catalog system. What Does a Data Catalog Do?

Metadata 133

Metadata IT Data-driven Data Quality 133

DataKitchen

AUGUST 3, 2021

Discoverable – users have access to a catalog or metadata management tool which renders the domain discoverable and accessible. Secure and permissioned – data is protected from unauthorized users. Governed – designed with data quality and management workflows that empower data usage.

Data Architecture 246

Data Architecture Data Lake Cost-Benefit Data Warehouse 246

Alation

DECEMBER 7, 2021

Alation and Soda are excited to announce a new partnership, which will bring powerful data-quality capabilities into the data catalog. Soda’s data observability platform empowers data teams to discover and collaboratively resolve data issues quickly. Do we have end-to-end data pipeline control?

Data Quality 52

Data Quality Metadata Data Governance Testing 52

Alation

MAY 24, 2022

In a sea of questionable data, how do you know what to trust? Data quality tells you the answer. It signals what data is trustworthy, reliable, and safe to use. It empowers engineers to oversee data pipelines that deliver trusted data to the wider organization. Today, as part of its 2022.2

Data Quality 52

Data Quality Metadata Reporting Metrics 52

Octopai

APRIL 19, 2021

Aptly named, metadata management is the process in which BI and Analytics teams manage metadata, which is the data that describes other data. In other words, data is the context and metadata is the content. Without metadata, BI teams are unable to understand the data’s full story.

Metadata 59

Metadata Management Business Intelligence Data Governance 59

IBM Big Data Hub

JANUARY 5, 2023

Poor data quality is one of the top barriers faced by organizations aspiring to be more data-driven. Ill-timed business decisions and misinformed business processes, missed revenue opportunities, failed business initiatives and complex data systems can all stem from data quality issues.

Data Architecture 52

Data Architecture Data Quality Strategy Data Lake 52

IBM Big Data Hub

JULY 28, 2022

Metadata enrichment is about scaling the onboarding of new data into a governed data landscape by taking data and applying the appropriate business terms, data classes and quality assessments so it can be discovered, governed and utilized effectively. Support for BI reporting. Public API.

Metadata 56

Metadata Machine Learning Data Quality Statistics 56

erwin

FEBRUARY 6, 2020

As organizations deal with managing ever more data, the need to automate data management becomes clear. Last week erwin issued its 2020 State of Data Governance and Automation (DGA) Report. It’s time to automate data management. How to Automate Data Management.

Management 144

Management Data Governance Cost-Benefit Metadata 144

IBM Big Data Hub

NOVEMBER 4, 2022

Data is the new oil and organizations of all stripes are tapping this resource to fuel growth. However, data quality and consistency are one of the top barriers faced by organizations in their quest to become more data-driven. Unlock quality data with IBM. Access the full report here.

Data Quality 56

Data Quality Metadata Data Governance Data-driven 56

erwin

SEPTEMBER 17, 2020

According to erwin’s “2020 State of Data Governance and Automation” report , close to 70 percent of data professional respondents say they spend an average of 10 or more hours per week on data-related activities, and most of that time is spent searching for and preparing data.

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143

Octopai

JANUARY 21, 2020

How much time has your BI team wasted on finding data and creating metadata management reports? BI groups spend more than 50% of their time and effort manually searching for metadata. In fact, BI projects used to take many months to complete and require huge numbers of IT professionals to extract data.

OLAP 81

OLAP Metadata Online Analytical Processing Data Quality 81

AWS Big Data

SEPTEMBER 11, 2024

The application supports custom workflows to allow demand and supply planning teams to collaborate, plan, source, and fulfill customer orders, then track fulfillment metrics via persona-based operational and management reports and dashboards. This metadata file is later used to read source file names during processing into the staging layer.

Data Architecture 111

Data Architecture Optimization Data Warehouse Metadata 111