AWS Big Data

NOVEMBER 20, 2024

We’re excited to announce a new feature in Amazon DataZone that offers enhanced metadata governance for your subscription approval process. With this update, domain owners can define and enforce metadata requirements for data consumers when they request access to data assets.

Metadata 95

Metadata Data Governance Metrics Marketing 95

erwin

SEPTEMBER 3, 2020

Why should you integrate data governance (DG) and enterprise architecture (EA)? Data governance provides time-sensitive, current-state architecture information with a high level of quality. Data governance provides time-sensitive, current-state architecture information with a high level of quality.

Data Governance 144

Data Governance Enterprise Risk Data Lake 144

CIO Business Intelligence

SEPTEMBER 19, 2024

It will do this, it said, with bidirectional integration between its platform and Salesforce’s to seamlessly delivers data governance and end-to-end lineage within Salesforce Data Cloud. Additional to that, we are also allowing the metadata inside of Alation to be read into these agents.”

Data Governance 123

Data Governance Metadata Unstructured Data Structured Data 123

CIO Business Intelligence

MARCH 24, 2023

Data governance definition Data governance is a system for defining who within an organization has authority and control over data assets and how those data assets may be used. It encompasses the people, processes, and technologies required to manage and protect data assets.

Data Governance 142

Data Governance Management Metadata Data Quality 142

erwin

OCTOBER 29, 2020

Automating data governance is key to addressing the exponentially growing volume and variety of data. Data readiness is everything. Data readiness depends on automation to create the data pipeline. We asked participants to “talk to us about data value chain bottlenecks.”

Data Governance 105

Data Governance Metadata Digital Transformation ROI 105

erwin

MARCH 4, 2021

Modern data governance is a strategic, ongoing and collaborative practice that enables organizations to discover and track their data, understand what it means within a business context, and maximize its security, quality and value. The What: Data Governance Defined. Data governance has no standard definition.

Data Governance 122

Data Governance Digital Transformation Data-driven Cost-Benefit 122

O'Reilly on Data

MARCH 18, 2020

Whether it’s controlling for common risk factors—bias in model development, missing or poorly conditioned data, the tendency of models to degrade in production—or instantiating formal processes to promote data governance, adopters will have their work cut out for them as they work to establish reliable AI production lines.

Enterprise 350

Enterprise Deep Learning Data Governance Risk 350

erwin

JULY 12, 2019

In light of recent, high-profile data breaches, it’s past-time we re-examined strategic data governance and its role in managing regulatory requirements. for alleged violations of the European Union’s General Data Protection Regulation (GDPR). Five Steps to GDPR/CCPA Compliance. How erwin Can Help.

Data Governance 110

Data Governance Management Metadata Risk Management 110

AWS Big Data

DECEMBER 19, 2024

HEMA built its first ecommerce system on AWS in 2018 and 5 years later, its developers have the freedom to innovate and build software fast with their choice of tools in the AWS Cloud. These services are individual software functionalities that fulfill a specific purpose within the company.

Data Governance 52

Data Governance Publishing Data-driven Metadata 52

AWS Big Data

FEBRUARY 29, 2024

Data is your generative AI differentiator, and a successful generative AI implementation depends on a robust data strategy incorporating a comprehensive data governance approach. Data governance is a critical building block across all these approaches, and we see two emerging areas of focus.

Data Governance 122

Data Governance Unstructured Data Metadata Data Lake 122

CIO Business Intelligence

APRIL 29, 2022

This first article emphasizes data as the ‘foundation-stone’ of AI-based initiatives. Establishing a Data Foundation. The shift away from ‘Software 1.0’ where applications have been based on hard-coded rules has begun and the ‘Software 2.0’ era is upon us. Addressing the Challenge.

Data Governance 145

Data Governance IT Data Lake Risk 145

Octopai

DECEMBER 12, 2021

What enables you to use all those gigabytes and terabytes of data you’ve collected? Metadata is the pertinent, practical details about data assets: what they are, what to use them for, what to use them with. Without metadata, data is just a heap of numbers and letters collecting dust. Where does metadata come from?

Metadata 98

Metadata Management Data Quality Data Governance 98

erwin

NOVEMBER 6, 2020

Prashant Parikh, erwin’s Senior Vice President of Software Engineering, talks about erwin’s vision to automate every aspect of the data governance journey to increase speed to insights. Although AI and ML are massive fields with tremendous value, erwin’s approach to data governance automation is much broader.

Data Governance 97

Data Governance Metadata Data-driven Visualization 97

erwin

OCTOBER 24, 2019

Untapped data, if mined, represents tremendous potential for your organization. While there has been a lot of talk about big data over the years, the real hero in unlocking the value of enterprise data is metadata , or the data about the data. Metadata Is the Heart of Data Intelligence.

Metadata 104

Metadata Management Data-driven Data Architecture 104

AWS Big Data

AUGUST 13, 2024

Amazon DataZone has announced a set of new data governance capabilities—domain units and authorization policies—that enable you to create business unit-level or team-level organization and manage policies according to your business needs. Data domains form a foundational pillar in data governance frameworks.

Data Governance 117

Data Governance Metadata Enterprise Sales 117

erwin

MAY 13, 2020

The role of data modeling (DM) has expanded to support enterprise data management, including data governance and intelligence efforts. After all, you can’t manage or govern what you can’t see, much less use it to make smart decisions. Types of Data Models: Conceptual, Logical and Physical.

Data Governance 93

Data Governance Enterprise Modeling Management 93

O'Reilly on Data

JANUARY 8, 2019

Cloud platforms will continue to draw companies that need to invest in data infrastructure: not only do the cloud platforms have improving foundational technologies and managed services, but increasingly software vendors and popular open source data projects are making sure their offerings are easy to run in the cloud.

Machine Learning 272

Machine Learning IoT Internet of Things Data Science 272

O'Reilly on Data

DECEMBER 19, 2018

In a previous post , we talked about applications of machine learning (ML) to software development, which included a tour through sample tools in data science and for managing data infrastructure. Humans are still needed to write software, but that software is of a different type. Developers of Software 1.0

Machine Learning 279

Machine Learning Software Metadata Testing 279

O'Reilly on Data

APRIL 2, 2019

So, why is this new open source project resonating with data scientists and machine learning engineers? Recall the following key attributes of a machine learning project: Unlike traditional software where the goal is to meet a functional specification , in ML the goal is to optimize a metric. Model governance.

Machine Learning 271

Machine Learning Modeling Data Science Software 271

O'Reilly on Data

MAY 21, 2019

Developers will find themselves increasingly building software that has ML elements. Thus, many developers will need to curate data, train models, and analyze the results of models. With that said, we are still in a highly empirical era for ML: we need big data, big models, and big compute. Marquez (WeWork) and Databook (Uber).

Machine Learning 279

Machine Learning Technology Deep Learning Data Science 279

AWS Big Data

OCTOBER 21, 2024

For producers seeking collaboration with partners, AWS Clean Rooms facilitates secure collaboration and analysis of collective datasets without the need to share or duplicate underlying data. Business analysts enhance the data with business metadata/glossaries and publish the same as data assets or data products.

Sales 113

Sales Data-driven Data Processing Key Performance Indicator 113

Cloudera

AUGUST 4, 2021

And if data security tops IT concerns, data governance should be their second priority. Not only is it critical to protect data, but data governance is also the foundation for data-driven businesses and maximizing value from data analytics. But it’s still not easy. But it’s still not easy.

Data Governance 86

Data Governance Metadata Data-driven Enterprise 86

David Menninger's Analyst Perspectives

MAY 8, 2025

DataOps was initially seen as antithetical to traditional data management approaches, which typically included batch-based and manual tools and practices. The term was embraced by emerging software providers as a means of differentiating from established data management providers. This is no longer the case, however.

Data Quality 130

Data Quality Data Governance Data Integration Software 130

CIO Business Intelligence

NOVEMBER 27, 2024

Good data governance has always involved dealing with errors and inconsistencies in datasets, as well as indexing and classifying that structured data by removing duplicates, correcting typos, standardizing and validating the format and type of data, and augmenting incomplete information or detecting unusual and impossible variations in the data.

Enterprise 141

Enterprise Data Quality Structured Data Modeling 141

erwin

JANUARY 31, 2019

And even organizations that are currently compliant can’t afford to let their data governance standards slip. Data Governance for GDPR. Google’s record GDPR fine makes the rationale for better data governance clear enough. So arguably, the “tertiary” benefits of data governance should take center stage.

Data Governance 72

Data Governance Metadata Cost-Benefit Enterprise 72

erwin

OCTOBER 4, 2021

Metadata management is essential to becoming a data-driven organization and reaping the competitive advantage your organization’s data offers. Gartner refers to metadata as data that is used to enhance the usability, comprehension, utility or functionality of any other data point. How the data has changed.

Metadata 52

Metadata Software Management Visualization 52

DataKitchen

FEBRUARY 2, 2023

A combined, interoperable suite of tools for data team productivity, governance, and security for large and small data teams. ’ They are data enabling vs. value delivery. Their software purchase behavior will align with enabling standards for line-of-business data teams who use various tools that act on data.

Metadata 130

Metadata Testing Data Science Risk 130

David Menninger's Analyst Perspectives

OCTOBER 8, 2024

As I recently noted , the term “data intelligence” has been used by multiple providers across analytics and data for several years and is becoming more widespread as software providers respond to the need to provide enterprises with a holistic view of data production and consumption.

Data Quality 130

Data Quality Data Governance Enterprise Visualization 130

AWS Big Data

OCTOBER 30, 2024

After connecting, you can query, visualize, and share data—governed by Amazon DataZone—within the tools you already know and trust. Publish data assets – As the data producer from the retail team, you must ingest individual data assets into Amazon DataZone. Eric Fleishman is a software engineer at AWS in Seattle.

Visualization 117

Visualization Data Lake Testing Data Governance 117

Octopai

JUNE 24, 2019

There are a number of scenarios that necessitate data governance tools. Businesses operating within strict industry regulations, utilizing analytics software, and/or regularly consolidating data in key subject areas will find themselves looking into data governance tools to help them achieve their goals.

Data Governance 58

Data Governance Metadata Unstructured Data Software 58

erwin

JANUARY 23, 2025

From increasing the strategic use of high-value data across organizations to advancing data and governance efforts to an AI-ready state, expectations are high for the contributions of data professionals in the year ahead. Thankfully, technology can help.

Metadata 52

Metadata Data Quality Data Governance Software 52

Octopai

OCTOBER 5, 2021

Your CFO finally gave the okay to purchase data catalog software. How will you choose the best data catalog software for your company? Does it support automatic harvesting from your other data/BI software? Check the presence, quality and depth of the data catalog’s data lineage capabilities.

Business Intelligence 98

Business Intelligence Software Cost-Benefit Metadata 98

Timo Elliott

JANUARY 6, 2022

If storage costs are escalating in a particular area, you may have found a good source of dark data. Analyze your metadata. If you’ve been properly managing your metadata as part of a broader data governance policy, you can use metadata management explorers to reveal silos of dark data in your landscape.

IT 135

IT Metadata Data-driven Data Governance 135

erwin

JULY 2, 2020

As he put it, “We are describing our business process and we are trying to describe our data catalog. His team also is using the software to manage roadmaps in their main transformation programs. He added, “We have also linked it to our documentation repository, so we have a description of our data documents.” For Rick D.,

Enterprise 122

Enterprise Modeling Metadata Data Governance 122

DataKitchen

JANUARY 5, 2021

Execution of this mission requires the contribution of several groups: data center/IT, data engineering, data science, data visualization, and data governance. Each of the roles mentioned above views the world through a preferred set of tools: Data Center/IT – Servers, storage, software.

Testing 147

Testing Data Governance Metadata Visualization 147

David Menninger's Analyst Perspectives

OCTOBER 24, 2024

Data fabric and data mesh are also both related to logical data management, which is the approach of providing virtualized access to data across an enterprise without the requirement to first extract and load it into a central repository.

Management 130

Management Data-driven Data Governance Data Lake 130

datapine

SEPTEMBER 29, 2022

He/she assists the organization by providing clarity and insight into advanced data technology solutions. As quality issues are often highlighted with the use of dashboard software , the change manager plays an important role in the visualization of data quality. 2 – Data profiling. How Do You Measure Data Quality?

Data Quality 241

Data Quality Metrics Data-driven Management 241