O'Reilly on Data

DECEMBER 19, 2018

Data management isn’t limited to issues like provenance and lineage; one of the most important things you can do with data is collect it. Given the rate at which data is created, data collection has to be automated. How do you do that without dropping data? Toward a sustainable ML practice.

Machine Learning 279

Machine Learning Software Metadata Testing 279

erwin

JULY 17, 2019

Once you’ve determined what part(s) of your business you’ll be innovating — the next step in a digital transformation strategy is using data to get there. Constructing A Digital Transformation Strategy: Data Enablement. Many organizations prioritize data collection as part of their digital transformation strategy.

Digital Transformation 98

Digital Transformation Strategy Metadata Data-driven 98

Alation

JULY 6, 2021

Common Data Governance Challenges. Every enterprise runs into data governance challenges eventually. Issues like data visibility, quality, and security are common and complex. Data governance is often introduced as a potential solution. And one enterprise alone can generate a world of data.

Data Governance 52

Data Governance Metadata Data Quality Risk 52

Alation

DECEMBER 15, 2021

Yet high-volume collection makes keeping that foundation sound a challenge, as the amount of data collected by businesses is greater than ever before. An effective data governance strategy is critical for unlocking the full benefits of this information. Data governance requires a system.

Data Governance 52

Data Governance Strategy Metadata Data Strategy 52

erwin

APRIL 18, 2019

Data governance , thankfully, provides a framework for compliance with either or both – in addition to other regulatory mandates your organization may be subject to. CCPA Compliance Requirements vs. Publicly available personal information (federal, state and local government records). Data Governance for Regulatory Compliance.

Data Governance 81

Data Governance Metadata Data Collection Data-driven 81

Alation

FEBRUARY 17, 2023

This past week, I had the pleasure of hosting Data Governance for Dummies author Jonathan Reichental for a fireside chat , along with Denise Swanson , Data Governance lead at Alation. Can you have proper data management without establishing a formal data governance program?

Data Governance 52

Data Governance Data Quality Metadata Cost-Benefit 52

Alation

NOVEMBER 11, 2021

As IT leaders oversee migration, it’s critical they do not overlook data governance. Data governance is essential because it ensures people can access useful, high-quality data. Therefore, the question is not if a business should implement cloud data management and governance, but which framework is best for them.

Data Governance 52

Data Governance Data Quality Metrics Metadata 52

Alation

APRIL 25, 2023

That means if you haven’t already incorporated a plan for data governance into your long-term vision for your business, the time is now. Let’s take a closer look at what data governance is — and the top five mistakes to avoid when implementing it. 5 common data governance mistakes 1.

Data Governance 52

Data Governance Marketing Machine Learning Sales 52

Alation

JANUARY 26, 2023

These data requirements could be satisfied with a strong data governance strategy. Governance can — and should — be the responsibility of every data user, though how that’s achieved will depend on the role within the organization. How can data engineers address these challenges directly?

Data Governance 52

Data Governance Strategy Data Quality Data Collection 52

AWS Big Data

MARCH 26, 2024

In this post, we discuss how you can use purpose-built AWS services to create an end-to-end data strategy for C360 to unify and govern customer data that address these challenges. We recommend building your data strategy around five pillars of C360, as shown in the following figure.

Data Strategy 102

Data Strategy Strategy Data Warehouse Prescriptive Analytics 102

erwin

DECEMBER 20, 2018

The driving factors behind data governance adoption vary. Whether implemented as preventative measures (risk management and regulation) or proactive endeavors (value creation and ROI), the benefits of a data governance initiative is becoming more apparent. Defining Data Governance. to Data Governance 2.0

Data Governance 40

Data Governance ROI Risk Management Metadata 40

Alation

APRIL 25, 2023

That means if you haven’t already incorporated a plan for data governance into your long-term vision for your business, the time is now. Let’s take a closer look at what data governance is — and the top five mistakes to avoid when implementing it. 5 common data governance mistakes 1.

Data Governance 40

Data Governance Marketing Machine Learning Sales 40

Alation

AUGUST 26, 2021

What Is Data Intelligence? Data intelligence is a system to deliver trustworthy, reliable data. It includes intelligence about data, or metadata. IDC coined the term, stating, “data intelligence helps organizations answer six fundamental questions about data.” Why keep data at all?

Metadata 64

Metadata Data Governance Dashboards Software 64

IBM Big Data Hub

DECEMBER 16, 2022

At IBM, we have an AI Ethics Board that supports a centralized governance, review, and decision-making process for IBM ethics policies, practices, communications, research, products and services. AI governance technology can help implement guardrails at each stage of the AI/ML lifecycle.

Uncertainty 112

Uncertainty Metadata Modeling Data Collection 112

Alation

FEBRUARY 13, 2020

Why do we need a data catalog? What does a data catalog do? These are all good questions and a logical place to start your data cataloging journey. Data catalogs have become the standard for metadata management in the age of big data and self-service analytics. Figure 1 – Data Catalog Metadata Subjects.

Metadata 64

Metadata Data Lake Recreation/Entertainment Big Data 64

Sisense

JULY 6, 2020

First off, this involves defining workflows for every business process within the enterprise: the what, how, why, who, when, and where aspects of data. Like any complex system, your company’s EDM system is made up of a multitude of smaller subsystems, each of which has a specific role in creating the final data products.

Enterprise 98

Enterprise Management Data Architecture Data-driven 98

Alation

SEPTEMBER 1, 2022

What’s worse, those best equipped to help are too busy: 55% of respondents stated that, “the few available data experts with business domain expertise have neither the time for nor the inclination to prioritize this task.”. Get the new IDC Marketscape for Data Catalogs to learn more. What goes into a Data Intelligence Platform?

Reporting 52

Reporting Metadata Data Governance Interactive 52

AWS Big Data

JULY 24, 2024

These additional ETL jobs add latency to the end-to-end process from data collection to activation, which makes it more likely that your campaigns are activating on stale data and missing key audience members. They often provide additional information to augment the data in event tables.

Data Warehouse 125

Data Warehouse Cost-Benefit Marketing Testing 125

Alation

MARCH 17, 2021

According to the Forrester Wave: Machine Learning Data Catalogs, Q4 2020 , “Alation exploits machine learning at every opportunity to improve data management, governance, and consumption by analytic citizens. An MLDC brings many benefits, like: Enhanced data management. Data governance streamlining.

Machine Learning 52

Machine Learning Metadata Data Governance Data Quality 52

bridgei2i

MARCH 11, 2021

Easily understandable, highly curated, and reliable data helps Machine Learning (ML) tools evolve. As long as small businesses don’t have efficient data governance strategies, they can’t properly use AI and ML-powered tools. What is a Data Governance Strategy? They have access to large amounts of data.

Key Performance Indicator 52

Key Performance Indicator Data Governance Data Lake Metadata 52

Octopai

AUGUST 26, 2021

The entry features the data asset description (i.e. the stalk of barley symbol and the circular numeral signs) and the data owner (i.e. This data catalog didn’t need automation. It was perfectly reasonable for an individual to manually manage a Sumerian data collection (especially if you paid him enough barley).

Metadata 52

Metadata Cost-Benefit Data Collection Reporting 52

Ontotext

FEBRUARY 12, 2024

Determine ownership by making sure all teams involved in the data mesh own the quality of their domain data, ensure service-level agreements are met, and share that data with data contracts. Domain teams should continually monitor for data errors with data validation checks and incorporate data lineage to track usage.

Data Quality 69

Data Quality Data-driven Data Lake Data Governance 69

Cloudera

FEBRUARY 16, 2022

We can think of model lineage as the specific combination of data and transformations on that data that create a model. This maps to the data collection, data engineering, model tuning and model training stages of the data science lifecycle. So, we have workspaces, projects and sessions in that order.

Machine Learning 85

Machine Learning Modeling Metadata Recreation/Entertainment 85

Ontotext

NOVEMBER 16, 2023

Data mesh solves this by promoting data autonomy, allowing users to make decisions about domains without a centralized gatekeeper. It also improves development velocity with better data governance and access with improved data quality aligned with business needs. What Is a Data Product and Who Owns Them?

Metadata 52

Metadata Data-driven Data Quality Data Architecture 52

Alation

FEBRUARY 20, 2020

With an on-premise deployment, enterprises have full control over data security, data access, and data governance. earthquake, flood, or fire), where the data collected does not need to be as tightly controlled. The Alation Data Catalog will automatically crawl and catalog metadata in your S3 bucket(s).

Data Lake 52

Data Lake ROI Metadata Cost-Benefit 52

Alation

JUNE 16, 2021

Alation … [offers a] dedicated data catalog… while others include this functionality as a part of a broader (e.g., Wisdom of Crowds® research is based on data collected on usage and deployment trends, products, and vendors. Data governance is a growing focus. business intelligence) solution.

Reporting 52

Reporting Business Intelligence Data Governance Metadata 52

Alation

JULY 7, 2022

In 2013 I joined American Family Insurance as a metadata analyst. I had always been fascinated by how people find, organize, and access information, so a metadata management role after school was a natural choice. The use cases for metadata are boundless, offering opportunities for innovation in every sector.

Metadata 52

Metadata Data-driven Insurance Statistics 52

IBM Big Data Hub

AUGUST 4, 2023

Data democratization instead refers to the simplification of all processes related to data, from storage architecture to data management to data security. It also requires an organization-wide data governance approach, from adopting new types of employee training to creating new policies for data storage.

Data Architecture 59

Data Architecture Data Lake Machine Learning Data Governance 59

TDAN

APRIL 30, 2019

Data collection is getting more dispersed and voluminous every day. Enterprises create and collect information from a variety of data sources which may include websites, mobile devices, customers, vendors, and other numerous sources.

Management 69

Management Data Collection Enterprise Metadata 69

CIO Business Intelligence

MARCH 23, 2023

New rules around data sovereignty are designed to keep data out of the hands of other countries, bad actors, and those without authorized access. Data sovereignty is the right to control citizens’ data collection, ownership, and application. CLOUD Act, which could result in the U.S. based company.

Metadata 52

Metadata Data Collection Data Governance Strategy 52

CIO Business Intelligence

MARCH 29, 2022

Lowering the entry cost by re-using data and infrastructure already in place for other projects makes trying many different approaches feasible. Fortunately, learning-based projects typically use data collected for other purposes. . You have data but don’t use it. Why does valuable data so often go unused?

Cost-Benefit 52

Cost-Benefit Machine Learning Metadata Unstructured Data 52

Alation

FEBRUARY 8, 2022

Middlemen — data engineering or IT teams — can’t possibly possess all the expertise needed to serve up quality data to the growing range of data consumers who need it. As data collection has surged, and demands for data have grown in the enterprise, one single team can no longer meet the data demands of every department.

Data Governance 52

Data Governance Data-driven Metadata Enterprise 52

Peter James Thomas

AUGUST 29, 2018

I have since run and driven transformation in Reference Data, Master Data , KYC [3] , Customer Data, Data Warehousing and more recently Data Lakes and Analytics , constantly building experience and capability in the Data Governance , Quality and data services domains, both inside banks, as a consultant and as a vendor.

Data-driven 61

Data-driven Cost-Benefit Metadata Technology 61

Alation

FEBRUARY 13, 2020

Today, we’re announcing that Alation has closed a $50 million Series C funding led by Sapphire Ventures, with participation from new investor Salesforce Ventures and our existing investors Costanoa Ventures, DCVC (Data Collective), Harmony Partners and Icon Ventures.

Enterprise 52

Enterprise Data Lake Machine Learning Data-driven 52

Alation

JANUARY 17, 2023

Data would be pulled from various sources, organized into, say, a table, and loaded into a data warehouse for mass consumption. This was not only time-consuming, but the growing popularity of cloud data warehouses compelled people to rethink this process. Data governance is a key use case of the modern data stack.

Data Warehouse 52

Data Warehouse Cost-Benefit Data Science Data Transformation 52

Alation

AUGUST 2, 2022

Legacy technologies, siloed data, and manual processes make securing data and protecting privacy much more expensive and risky. After investing to develop these critical customer insights, a security breach can quickly damage trust and compromise the value of that data. Data discovery was conducted 67% times faster.

Cost-Benefit 52

Cost-Benefit Metrics Strategy Data Lake 52

Andrew White

JANUARY 9, 2022

Could you precise to which complementary research you mentioned when you talked about a data governance survey ? – Here is the one I mentioned during the webinar: The State of Data and Analytics Governance Is Worse Than You Think. – Data (and analytics) governance remains a challenge.

Analytics 64

Analytics Measurement Data-driven Modeling 64