Alation

FEBRUARY 13, 2020

Why do we need a data catalog? What does a data catalog do? These are all good questions and a logical place to start your data cataloging journey. Data catalogs have become the standard for metadata management in the age of big data and self-service analytics. Figure 1 – Data Catalog Metadata Subjects.

Metadata 64

Metadata Data Lake Recreation/Entertainment Big Data 64

Cloudera

MARCH 23, 2022

The table information (such as schema, partition) is stored as part of the metadata (manifest) file separately, making it easier for applications to quickly integrate with the tables and the storage formats of their choice. Enterprise grade security and data governance – centralized data authorization to lineage and auditing.

Metadata 92

Metadata Data Architecture Machine Learning Cost-Benefit 92

Alation

JUNE 1, 2023

So it’s fitting that Snowflake Summit , the premier event for data cloud strategy, will occur at Caesars Forum in Las Vegas on June 26–29 (togas not required). As a 2-time Snowflake Data Governance Partner of the Year , Alation knows how important this event is to the Snowflake community. The data governance team’s solution?

Metadata 52

Metadata Data Governance Data-driven Recreation/Entertainment 52

AWS Big Data

JUNE 9, 2023

Data in customers’ data lakes is used to fulfil a multitude of use cases, from real-time fraud detection for financial services companies, inventory and real-time marketing campaigns for retailers, or flight and hotel room availability for the hospitality industry. Metadata table s eliminate slow S3 file listing operations.

Data Lake 129

Data Lake Metadata Statistics Optimization 129

Alation

NOVEMBER 8, 2021

Challenge #2: Ability to Meet Governance Requirements at Scale. Traditionally, self-service reporting analytics and data governance have been opposed. The goal of enabling more people to visualize and analyze data has interfered with the need to govern data (and prevent it from falling into the wrong hands).

Dashboards 52

Dashboards Recreation/Entertainment Metadata Data-driven 52

Cloudera

FEBRUARY 16, 2022

Weak model lineage can result in reduced model performance, a lack of confidence in model predictions and potentially violation of company, industry or legal regulations on how data is used. . Within the CML data service, model lineage is managed and tracked at a project level by the SDX. Figure 03: lineage.yaml.

Machine Learning 85

Machine Learning Modeling Metadata Recreation/Entertainment 85

AWS Big Data

APRIL 19, 2023

We took this a step further by creating a blueprint to create smart recommendations by linking similar data products using graph technology and ML. In this post, we showed how an organization can augment a data catalog with additional metadata by using ML and Neptune with an automated process.

Technology 105

Technology Data-driven Machine Learning Sales 105

Cloudera

NOVEMBER 12, 2020

Inability to maintain context – This is the worst of them all because every time a data set or workload is re-used, you must recreate its context including security, metadata, and governance. Alternatively, you can also spin up a different compute cluster and access the data by using CDP’s Shared Data Experience.

Data Warehouse 104

Data Warehouse Reporting Risk Cost-Benefit 104

Cloudera

MARCH 6, 2018

Instead, they have separate data stores and inconsistent (if any) frameworks for data governance, management, and security. If catalog metadata and business definitions live with transient compute resources, they will be lost, requiring work to recreate later and making auditing impossible.

Analytics 40

Analytics Metadata Recreation/Entertainment Big Data 40

Alation

FEBRUARY 13, 2020

That’s fitting because we and our customers see a future in which no one has to scrounge for information, guess whether a number is accurate or what it means in context, or recreate an analysis which someone else has done.

Recreation/Entertainment 52

Recreation/Entertainment Machine Learning Data-driven Consulting 52

Alation

SEPTEMBER 21, 2021

I grew up in a family that did a lot of camping in recreational vehicles. It is people, process, technology, and data — more importantly, metadata. DataOps is not DevOps for data, but ambiguity of the term is persistent. Data Intelligence Benefits.

Metadata 52

Metadata Testing Recreation/Entertainment Data-driven 52

Jet Global

DECEMBER 17, 2021

For example, the research finds that nearly half (48%) of finance organizations spend too much time on closing the books in reporting entities, and a similar percentage spend too much time on subsequent steps, such as, data collection, validation, and submission of data to the corporate center.

Reporting 52

Reporting Management Recreation/Entertainment Finance 52