AWS Big Data

DECEMBER 19, 2024

Organizational data is often fragmented across multiple lines of business, leading to inconsistent and sometimes duplicate datasets. This fragmentation can delay decision-making and erode trust in available data. This solution enhances governance and simplifies access to unstructured data assets across the organization.

Publishing 97

Publishing Unstructured Data Metadata Data-driven 97

erwin

OCTOBER 8, 2020

So if you’re going to move from your data from on-premise legacy data stores and warehouse systems to the cloud, you should do it right the first time. And as you make this transition, you need to understand what data you have, know where it is located, and govern it along the way. Then you must bulk load the legacy data.

Data Governance 145

Data Governance Metadata Testing Data Lake 145

DataKitchen

APRIL 28, 2021

Industry analysts who follow the data and analytics industry tell DataKitchen that they are receiving inquiries about “data fabrics” from enterprise clients on a near-daily basis. Gartner included data fabrics in their top ten trends for data and analytics in 2019. What is a Data Fabric?

Statistics 246

Statistics Optimization Data Analytics Technology 246

erwin

DECEMBER 9, 2024

When it comes to using AI and machine learning across your organization, there are many good reasons to provide your data and analytics community with an intelligent data foundation. For instance, Large Language Models (LLMs) are known to ultimately perform better when data is structured. Lets give a for instance.

Metadata 52

Metadata Data Quality Sales Modeling 52

AWS Big Data

JULY 18, 2024

Over the years, organizations have invested in creating purpose-built, cloud-based data lakes that are siloed from one another. A major challenge is enabling cross-organization discovery and access to data across these multiple data lakes, each built on different technology stacks.

Data Lake 130

Data Lake Publishing Metadata Data-driven 130

AWS Big Data

OCTOBER 4, 2023

Amazon DataZone enables customers to discover, access, share, and govern data at scale across organizational boundaries, reducing the undifferentiated heavy lifting of making data and analytics tools accessible to everyone in the organization. Govern data access across organizational boundaries.

Metadata 119

Metadata Data Lake Publishing Data Governance 119

erwin

APRIL 16, 2021

Data governance is best defined as the strategic, ongoing and collaborative processes involved in managing data’s access, availability, usability, quality and security in line with established internal policies and relevant data regulations. Data Governance Is Business Transformation. Maturity Levels.

Data Governance 128

Data Governance Metadata Cost-Benefit Data-driven 128

AWS Big Data

AUGUST 8, 2024

Today’s data lakes are expanding across lines of business operating in diverse landscapes and using various engines to process and analyze data. Traditionally, SQL views have been used to define and share filtered data sets that meet the requirements of these lines of business for easier consumption.

Data Lake 120

Data Lake Sales Marketing Big Data 120

AWS Big Data

DECEMBER 4, 2024

Open table formats are emerging in the rapidly evolving domain of big data management, fundamentally altering the landscape of data storage and analysis. By providing a standardized framework for data representation, open table formats break down data silos, enhance data quality, and accelerate analytics at scale.

Snapshot 84

Snapshot Metadata Data Lake Optimization 84

erwin

MAY 20, 2020

Data governance (DG) as a an “emergency service” may be one critical lesson learned coming out of the COVID-19 crisis. Where crisis leads to vulnerability, data governance as an emergency service enables organization management to direct or redirect efforts to ensure activities continue and risks are mitigated.

Data Governance 144

Data Governance Metadata Risk Strategy 144

Alation

NOVEMBER 4, 2021

This week I was talking to a data practitioner at a global systems integrator. The practitioner asked me to add something to a presentation for his organization: the value of data governance for things other than data compliance and data security. Now to be honest, I immediately jumped onto data quality.

Data Governance 94

Data Governance Metadata Data Quality Enterprise 94

erwin

JANUARY 9, 2020

Enterprises are trying to manage data chaos. They also face increasing regulatory pressure because of global data regulations , such as the European Union’s General Data Protection Regulation (GDPR) and the new California Consumer Privacy Act (CCPA), that went into effect last week on Jan. GDPR: Key Differences.

Data Governance 144

Data Governance Modeling Metadata Unstructured Data 144

DataKitchen

FEBRUARY 2, 2023

We’ve read many predictions for 2023 in the data field: they cover excellent topics like data mesh, observability, governance, lakehouses, LLMs, etc. What will the world of data tools be like at the end of 2025? Central IT Data Teams focus on standards, compliance, and cost reduction. Recession: the party is over.

Metadata 130

Metadata Testing Data Science Risk 130

erwin

DECEMBER 6, 2019

In the data-driven era, CIO’s need a solid understanding of data governance 2.0 … Data governance (DG) is no longer about just compliance or relegated to the confines of IT. Today, data governance needs to be a ubiquitous part of your organization’s culture. Collaborative Data Governance.

Data Governance 145

Data Governance Metadata Enterprise Data-driven 145

Alation

JANUARY 20, 2022

Several weeks ago (prior to the Omicron wave), I got to attend my first conference in roughly two years: Dataversity’s Data Quality and Information Quality Conference. Ryan Doupe, Chief Data Officer of American Fidelity, held a thought-provoking session that resonated with me. But what about governance rules that enforce quality?

Data Quality 94

Data Quality Data Governance Metrics Statistics 94

Alation

JUNE 14, 2021

The Role of Catalog in Data Security. Recently, I dug in with CIOs on the topic of data security. Recently, I dug in with CIOs on the topic of data security. What came as no surprise was the importance CIOs place on taking a broader approach to data protection. The Role of the CISO in Data Governance and Security.

Data Governance 97

Data Governance Recreation/Entertainment Data Lake Metadata 97

erwin

JULY 22, 2020

Fostering organizational support for a data-driven culture might require a change in the organization’s culture. Recently, I co-hosted a webinar with our client E.ON , a global energy company that reinvented how it conducts business from branding to customer engagement – with data as the conduit. As an example, E.ON Avoiding Hurdles.

Data-driven 136

Data-driven Data Governance Digital Transformation Data Processing 136

AWS Big Data

JULY 25, 2024

This blog post is co-written with Raj Samineni from ATPCO. In today’s data-driven world, companies across industries recognize the immense value of data in making decisions, driving innovation, and building new products to serve their customers.

Data Lake 116

Data Lake Metadata Sales Publishing 116

AWS Big Data

MAY 29, 2024

To enable them to use the AWS services, their identities from the external IdP are mapped to AWS Identity and Access Management (IAM) roles within AWS, and access policies are applied to these IAM roles by data administrators. Given the diverse range of services involved, different IAM roles may be required for accessing the data.

Data Lake 115

Data Lake Enterprise Management Business Intelligence 115

AWS Big Data

OCTOBER 9, 2023

Data lakes have been gaining popularity for storing vast amounts of data from diverse sources in a scalable and cost-effective way. As the number of data consumers grows, data lake administrators often need to implement fine-grained access controls for different user profiles.

Data Lake 131

Data Lake Testing Big Data Management 131

AWS Big Data

JULY 29, 2024

In the era of big data, data lakes have emerged as a cornerstone for storing vast amounts of raw data in its native format. They support structured, semi-structured, and unstructured data, offering a flexible and scalable environment for data ingestion from multiple sources.

Metadata 126

Metadata Snapshot Data Lake Metrics 126

Alation

JULY 26, 2021

How do you initiate change within a system containing many thousands of people and millions of bytes of data? During my time as a data specialist at American Family Insurance, it became clear that we had to move away from the way things had been done in the past. So you can probably imagine: The company manages a lot of data.

Insurance 98

Insurance Digital Transformation Enterprise Data Governance 98

Alation

JUNE 17, 2021

We’re so proud to join this growing community of leaders in data, where we plan to deliver more value to our joint customers for years to come. And we’re only just getting started! Leading companies like Cisco, Nielsen, and Finnair turn to Alation + Snowflake for data governance and analytics.

Data Governance 98

Data Governance Data Lake Insurance Enterprise 98

AWS Big Data

JUNE 26, 2024

We also delve into details on how to configure data sources and subscription targets for a project using a custom AWS service blueprint. New feature: Custom AWS service blueprints Previously, Amazon DataZone provided default blueprints that created AWS resources required for data lake, data warehouse, and machine learning use cases.

Data Lake 119

Data Lake Data Warehouse Unstructured Data Data Governance 119

erwin

MARCH 25, 2021

erwin recently hosted the second in its six-part webinar series on the practice of data governance and how to proactively deal with its complexities. Led by Frank Pörschmann of iDIGMA GmbH, an IT industry veteran and data governance strategist, the second webinar focused on “ The Value of Data Governance & How to Quantify It.”.

Data Governance 109

Data Governance Cost-Benefit IT Risk 109

O'Reilly on Data

NOVEMBER 28, 2023

AI users say that AI programming (66%) and data analysis (59%) are the most needed skills. We’re not encouraging skepticism or fear, but companies should start AI products with a clear understanding of the risks, especially those risks that are specific to AI. Developers are learning how to find quality data and build models that work.

Enterprise 339

Enterprise Modeling Testing Reporting 339

Alation

APRIL 13, 2021

Much of his work focuses on democratising data and breaking down data silos to drive better business outcomes. In this blog, Chris shows how Snowflake and Alation together accelerate data culture. He shows how Texas Mutual Insurance Company has embraced data governance to build trust in data.

Insurance 98

Insurance Data Governance Data-driven Data Quality 98

AWS Big Data

JANUARY 22, 2024

The company uses AWS Cloud services to build data-driven products and scale engineering best practices. To ensure a sustainable data platform amid growth and profitability phases, their tech teams adopted a decentralized data mesh architecture. The solution Acast implemented is a data mesh, architected on AWS.

Data-driven 118

Data-driven Advertising Metadata Data Architecture 118

DataKitchen

JUNE 7, 2021

Here’s something you likely won’t hear from any of them (except us) – you can start your DataOps journey without buying any software. When we started sharing the “ Seven Steps of DataOps ” a few years ago, our intent was (and still is) to evangelize DataOps as a free and open methodology. What can you do? Measure Your Process.

Testing 130

Testing IT Data-driven Measurement 130

IBM Big Data Hub

SEPTEMBER 12, 2022

Enterprises are dealing with a barrage of upcoming regulations concerning data privacy and data protection, not only at the state and federal level in the US, but also in a dizzying number of jurisdictions around the world. Adopting a privacy-centric approach built around a data fabric.

Metadata 91

Metadata Data Governance Enterprise Data Architecture 91

AWS Big Data

SEPTEMBER 13, 2024

In recent years, driven by the commoditization of data storage and processing solutions, the industry has seen a growing number of systematic investment management firms switch to alternative data sources to drive their investment decisions. Each team is the sole owner of its AWS account.

Interactive 109

Interactive Strategy Cost-Benefit Data Governance 109

erwin

SEPTEMBER 19, 2019

Data governance isn’t a one-off project with a defined endpoint. Data governance, today, comes back to the ability to understand critical enterprise data within a business context, track its physical existence and lineage, and maximize its value while ensuring quality and security. Passing the Data Governance Ball.

Data Governance 108

Data Governance Cost-Benefit Enterprise Modeling 108

Alation

SEPTEMBER 30, 2022

This June, Snowflake recognized Alation as its data governance partner of the year for the second year in a row, and Eckerson , IDC , BARC , Dresner , and Constellation all released reports just this summer naming Alation a data catalog leader. Everything and Everyone: The Catalog is the platform for Data Intelligence.

Measurement 92

Measurement Metrics Data Governance Sales 92

AWS Big Data

MAY 28, 2024

Apache Flink is a scalable, reliable, and efficient data processing framework that handles real-time streaming and batch workloads (but is most commonly used for real-time streaming). In this post, we introduce the features of EMR on EKS with Apache Flink, discuss their benefits, and highlight how to get started.

Data Processing 119

Data Processing Cost-Benefit Metadata Optimization 119

AWS Big Data

FEBRUARY 12, 2024

Public health organizations need access to data insights that they can quickly act upon, especially in times of health emergencies, when data needs to be updated multiple times daily. Instead, they rely on up-to-date dashboards that help them visualize data insights to make informed decisions quickly.

Publishing 111

Publishing Dashboards Metadata Visualization 111

AWS Big Data

SEPTEMBER 26, 2024

In today’s rapidly evolving digital landscape, enterprises across regulated industries face a critical challenge as they navigate their digital transformation journeys: effectively managing and governing data from legacy systems that are being phased out or replaced.

Data Governance 115

Data Governance Enterprise Management Data Lake 115

erwin

APRIL 2, 2021

Organizations are managing more data than ever. With more companies increasingly migrating their data to the cloud to ensure availability and scalability, the risks associated with data management and protection also are growing. Data Security Starts with Data Governance.

Data Governance 106

Data Governance Cost-Benefit Metadata Risk 106