AWS Big Data

JUNE 10, 2024

This amalgamation empowers vendors with authority over a diverse range of workloads by virtue of owning the data. This authority extends across realms such as business intelligence, data engineering, and machine learning thus limiting the tools and capabilities that can be used. Here is where it can get complicated.

Data Lake 126

Data Lake Metadata Snapshot Analytics 126

Jen Stirrup

MARCH 29, 2023

What does a sound, intelligent data foundation give you? It can give business-oriented data strategy for business leaders to help drive better business decisions and ROI. It can also increase productivity by enabling the business to find the data they need when the business teams need it.

Data Warehouse 121

Data Warehouse Metadata Data Integration Business Intelligence 121

AWS Big Data

FEBRUARY 26, 2025

S3 Tables integration with the AWS Glue Data Catalog is in preview, allowing you to stream, query, and visualize dataincluding Amazon S3 Metadata tablesusing AWS analytics services such as Amazon Data Firehose , Amazon Athena , Amazon Redshift, Amazon EMR, and Amazon QuickSight. With AWS Glue 5.0,

Analytics 60

Analytics Data Lake Metadata Data Warehouse 60

TDAN

SEPTEMBER 5, 2023

Data is the lifeblood of modern organizations, and as such, it must be carefully managed and protected. Whether it’s financial data, personal health information, or customer data, organizations that generate and manage data must implement a comprehensive data governance strategy.

Data Governance 52

Data Governance Business Intelligence Strategy Management 52

CIO Business Intelligence

SEPTEMBER 12, 2024

While some enterprises are already reporting AI-driven growth, the complexities of data strategy are proving a big stumbling block for many other businesses.

ROI 110

ROI Cost-Benefit Unstructured Data Metadata 110

CIO Business Intelligence

OCTOBER 13, 2023

A sampling of data architect job descriptions shows key areas of responsibility such as: creating a DataOps and BI transformation roadmap, developing and sustaining a data strategy, implementing and optimizing physical database design, and designing and implementing data migration and integration processes.

Data Architecture 132

Data Architecture Data Warehouse Statistics Visualization 132

CIO Business Intelligence

MARCH 21, 2022

Businesses typically rely on keywords to make sense of unstructured data to pull out relevant data using searchable terms. Semi-structured data falls between the two. It doesn’t conform to a data model but does have associated metadata that can be used to group it.

Unstructured Data 137

Unstructured Data Data Analytics Analytics Data Science 137

TDAN

JUNE 18, 2019

Is your organization struggling to succeed with your Data Governance program? Is adoption by the business an issue for you? Data Governance occurs best when done in conjunction with the business processes and not as a “bolt on”/additional activity.

Data Governance 56

Data Governance Metadata Data Strategy Business Intelligence 56

AWS Big Data

MARCH 10, 2023

However, as data processing at scale solutions grow, organizations need to build more and more features on top of their data lakes. They enable transactions on top of data lakes and can simplify data storage, management, ingestion, and processing. The Iceberg table is synced with the AWS Glue Data Catalog.

Data Lake 122

Data Lake Sales Data Warehouse Snapshot 122

BI-Survey

FEBRUARY 23, 2023

“Data culture eats data strategy for breakfast” has become a popular saying among data and analytics managers and executives. Even the best data strategy cannot fulfill its potential if the data culture in the company does not match it. These include tools for metadata management (e.g.,

Metadata 52

Metadata Data-driven Data Strategy Strategy 52

Octopai

JANUARY 31, 2021

The particular episode we recommend looks at how WeWork struggled with understanding their data lineage so they created a metadata repository to increase visibility. Agile Data. Another podcast we think is worth a listen is Agile Data. Techcopedia follows the latest trends in data and provides comprehensive tutorials.

Data Governance 83

Data Governance Data Processing Data Quality Metadata 83

CIO Business Intelligence

DECEMBER 16, 2022

These included metadata design and development, quantitative analysis, regression analysis, continuous integration, data analytics, data strategy, identity and access management, machine learning, natural language processing, and more.

Testing 98

Testing Metadata Data Processing Machine Learning 98

CIO Business Intelligence

JUNE 23, 2022

In our very own Enterprise Data Maturity research surveying over 3,000 IT and senior business leaders, we found that 40% of organizations are currently running hybrid but mostly on-premises, and 36% of respondents expect to shift to hybrid multi-cloud in the next 18 months. Where data flows, ideas follow.

IT 97

IT Data Architecture Unstructured Data Big Data 97

Alation

OCTOBER 21, 2021

Data lakes also support the growing thirst for analysis by data scientists and data analysts, as well as the critical role of data governance. But setting up a data lake takes a thoughtful approach to ensure it’s positioned to prevent it from becoming a data swamp. Lack of metadata.

Data Lake 52

Data Lake Metadata Data Warehouse Data Governance 52

IBM Big Data Hub

JANUARY 5, 2023

The right data architecture can help your organization improve data quality because it provides the framework that determines how data is collected, transported, stored, secured, used and shared for business intelligence and data science use cases. Practice proper data hygiene across interfaces.

Data Architecture 52

Data Architecture Data Quality Strategy Data Lake 52

AWS Big Data

APRIL 26, 2023

Having an accurate and up-to-date inventory of all technical assets helps an organization ensure it can keep track of all its resources with metadata information such as their assigned oners, last updated date, used by whom, how frequently and more. This is a guest blog post co-written with Corey Johnson from Huron.

Metadata 52

Metadata Dashboards Visualization Consulting 52

TDAN

NOVEMBER 5, 2019

There is … but one … Data Governance. Maybe you are one of those that believe that there is something called Master Data Governance, Information Governance, Metadata Governance, Big Data Governance, Customer [or insert domain name here] Data Governance, Data Governance 1.0 – 2.0 – 3.0, […].

Data Governance 69

Data Governance Metadata Big Data Data Strategy 69

Sisense

JULY 6, 2020

First off, this involves defining workflows for every business process within the enterprise: the what, how, why, who, when, and where aspects of data. Data Warehousing and BI represent the analytical core of an EDM system. Benefits of enterprise data management.

Enterprise 98

Enterprise Management Data Architecture Data-driven 98

Domino Data Lab

APRIL 3, 2019

Data governance shows up as the fourth-most-popular kind of solution that enterprise teams were adopting or evaluating during 2019. That’s a lot of priorities – especially when you group together closely related items such as data lineage and metadata management which rank nearby. Validates products for conformance.

Machine Learning 84

Machine Learning Data Governance Metadata Data Science 84

TDAN

DECEMBER 20, 2022

Over the past few months, my team in Castlebridge and I have been working with clients delivering training to business and IT teams on data management skills like data governance, data quality management, data modelling, and metadata management.

Metadata 52

Metadata Data Governance Data Quality Management 52

IBM Big Data Hub

MARCH 14, 2024

This involves unifying and sharing a single copy of data and metadata across IBM® watsonx.data ™, IBM® Db2 ®, IBM® Db2® Warehouse and IBM® Netezza ®, using native integrations and supporting open formats, all without the need for migration or recataloging. .

Cost-Benefit 75

Cost-Benefit Metadata Optimization Management 75

BI-Survey

MARCH 4, 2022

However, when attempting to restructure and reorganize data flows and processes and bring in new ways of working with data, particularly CDOs, CIOs and data teams often run into what feels like a brick wall. DATA LEADERSHIP. Formulate and communicate the data strategy clearly, explicitly and frequently.

Data-driven 52

Data-driven Data Strategy Data Governance Strategy 52

Alation

MARCH 21, 2023

When it embarked on a digital transformation and modernization initiative in 2018, the company migrated all its data to AWS S3 Data Lake and Snowflake Data Cloud to provide accessibility to data to all users. Using Alation, ARC automated the data curation and cataloging process. “So

Data Analytics 52

Data Analytics Analytics Data-driven Big Data 52

CIO Business Intelligence

MARCH 29, 2022

. • You have data but don’t use it. Why does valuable data so often go unused? Lack of annotation with the right metadata is a contributing factor. Another is poor communication between projects or business units. An even larger issue is that people may not know how to see value in data. Reducing data waste.

Cost-Benefit 52

Cost-Benefit Machine Learning Metadata Data Quality 52

TDAN

MAY 19, 2020

If your organization uses data—and even if it doesn’t—you have a data culture. Think about the ways that you and your colleagues interact with and discuss data. Is it spoken about as a driver of business and competitive edge or just the exhaust of your existing […]. Are people afraid of it? Do they trust it?

Interactive 105

Interactive IT Metadata Data Strategy 105

TDAN

JANUARY 14, 2020

Recording requirements for success is an important first step toward demonstrating the value of a Data Governance program. Practitioners know that Data Governance requires planning, resources, money and time and that several of these objects are in short supply.

Data Governance 89

Data Governance Metadata Data Strategy Business Intelligence 89

TDAN

MARCH 31, 2020

yield differing answers, making it more difficult to run the business. Executive Summary It seems obvious enough that companies, government agencies and non-profits would benefit from a common language. Without it, coordinating work is more difficult, computers “don’t talk,” and basic questions such as “how many customers do we have?”

IT 84

IT Data Architecture Metadata Data Strategy 84

TDAN

APRIL 16, 2019

The secret lies with Data Governance. The Chief Data Officer (or whoever the Data Czar is at your organization) needs to get past, and I mean way past, the “Why is Data Governance important?” or “Why do we need Data Governance?” questions if they are ever going to be successful czar-ing the data.

Data Governance 84

Data Governance Data Quality Metadata Data Strategy 84

TDAN

DECEMBER 15, 2020

Weinberg’s Second Law: If builders built buildings the way programmers wrote programs, then the first woodpecker that came along would destroy civilization.[1] 1] Introduction Opportunity While most people don’t think about it very often, common language is essential to day-in, day-out commerce.

Data Quality 83

Data Quality IT Metadata Data Strategy 83

TDAN

AUGUST 6, 2019

Deep learning, as defined by MathWorks, is a system of artificial intelligence that is built around learning by example. Multiple industries have already understood the benefits that deep learning brings to their operational capabilities.

Deep Learning 81

Deep Learning Technology Data Architecture Metadata 81

TDAN

MARCH 3, 2020

This is surely the case with the “new” products that call themselves data catalogs. But before talking about the rise of the data catalog, I will take […]. If you have been around the IT industry for as long as I have, you have seen technologies and ideas come and go—and sometimes even come back again.

Technology 78

Technology Data Quality IT Metadata 78

TDAN

APRIL 30, 2019

Roles and responsibilities are the backbone of a successful information or data governance program. To operate an efficient and effective program and hold people formally accountable for doing the “right” thing at the “right” time, it requires the definition and deployment of roles that are appropriate for the culture of the organization.

Data Governance 79

Data Governance Data Quality IT Metadata 79

TDAN

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Publishing 78

Publishing Data Quality Data Architecture IT 78

TDAN

MARCH 19, 2019

Various databases, plus one or more data warehouses, have been the state-of-the art data management infrastructure in companies for years. The emergence of various new concepts, technologies, and applications such as Hadoop, Tableau, R, Power BI, or Data Lakes indicate that changes are under way.

Management 84

Management Data Warehouse Data Lake Analytics 84

TDAN

JULY 2, 2019

The third and final part of the Non-Invasive Data Governance Framework details the breakdown of components by level, providing considerations for what must be included at the intersections. The squares are completed with nouns and verbs that provide direction for meaningful discussions about how the program will be set up and operate.

Data Governance 74

Data Governance Data Quality Data Architecture Metadata 74

TDAN

APRIL 19, 2022

Introduction We are living in the age of a data revolution, and more corporations are realizing that to lead—or in some cases, to survive—they need to harness their data wealth effectively.

Data Warehouse 72

Data Warehouse Enterprise IT Metadata 72

TDAN

SEPTEMBER 15, 2020

Remember the Sears catalog? Hundreds of pages of clothes quickly flipped past to get to the toys! Who didn’t spend countless hours trying to find the perfect suggested gift for your next birthday or holiday? In an Amazon and eBay world, thinking about old-school catalogs seems so quaint. Opening a paper volume to manually flip […].

Data Architecture 69

Data Architecture Metadata Data Governance Data Strategy 69