David Menninger's Analyst Perspectives

MARCH 30, 2020

I was recently asked to identify key modern data architecture trends. Data architectures have changed significantly to accommodate larger volumes of data as well as new types of data such as streaming and unstructured data. Here are some of the trends I see continuing to impact data architectures.

Data Architecture 292

Data Architecture Unstructured Data Data Lake Data Governance 292

CIO Business Intelligence

JULY 23, 2023

More than 60% of corporate data is unstructured, according to AIIM , and a significant amount of this unstructured data is in the form of non-traditional “records,” like text and social media messages, audio files, video, and images. Data Management

Data Governance 98

Data Governance Unstructured Data Cost-Benefit Machine Learning 98

O'Reilly on Data

FEBRUARY 11, 2020

They have too many different data sources and too much inconsistent data. They don’t have the resources they need to clean up data quality problems. The building blocks of data governance are often lacking within organizations. Nearly one-quarter of respondents work as data scientists or analysts (see Figure 1).

Data Quality 361

Data Quality Metadata Data Governance Publishing 361

CIO Business Intelligence

JANUARY 24, 2024

“Similar to disaster recovery, business continuity, and information security, data strategy needs to be well thought out and defined to inform the rest, while providing a foundation from which to build a strong business.” Overlooking these data resources is a big mistake. What are the goals for leveraging unstructured data?”

Data Strategy 136

Data Strategy Strategy Unstructured Data Data Governance 136

DataKitchen

APRIL 13, 2021

We have also included vendors for the specific use cases of ModelOps, MLOps, DataGovOps and DataSecOps which apply DataOps principles to machine learning, AI, data governance, and data security operations. . DVC — Open-source Version Control System for Machine Learning Projects … data version control. Process Analytics.

Testing 312

Testing Machine Learning Consulting Data Quality 312

Octopai

JUNE 24, 2019

There are a number of scenarios that necessitate data governance tools. Businesses operating within strict industry regulations, utilizing analytics software, and/or regularly consolidating data in key subject areas will find themselves looking into data governance tools to help them achieve their goals.

Data Governance 58

Data Governance Metadata Unstructured Data Software 58

CIO Business Intelligence

DECEMBER 19, 2023

Improving search capabilities and addressing unstructured data processing challenges are key gaps for CIOs who want to deliver generative AI capabilities. But 99% also report technical challenges, listing integration (68%), data volume and cleansing (59%), and managing unstructured data (55% ) as the top three.

Digital Transformation 143

Digital Transformation Unstructured Data Machine Learning Risk Management 143

erwin

JANUARY 17, 2020

In the modern context, data modeling is a function of data governance. While data modeling has always been the best way to understand complex data sources and automate design standards, modern data modeling goes well beyond these domains to accelerate and ensure the overall success of data governance in any organization.

Data-driven 138

Data-driven Modeling Metadata Data Governance 138

CIO Business Intelligence

NOVEMBER 21, 2022

In our most recent Rocket survey, 46% of IT professionals indicate that at least half of their content is “dark data”— meaning it’s processed but never used. A big reason for the proliferation of dark data is the amount of unstructured data within business operations.

Software 98

Software Management Unstructured Data Data Governance 98

CIO Business Intelligence

OCTOBER 2, 2024

But the most advanced data and analytics platforms should be able to: a) ingest risk assessment data from a multitude of sources; b) allow analytics teams in and outside an organization to permissibly collaborate on aggregate insights without accessing raw data; and c) provide a robust data governance structure to ensure compliance and auditability.

Analytics 115

Analytics Unstructured Data Interactive Data Governance 115

CIO Business Intelligence

MARCH 6, 2024

SAP announced today a host of new AI copilot and AI governance features for SAP Datasphere and SAP Analytics Cloud (SAC). The company is expanding its partnership with Collibra to integrate Collibra’s AI Governance platform with SAP data assets to facilitate data governance for non-SAP data assets in customer environments. “We

Unstructured Data 129

Unstructured Data Dashboards Business Intelligence Data Governance 129

CIO Business Intelligence

JUNE 19, 2023

Achieving this requires a comprehensive upgrade across five dimensions of data intelligence — data architecture, data governance, data consumption, data security, and data talent. Mr. Cao noted the specific problem of unstructured data. “A Huawei’s new Data Intelligence Solution 3.0

Finance 98

Finance Unstructured Data Data Processing Data Architecture 98

CIO Business Intelligence

JUNE 15, 2023

Achieving this requires a comprehensive upgrade across five dimensions of data intelligence — data architecture, data governance, data consumption, data security, and data talent. Mr. Cao noted the specific problem of unstructured data. “A Huawei’s new Data Intelligence Solution 3.0

Unstructured Data 98

Unstructured Data Finance Data Processing Data Architecture 98

CIO Business Intelligence

AUGUST 9, 2024

According to Pruitt, one major benefit of partnering with a cloud-agnostic data giant such as Databricks and developing a sophisticated data governance strategy is “just being able to have a single source of truth.”

Data Transformation 126

Data Transformation Machine Learning Data Lake Dashboards 126

Alation

SEPTEMBER 9, 2021

Internal and external auditors work with many different systems to ensure this data is protected accordingly. This is where data governance comes in: A robust program allows banks and financial institutions to use this data to build customer trust and still meet compliance mandates. What is Data Governance in Banking?

Data Governance 52

Data Governance Data Strategy Strategy Risk 52

Cloudera

OCTOBER 26, 2020

Not a day goes by without virtual conversations, creating masses of unstructured data. To be able to capitalize on this data storm, organizations must find a better balance between the security and usability related to data access. Getting to value means delivering it to those who can make sense of it: the end-users.

IT 119

IT Unstructured Data Data-driven Data Governance 119

CIO Business Intelligence

FEBRUARY 16, 2023

The Basel, Switzerland-based company, which operates in more than 100 countries, has petabytes of data, including highly structured customer data, data about treatments and lab requests, operational data, and a massive, growing volume of unstructured data, particularly imaging data.

Unstructured Data 105

Unstructured Data Data Lake Prescriptive Analytics Data Warehouse 105

Cloudera

MAY 14, 2024

This form of hybrid also goes a level deeper than one may find in a standard hybrid cloud, accounting for the entirety of the data lifecycle, whether that’s the point of ingestion, warehousing, or machine learning—even when that end-to-end data lifecycle is split between entirely different environments. Data comes in many forms.

Data Architecture 99

Data Architecture Data Governance Unstructured Data Structured Data 99

CIO Business Intelligence

SEPTEMBER 12, 2024

It’s critical to take a unified approach that covers both structured and unstructured data. Based on what we see with our customers, only about 20% of the data you require for any use case is typically visible, while another 20% is what we call ROT: redundant, obsolete or trivial.

Unstructured Data 111

Unstructured Data Data Quality Enterprise Data Governance 111

CIO Business Intelligence

AUGUST 9, 2023

Unstructured data needs for generative AI Generative AI architecture and storage solutions are a textbook case of “what got you here won’t get you there.” To better understand the scale of data changes, the graphic below shows the relative magnitude of generative AI data management needs, impacting both compute and storage needs.

Unstructured Data 98

Unstructured Data Modeling Data Architecture Enterprise 98

CIO Business Intelligence

JANUARY 22, 2024

Payers and providers will need to create a data foundation that addresses elements such as bringing in the right data, how to classify it, and how to create a data lineage so data sources can be tracked to address potential AI hallucinations. The need for generative AI data management may seem daunting.

Unstructured Data 98

Unstructured Data Digital Transformation Data Strategy Modeling 98

CIO Business Intelligence

SEPTEMBER 11, 2024

A 2024 survey by Monte Carlo and Wakefield Research found that 100% of data leaders feel pressured to move forward with AI implementations even though two out of three doubt their data is AI-ready. Those organizations are sailing into the AI storm without a proper compass – a solid enterprise-wide data governance strategy.

Data Quality 118

Data Quality Unstructured Data Metadata Data Governance 118

CIO Business Intelligence

APRIL 19, 2023

Using technologies that support a hybrid environment makes it easier to modernize with less disruption, improving workloads, keeping data accessible and ultimately driving greater revenue. Enterprises store a vast amount of data. The less visibility and awareness IT has over data, the greater the chance that it will be exposed.

Digital Transformation 98

Digital Transformation Data Governance Unstructured Data Risk 98

CIO Business Intelligence

JULY 22, 2024

When you’re taking the whole of Dow’s 127 years of knowledge in the form of structured and unstructured data and putting it in a place that’s supposed to make it easier to access and find, that can be scary,” Schroeder says. There are data privacy laws, and security regulations and controls that have to be put in place.

Data Governance 119

Data Governance Unstructured Data Technology Manufacturing 119

erwin

JUNE 26, 2020

It’s no surprise that most organizations’ data is often fragmented and siloed across numerous sources (e.g., legacy systems, data warehouses, flat files stored on individual desktops and laptops, and modern, cloud-based repositories.). This also diminishes the value of data as an asset.

Metadata 132

Metadata Cost-Benefit Measurement Data-driven 132

Alation

APRIL 6, 2023

Data governance is traditionally applied to structured data assets that are most often found in databases and information systems. Alation blog from Jason Lim – [link] Subscribe to Alation's Blog Get the latest data cataloging news and trends in your inbox.

Data Governance 52

Data Governance Metadata Cost-Benefit Structured Data 52

Cloudera

JANUARY 28, 2022

Then there are the more extensive discussions – scrutiny of the overarching, data strategy questions related to privacy, security, data governance /access and regulatory oversight. These are not straightforward decisions, especially when data breaches always hit the top of the news headlines.

Slice and Dice 115

Slice and Dice Cost-Benefit Data Governance Risk 115

CIO Business Intelligence

OCTOBER 13, 2023

Application data architect: The application data architect designs and implements data models for specific software applications. Information/data governance architect: These individuals establish and enforce data governance policies and procedures.

Data Architecture 132

Data Architecture Data Warehouse Statistics Visualization 132

Cloudera

OCTOBER 5, 2023

Your organization is not alone — many organizations struggle to move towards data as the cornerstone of their organization. Here are five challenges that you need to overcome to become a data leader: Bad data governance Your insights are only as good as your data.

Data-driven 84

Data-driven Enterprise Data Governance Unstructured Data 84

AWS Big Data

JUNE 26, 2024

Administrators can customize Amazon DataZone to use existing AWS resources, enabling Amazon DataZone portal users to have federated access to those AWS services to catalog, share, and subscribe to data, thereby establishing data governance across the platform.

Data Lake 118

Data Lake Data Warehouse Unstructured Data Data Governance 118

AWS Big Data

FEBRUARY 26, 2025

By streamlining metadata governance, this capability helps organizations meet compliance standards, maintain audit readiness, and simplify access workflows for greater efficiency and control.

Analytics 60

Analytics Data Lake Metadata Data Warehouse 60

CIO Business Intelligence

AUGUST 15, 2024

SAP enhances Datasphere and SAC for AI-driven transformation March 6, 24: SAP adds new generative AI and data governance features to SAP Datasphere and SAP Analytics Cloud, enabling customers to incorporate non-SAP and unstructured data when creating AI-based planning models and scenarios.

Digital Transformation 122

Digital Transformation Enterprise Software Unstructured Data 122

Cloudera

DECEMBER 11, 2020

It established a data governance framework within its enterprise data lake. Powered and supported by Cloudera, this framework brings together disparate data sources, combining internal data with public data, and structured data with unstructured data.

Data Lake 98

Data Lake Cost-Benefit Unstructured Data Data Governance 98

Cloudera

FEBRUARY 15, 2024

By leveraging cutting-edge technology and an efficient framework for managing, analyzing, and securing data, financial institutions can streamline operations and enhance their ability to meet compliance requirements efficiently, while maintaining a strong focus on risk management.

Insurance 88

Insurance Data Architecture Risk Management Risk 88

Andrew White

DECEMBER 9, 2019

The outline of the call went as follows: I was taking to a central state agency who was organizing a data governance initiative (in their words) across three other state agencies. All four agencies had reported an independent but identical experience with data governance in the past. An expensive consulting engagement.

Analytics 66

Analytics Data Lake Data Governance Data Warehouse 66

AWS Big Data

JULY 29, 2024

In the era of big data, data lakes have emerged as a cornerstone for storing vast amounts of raw data in its native format. They support structured, semi-structured, and unstructured data, offering a flexible and scalable environment for data ingestion from multiple sources.

Metadata 126

Metadata Snapshot Data Lake Metrics 126

Cloudera

AUGUST 21, 2024

The root of the problem comes down to trusted data. Pockets and siloes of disparate data can accumulate across an enterprise or legacy data warehouses may not be equipped to properly manage a sea of structured and unstructured data at scale.

Snapshot 66

Snapshot Unstructured Data Data Architecture Data Warehouse 66