erwin

JANUARY 23, 2025

From increasing the strategic use of high-value data across organizations to advancing data and governance efforts to an AI-ready state, expectations are high for the contributions of data professionals in the year ahead. Thankfully, technology can help.

Metadata 52

Metadata Data Quality Data Governance Software 52

CIO Business Intelligence

JUNE 12, 2024

As part of this work, the foundation’s volunteers learned about the necessity of collecting reliable data to provide efficient healthcare activity. Some of the models are traditional machine learning (ML), and some, LaRovere says, are gen AI, including the new multi-modal advances. The generative AI is filling in data gaps,” she says.

Modeling 140

Modeling Testing Cost-Benefit Metadata 140

IBM Big Data Hub

DECEMBER 16, 2022

Over the last week, millions of people around the world have interacted with OpenAI’s ChatGPT, which represents a significant advance for generative artificial intelligence (AI) and the foundation models that underpin many of these use cases. We’re at an exciting inflection point for AI. The potential is vast.

Uncertainty 112

Uncertainty Metadata Modeling Data Collection 112

Rocket-Powered Data Science

JULY 19, 2023

This was not a scientific or statistically robust survey, so the results are not necessarily reliable, but they are interesting and provocative. I recently saw an informal online survey that asked users which types of data (tabular, text, images, or “other”) are being used in their organization’s analytics applications.

Data-driven 188

Data-driven Enterprise Analytics Machine Learning 188

erwin

SEPTEMBER 17, 2020

Replace manual and recurring tasks for fast, reliable data lineage and overall data governance. Data automation reduces the loss of time in collecting, processing and storing large chunks of data because it replaces manual processes (and human errors) with intelligent processes, software and artificial intelligence (AI).

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143

IBM Big Data Hub

OCTOBER 4, 2022

It is well known that Artificial Intelligence (AI) has progressed, moving past the era of experimentation. Today, AI presents an enormous opportunity to turn data into insights and actions, to amplify human capabilities, decrease risk and increase ROI by achieving break through innovations. IBM Global AI Adoption Index 2022.).

Metadata 97

Metadata Risk Management Risk Experimentation 97

Cloudera

APRIL 2, 2024

Moreover, as emerging technologies like generative AI proliferate across Federal use cases, the need for trusted data that is secure, governed and ready for AI has never been more acute. The post FedRAMP In Process Designation, A Milestone in Cybersecurity Commitment appeared first on Cloudera Blog.

Metadata 101

Metadata Measurement Management Enterprise 101

DataRobot Blog

SEPTEMBER 1, 2022

The latest McKinsey Global Survey on AI proves that AI adoption continues to grow and that the benefits remain significant. At the same time, AI remains complex and out of reach for many. Operational Efficiency with AI Inside. To prevent delays in productionalizing AI , many organizations invest in MLOps.

Metrics 145

Metrics Statistics Modeling Data Science 145

O'Reilly on Data

MARCH 20, 2019

Apply fair and private models, white-hat and forensic model debugging, and common sense to protect machine learning models from malicious actors. Like many others, I’ve known for some time that machine learning models themselves could pose security risks. Data poisoning attacks. Many other organizations, however, aren't yet so evolved.

Modeling 278

Modeling Machine Learning Predictive Modeling Consulting 278

Cloudera

APRIL 1, 2024

This recognition underscores Cloudera’s commitment to continuous customer innovation and validates our ability to foresee future data and AI trends, and our strategy in shaping the future of data management. Cloudera, a leader in big data analytics, provides a unified Data Platform for data management, AI, and analytics.

Unstructured Data 105

Unstructured Data Cost-Benefit Metadata Machine Learning 105

Cloudera

APRIL 22, 2021

Businesses are also looking to move to a scale-out storage model that provides dense storages along with reliability, scalability, and performance. Collects and aggregates metadata from components and present cluster state. Metadata in cluster is disjoint across components. APACHE OZONE DENSE DEPLOYMENT CONFIGURATION.

Data Lake 101

Data Lake Cost-Benefit Big Data Metadata 101

Cloudera

FEBRUARY 8, 2021

This is part 2 in this blog series. This blog series follows the manufacturing, operations and sales data for a connected vehicle manufacturer as the data goes through stages and transformations typically experienced in a large manufacturing company on the leading edge of current technology.

Manufacturing 118

Manufacturing Data Warehouse Sales Predictive Analytics 118

IBM Big Data Hub

OCTOBER 4, 2023

Artificial intelligence (AI) is now at the forefront of how enterprises work with data to help reinvent operations, improve customer experiences, and maintain a competitive advantage. The first step for successful AI is access to trusted, governed data to fuel and scale the AI. All of this supports the use of AI.

Data Lake 77

Data Lake Metadata Data Warehouse Cost-Benefit 77

DataRobot Blog

MARCH 16, 2023

One of the most common challenges today in the adoption of AI is that far too many projects do not complete and fail to deliver clear business outcomes. In speaking with hundreds of our customers over the past year, and analyzing projects further, we quickly realized that a new approach to AI was needed.

Experimentation 98

Experimentation Data-driven Modeling Metadata 98

Cloudera

MARCH 9, 2021

While Cloudera Data Platform (CDP) already supports the entire data lifecycle from ‘Edge to AI’, we at Cloudera are fully aware that enterprises have more systems outside of CDP. Atlas provides open metadata management and governance capabilities to build a catalog of all assets, and also classify and govern these assets.

Data Governance 97

Data Governance Metadata Enterprise Data Processing 97

IBM Big Data Hub

MAY 9, 2023

Today is a revolutionary moment for Artificial Intelligence (AI). Suddenly, everybody is talking about generative AI: sometimes with excitement, other times with anxiety. Suddenly, everybody is talking about generative AI: sometimes with excitement, other times with anxiety. AI is already driving results for business.

Data Warehouse 106

Data Warehouse Machine Learning Cost-Benefit Metadata 106

IBM Big Data Hub

APRIL 27, 2022

A data fabric utilizes continuous analytics over existing, discoverable and inferenced metadata to support the design, deployment and utilization of integrated and reusable datasets across all environments, including hybrid and multicloud platforms.” [1]. What’s a data fabric? What’s a data mesh? A data fabric and data mesh can co-exist.

Management 79

Management Metadata Data Architecture Data Lake 79

Cloudera

JULY 24, 2024

People need to get to work, go to the doctor, and get groceries, and it’s up to their local transportation department to ensure they make it to their destinations reliably. If any issues occur during the process, Cloudera Private Cloud Base now supports downgrades to allow a cluster to adopt the previous version without losing any metadata.

Metadata 79

Metadata Optimization Management IT 79

Ontotext

MARCH 13, 2024

Through Ontotext Metadata Studio (OMDS), we then apply semantic content enrichment using text analysis based on our marketing vocabularies. Where does AI fit into this? Now let’s see how we integrated knowledge graphs with AI on each of these layers. In this way, we benefit from better SEO and semantic-driven content discovery.

Marketing 72

Marketing Knowledge Discovery Metadata Data-driven 72

Cloudera

SEPTEMBER 15, 2022

It was designed as a native object store to provide extreme scale, performance, and reliability to handle multiple analytics workloads using either S3 API or the traditional Hadoop API. There are also newer AI/ML applications that need data storage, optimized for unstructured data using developer friendly paradigms like Python Boto API.

Metadata 87

Metadata Big Data Optimization Machine Learning 87

IBM Big Data Hub

OCTOBER 12, 2023

But the implementation of AI is only one piece of the puzzle. The tasks behind efficient, responsible AI lifecycle management The continuous application of AI and the ability to benefit from its ongoing use require the persistent management of a dynamic and intricate AI lifecycle—and doing so efficiently and responsibly.

Cost-Benefit 76

Cost-Benefit Metadata Data Governance Optimization 76

IBM Big Data Hub

APRIL 10, 2023

A well-designed data architecture should support business intelligence and analysis, automation, and AI—all of which can help organizations to quickly seize market opportunities, build customer value, drive major efficiencies, and respond to risks such as supply chain disruptions.

Strategy 85

Strategy Data Architecture Cost-Benefit Reporting 85

DataRobot Blog

MARCH 16, 2023

Over the last 12 years, I’ve been fortunate to explore what’s possible with AI through innovation, starting with graduate school at Cornell University, to building a company based on Eureqa algorithms, and leading a team of innovators at DataRobot. It is a time-intensive process that can slow the adoption of AI across an organization.

Data Science 98

Data Science Technology Data-driven Modeling 98

IBM Big Data Hub

JULY 6, 2022

starts at the data source, collecting data pipeline metadata across key solutions in the modern data stack like Airflow, dbt, Databricks and many more. Catching data quality problems at the source helps enable the delivery of more reliable data. Instead, Databand.ai Data observability as part of a data fabric .

Metadata 56

Metadata Data Quality Snapshot Cost-Benefit 56

IBM Big Data Hub

MAY 9, 2023

It is well known that Artificial Intelligence (AI) has progressed, moving past the era of experimentation to become business critical for many organizations. While the promise of AI isn’t guaranteed and may not come easy, adoption is no longer a choice. So what is stopping AI adoption today? It is an imperative.

Metadata 71

Metadata Risk Experimentation Dashboards 71

Cloudera

MARCH 22, 2023

Luke Roquet recently drilled into the topic of data observability with Mark Ramsey of Ramsey International (RI) to also cover the five pillars (freshness, distribution, volume, schema, and lineage) that describe the quality and reliability of data. And, crucial for a hybrid data platform, it does so across hybrid cloud.

Metrics 88

Metrics Data Governance Cost-Benefit Dashboards 88

AWS Big Data

JANUARY 8, 2024

Therefore, it is critical for organizations to embrace a low-latency, scalable, and reliable data streaming infrastructure to deliver real-time business applications and better customer experiences. In this post, we will review the common architectural patterns of two use cases: Time Series Data Analysis and Event Driven Microservices.

Analytics 134

Analytics IoT Data-driven Snapshot 134

Alation

AUGUST 26, 2021

Data intelligence is a system to deliver trustworthy, reliable data. It includes intelligence about data, or metadata. By answering key questions around the who, what, where and when of a given data asset, DI paints a picture of why folks might use it, educating on that asset’s reliability and relative value.

Metadata 64

Metadata Data Governance Dashboards Software 64

IBM Big Data Hub

APRIL 4, 2023

For years IBM has been using cutting-edge AI to improve the digital experiences found in the Masters app. We taught an AI model to analyze Masters video and produce highlight reels for every player, minutes after their round is complete. I think the AI Commentary capability in the Masters app offers some answers.

Modeling 80

Modeling Consulting Metadata Enterprise 80

Cloudera

APRIL 3, 2023

In this blog, we will share with you in detail how Cloudera integrates core compute engines including Apache Hive and Apache Impala in Cloudera Data Warehouse with Iceberg. We will publish follow up blogs for other data services. Iceberg basics Iceberg is an open table format designed for large analytic workloads.

Data Warehouse 82

Data Warehouse Snapshot Metadata Cost-Benefit 82

IBM Big Data Hub

MARCH 14, 2024

Businesses face significant hurdles when preparing data for artificial intelligence (AI) applications. Such infrastructure should not only address these issues but also scale according to the demands of AI workloads, thereby enhancing business outcomes.

Cost-Benefit 75

Cost-Benefit Metadata Optimization Management 75

IBM Big Data Hub

JANUARY 9, 2024

The emergence of generative AI prompted several prominent companies to restrict its use because of the mishandling of sensitive internal data. According to CNN, some companies imposed internal bans on generative AI tools while they seek to better understand the technology and many have also blocked the use of internal ChatGPT.

Enterprise 71

Enterprise Data Integration Data Quality Contextual Data 71

erwin

SEPTEMBER 2, 2024

Added data quality capability ready for an AI era Data quality has never been more important than as we head into this next AI-focused era. erwin Data Quality is the data quality heart of erwin Data Intelligence. You can get a firsthand view of these new erwin Data Quality capabilities within this 2 ½ minute overview video.

Data Quality 52

Data Quality Data Processing Measurement Metadata 52

AWS Big Data

JULY 20, 2023

This setup led to several issues, including scaling difficulties as the data size grew, maintaining data quality, ensuring consistent and reliable data access, high costs associated with storage and processing, and difficulties supporting streaming use cases. This post is co-written with Eliad Gat and Oded Lifshiz from Orca Security.

Data Lake 98

Data Lake Analytics Snapshot Data Quality 98

IBM Big Data Hub

APRIL 11, 2024

The global AI governance landscape is complex and rapidly evolving. The global governance landscape As of this writing, the OECD Policy Observatory lists 668 national AI governance initiatives from 69 countries, territories and the EU. Compliance with official policies through auditing tools and other measures is merely the final step.

Risk 74

Risk Consulting Data Processing Publishing 74

Alation

OCTOBER 5, 2021

Today, all companies must pursue data analytics, Machine Learning & Artificial Intelligence (ML & AI) as an integral part of any standard business plan. What is data governance and how do you measure success? Data governance is a system for answering core questions about data. But what comes after these parameters are set?

Data Governance 96

Data Governance Strategy Data Quality Metrics 96

AWS Big Data

JULY 25, 2023

This is a guest blog post co-written with Zack Rossman from Alcion. Alcion, a security-first, AI-driven backup-as-a-service (BaaS) platform, helps Microsoft 365 administrators quickly and intuitively protect data from cyber threats and accidental data loss. To use OpenSearch Serverless, the first step is to create a collection.

Cost-Benefit 97

Cost-Benefit Modeling Management Optimization 97