O'Reilly on Data

MARCH 31, 2020

You might have millions of short videos , with user ratings and limited metadata about the creators or content. Job postings have a much shorter relevant lifetime than movies, so content-based features and metadata about the company, skills, and education requirements will be more important in this case.

Management 363

Management Machine Learning Experimentation Metrics 363

AWS Big Data

NOVEMBER 20, 2024

We’re excited to announce a new feature in Amazon DataZone that offers enhanced metadata governance for your subscription approval process. With this update, domain owners can define and enforce metadata requirements for data consumers when they request access to data assets. Key benefits The feature benefits multiple stakeholders.

Metadata 75

Metadata Data Governance Metrics Marketing 75

O'Reilly on Data

APRIL 2, 2019

Recall the following key attributes of a machine learning project: Unlike traditional software where the goal is to meet a functional specification , in ML the goal is to optimize a metric. Metadata and artifacts needed for audits: as an example, the output from the components of MLflow will be very pertinent for audits.

Machine Learning 271

Machine Learning Modeling Data Science Software 271

O'Reilly on Data

JUNE 19, 2019

In a previous post , we noted some key attributes that distinguish a machine learning project: Unlike traditional software where the goal is to meet a functional specification, in ML the goal is to optimize a metric. Metadata and artifacts needed for a full audit trail.

Modeling 257

Modeling Machine Learning Testing Metrics 257

CIO Business Intelligence

APRIL 8, 2025

As data-centric AI, automated metadata management and privacy-aware data sharing mature, the opportunity to embed data quality into the enterprises core has never been more significant. Data fabric Metadata-rich integration layer across distributed systems. Implementation complexity, relies on robust metadata management.

Data Quality 102

Data Quality Data-driven Key Performance Indicator Metadata 102

AWS Big Data

OCTOBER 11, 2023

Near-real-time streaming analytics captures the value of operational data and metrics to provide new insights to create business opportunities. These metrics help agents improve their call handle time and also reallocate agents across organizations to handle pending calls in the queue.

Management 117

Management Metadata Analytics Dashboards 117

DataKitchen

OCTOBER 11, 2021

The data engineer then emails the BI Team, who refreshes a Tableau dashboard. The delays impact delivery of the reports to senior management, who are responsible for making business decisions based on the dashboard. Imagine receiving a call from your CEO because sales on the CEO dashboard were off by a million dollars.

Testing 152

Testing Metadata Dashboards Statistics 152

Octopai

APRIL 8, 2019

Metadata is at the heart of every report, dashboard, data warehouse, visualization, and anything else the BI team produces. Without an understanding of the organization’s metadata, the BI team can’t match the data from multiple sources to produce a single view of the business. Money Loser #1: Manual Data Discovery.

Metadata 65

Metadata Dashboards Data Warehouse Visualization 65

AWS Big Data

JANUARY 16, 2024

Within Airflow, the metadata database is a core component storing configuration variables, roles, permissions, and DAG run histories. A healthy metadata database is therefore critical for your Airflow environment. AWS publishes our most up-to-the-minute information on service availability on the Service Health Dashboard.

Strategy 109

Strategy Metadata Metrics Dashboards 109

AWS Big Data

SEPTEMBER 7, 2023

We will partition and format the server access logs with Amazon Web Services (AWS) Glue , a serverless data integration service, to generate a catalog for access logs and create dashboards for insights. Using Amazon Athena and Amazon QuickSight, we query and create dashboards for insights. Save and run the job.

Metadata 111

Metadata Dashboards Metrics Visualization 111

AWS Big Data

APRIL 16, 2024

Running Apache Airflow at scale puts proportionally greater load on the Airflow metadata database, sometimes leading to CPU and memory issues on the underlying Amazon Relational Database Service (Amazon RDS) cluster. A resource-starved metadata database may lead to dropped connections from your workers, failing tasks prematurely.

Metadata 110

Metadata Metrics Testing Management 110

DataRobot Blog

SEPTEMBER 1, 2022

Imagine yourself as a pilot operating aircraft through a thunderstorm; you have all the dashboards and automated systems that inform you about any risks. This also shows how the models compare on standard performance metrics and informative visualizations like Dual Lift. Model Observability with Custom Metrics.

Metrics 145

Metrics Statistics Modeling Data Science 145

CIO Business Intelligence

SEPTEMBER 11, 2024

Emission factor mapping and other capabilities As part of Oracle Fusion Cloud Sustainability, enterprises would get access to features such as automated transaction records, contextualized data, pre-built dashboards, emission factor mapping, and audit capabilities.

Contextual Data 116

Contextual Data Key Performance Indicator Dashboards Data-driven 116

DataKitchen

SEPTEMBER 21, 2023

Moreover, advanced metrics like Percentage Regional Sales Growth can provide nuanced insights into business performance. Problems can manifest in various ways, such as Model Prediction Errors in machine learning applications, empty dashboards in BI tools, or row counts in exported data falling short of expectations.

Testing 169

Testing Data Quality Predictive Modeling Metrics 169

Smart Data Collective

APRIL 14, 2021

Business intelligence tools can include data warehousing, data visualizations, dashboards, and reporting. It comes with embedded dashboards privately and publicly. The best part about Tableau is the easy-to-use drag-and-drop user interface that makes it easy to create in-depth analysis and dashboards.

Business Intelligence 138

Business Intelligence Dashboards Visualization Big Data 138

CIO Business Intelligence

APRIL 30, 2024

This feature provides users the ability to explore metrics with natural language. Tableau Pulse will then send insights for that metric directly to the executive’s preferred communications platform: Slack, email, mobile device, etc. Metrics Bootstrapping. Metric Goals. Metric Goals.

Analytics 96

Analytics Metrics Visualization Dashboards 96

Cloudera

AUGUST 16, 2021

CDF-PC enables Apache NiFi users to run their existing data flows on a managed, auto-scaling platform with a streamlined way to deploy NiFi data flows and a central monitoring dashboard making it easier than ever before to operate NiFi data flows at scale in the public cloud. This will create a JSON file containing the flow metadata.

Dashboards 122

Dashboards Metrics KPI Data-driven 122

AWS Big Data

MAY 1, 2024

The platform consists of approximately 370 dashboards, 360 tables registered in the data catalog, and 40 linked systems. Provide and keep up to date with technical metadata for loaded data. Configure business intelligence (BI) dashboards to provide data-driven insights to end-users targeted by the consumer’s project.

Dashboards 122

Dashboards Publishing Data-driven Cost-Benefit 122

datapine

JANUARY 31, 2022

BI users analyze and present data in the form of dashboards and various types of reports to visualize complex information in an easier, more approachable way. Team members at Lieferando said that “our new real-time dashboards allow us to monitor all major business operations through customized Key Performance Indicators.

Business Intelligence 214

Business Intelligence Analytics Cost-Benefit ROI 214

Alation

AUGUST 18, 2022

Most of the time we think about data fields & files, columns & tables, reports & dashboards. It’s important to realize that we need visibility into lineage and relationships between all data and data-related assets, including business terms, metric definitions, policies, quality rules, access controls, algorithms, etc.

Metadata 69

Metadata Visualization Statistics Data Architecture 69

CIO Business Intelligence

DECEMBER 21, 2022

To gain employee buy-in, Stout’s team builds BI dashboards to show them how they can easily connect to and interact with their data, as well as visualize it in a meaningful way. I can build a dashboard and show them the intelligence that either proves that what they think is correct, or I can prove them wrong and show them why.”

IT 131

IT Business Intelligence Sales Key Performance Indicator 131

AWS Big Data

FEBRUARY 26, 2025

S3 Tables integration with the AWS Glue Data Catalog is in preview, allowing you to stream, query, and visualize dataincluding Amazon S3 Metadata tablesusing AWS analytics services such as Amazon Data Firehose , Amazon Athena , Amazon Redshift, Amazon EMR, and Amazon QuickSight. connection testing, metadata retrieval, and data preview.

Analytics 59

Analytics Data Lake Metadata Data Warehouse 59

AWS Big Data

NOVEMBER 15, 2023

The CLEA dashboards were built on the foundation of the Well-Architected Lab. For more information on this foundation, refer to A Detailed Overview of the Cost Intelligence Dashboard. These ingested datasets are used as a source in CLEA dashboards. Data providers and consumers are the two fundamental users of a CDH dataset.

Dashboards 106

Dashboards Analytics Metadata Data Warehouse 106

AWS Big Data

MARCH 7, 2024

For on-demand ingestion for past time durations where you don’t expect new objects to be created, consider using supported pipeline metrics such as recordsOut.count to create Amazon CloudWatch alarms that can stop the pipeline. For a list of supported metrics, refer to Monitoring pipeline metrics.

Data Lake 124

Data Lake Analytics Dashboards Metrics 124

AWS Big Data

JUNE 12, 2024

In this post, we show how to ingest CSV files from Amazon Simple Storage Service (Amazon S3) into Amazon OpenSearch Service using the Amazon OpenSearch Ingestion feature and visualize the ingested data using OpenSearch Dashboards. Additionally, we demonstrate how to visualize the ingested data using OpenSearch Dashboards.

Dashboards 109

Dashboards Visualization Sales IoT 109

AWS Big Data

SEPTEMBER 11, 2024

The application supports custom workflows to allow demand and supply planning teams to collaborate, plan, source, and fulfill customer orders, then track fulfillment metrics via persona-based operational and management reports and dashboards. To achieve this, Aruba used Amazon S3 Event Notifications.

Data Architecture 96

Data Architecture Optimization Data Warehouse Metadata 96

Cloudera

MARCH 22, 2023

While in the old world where questions around data quality or system performance were answered by monitoring a few logs and metrics, in a distributed landscape (like a hybrid data platform) it’s not that straightforward. There are many logs and metrics, and they are all over the place. as they use CDP.

Metrics 88

Metrics Data Governance Cost-Benefit Dashboards 88

AWS Big Data

FEBRUARY 27, 2024

OSI is a fully managed, serverless data collector that delivers real-time log, metric, and trace data to OpenSearch Service domains and OpenSearch Serverless collections. Migration of metadata such as security roles and dashboard objects will be covered in another subsequent post.

Metadata 109

Metadata Data Processing Dashboards IoT 109

AWS Big Data

AUGUST 23, 2023

The vector engine uses approximate nearest neighbor (ANN) algorithms from the Non-Metric Space Library (NMSLIB) and FAISS libraries to power k-NN search. With the search relevance plugin, you can now view a side-by-side comparison of results in OpenSearch Dashboards. SS4O complies with the OTEL schema for logs, traces, and metrics.

Snapshot 97

Snapshot Dashboards Visualization Metrics 97

Alation

AUGUST 26, 2021

It includes intelligence about data, or metadata. The earliest DI use cases leveraged metadata — EG, popularity rankings reflecting the most used data — to surface assets most useful to others. Again, metadata is key. A stewardship dashboard, to track assets most ripe for curation and curation progress.

Metadata 64

Metadata Data Governance Dashboards Software 64

IBM Big Data Hub

MARCH 29, 2024

OpenTelemetry and Prometheus enable the collection and transformation of metrics, which allows DevOps and IT teams to generate and act on performance insights. These APIs play a key role in standardizing the collection of OpenTelemetry metrics. Metrics: Metrics define a high-level overview of system performance and health.

Metrics 75

Metrics Visualization Measurement Optimization 75

AWS Big Data

MAY 4, 2023

The data, fetched from the Kubernetes Metric Server, feeds into statistical models that VPA constructs in order to build recommendations. In short, vertical autoscaling sets up VPA to track the container_memory_working_set_bytes metric for the Spark executor pods that have vertical autoscaling enabled.

Metrics 86

Metrics Dashboards Optimization Statistics 86

AWS Big Data

AUGUST 6, 2024

At a high level, the core of Langley’s architecture is based on a set of Amazon Simple Queue Service (Amazon SQS) queues and AWS Lambda functions, and a dedicated RDS database to store ETL job data and metadata. Amazon MWAA natively provides Airflow environment metrics and Amazon MWAA infrastructure-related metrics.

Cost-Benefit 103

Cost-Benefit Snapshot Metadata Metrics 103

AWS Big Data

MARCH 7, 2023

Sources Data can be loaded from multiple sources, such as systems of record, data generated from applications, operational data stores, enterprise-wide reference data and metadata, data from vendors and partners, machine-generated data, social sources, and web sources. Let’s look at the components of the architecture in more detail.

Analytics 78

Analytics Data Warehouse Data Lake Metadata 78

AWS Big Data

MARCH 3, 2023

Monitoring – EMR Serverless sends metrics to Amazon CloudWatch at the application and job level every 1 minute. You can set up a single-view dashboard in CloudWatch to visualize application-level and job-level metrics using an AWS CloudFormation template provided on the EMR Serverless CloudWatch Dashboard GitHub repository.

Data Lake 90

Data Lake Dashboards Metrics Metadata 90

AWS Big Data

AUGUST 6, 2024

Business metrics – Providing KPIs, scorecards, and business-relevant benchmarks. Internal dashboards – Providing analytics that are relevant to stakeholders across the organization for internal use. million events per second, and analyzing over 10,000 business metrics across over 50,000 dimensions.

OLAP 93

OLAP Analytics Visualization Dashboards 93

IBM Big Data Hub

FEBRUARY 8, 2024

Automate the identification of regulatory change to applicable requirement, connect regulatory data to key risk controls and policies, and use factsheets to automate the capture and reporting of model metadata in support of inquiries and audits. Monitor for fairness, drift, bias and new generative AI metrics.

Risk Management 72

Risk Management Risk Machine Learning Dashboards 72