Alation

MAY 31, 2023

This year’s DGIQ West will host tutorials, workshops, seminars, general conference sessions, and case studies for global data leaders. DGIQ is June 5-9, 2023, at the Catamaran Resort Hotel and Spa in San Diego, just steps away from the Mission Bay beach. See the session description and add it to your agenda.

Data Governance 52

Data Governance Insurance Metadata Data-driven 52

AWS Big Data

MARCH 29, 2024

An AWS Glue crawler scans data on the S3 bucket and populates table metadata on the AWS Glue Data Catalog. Looking at the Skewness Job per Job visualization, there was spike on November 1, 2023. QuickSight periodically runs Amazon Athena queries to load query results to SPICE and then visualize the latest metric data.

Metrics 128

Metrics Visualization Dashboards Publishing 128

AWS Big Data

MARCH 10, 2023

Iceberg employs internal metadata management that keeps track of data and empowers a set of rich features at scale. The transformed zone is an enterprise-wide zone to host cleaned and transformed data in order to serve multiple teams and use cases. For example, from 2023/02/20 14:40:41 to 2023-02-20 14:40:41.000 UTC.

Data Lake 122

Data Lake Sales Data Warehouse Snapshot 122

AWS Big Data

AUGUST 6, 2024

At a high level, the core of Langley’s architecture is based on a set of Amazon Simple Queue Service (Amazon SQS) queues and AWS Lambda functions, and a dedicated RDS database to store ETL job data and metadata. In 2023, AWS announced the upcoming deprecation of Data Pipeline , one of the core services used by Langley.

Cost-Benefit 111

Cost-Benefit Metadata Snapshot Metrics 111

AWS Big Data

JUNE 12, 2024

The OpenSearch Ingestion feature of OpenSearch Service introduced in April 2023 makes ingesting and processing petabyte-scale data into OpenSearch Service straightforward. Amazon SQS receives an Amazon S3 event notification as a JSON file with metadata such as the S3 bucket name, object key, and timestamp.

Dashboards 122

Dashboards Visualization Sales IoT 122

AWS Big Data

MARCH 7, 2024

After the table is cataloged in your AWS Glue metadata catalog, you can run queries directly on your data in your S3 data lake through OpenSearch Dashboards. You can audit connections to ensure that they are set up in a scalable, cost-efficient, and secure way. Solution overview The following diagram illustrates the solution architecture.

Data Lake 131

Data Lake Analytics Dashboards Metrics 131

IBM Big Data Hub

JANUARY 9, 2024

Data ingestion must be done properly from the start, as mishandling it can lead to a host of new issues. 4 key components to ensure reliable data ingestion Data quality and governance: Data quality means ensuring the security of data sources, maintaining holistic data and providing clear metadata.

Enterprise 71

Enterprise Data Integration Data Quality Contextual Data 71

AWS Big Data

MAY 2, 2023

Earlier in 2023, we added support for Apache Airflow v2.4.3 The workflow steps are as follows: The producer DAG makes an API call to a publicly hosted API to retrieve data. Amazon MWAA supports multiple versions of Apache Airflow (v1.10.12, v2.0.2, and v2.2.2). Additionally, with Apache Airflow v2.4.3 environment. environment.

Testing 130

Testing Experimentation Management Metadata 130

CIO Business Intelligence

JANUARY 30, 2024

Even for more straightforward ESG information, such as kilowatt-hours of energy consumed, ESG reporting requirements call for not just the data, but the metadata, including “the dates over which the data was collected and the data quality,” says Fridrich. The complexity is at a much higher level.”

Reporting 115

Reporting Data Quality Strategy Data-driven 115

Alation

MAY 11, 2023

Our revAlation London event returns for 2023. This multi-brand online retailer hosts thousands of products for sale on the internet and collects millions of bits and bytes of data across customer touchpoints each day. In this blog, I’ll detail how we’ve grown in EMEA specifically, sharing exciting updates and plans for the future.

B2B 52

B2B Finance Data Governance Marketing 52

IBM Big Data Hub

APRIL 11, 2024

For example, New York City published its own AI Action plan in October 2023, and formalized its AI principles in March 2024. Responsibility for risk: These forms can imply that model owners will be absolved of risk because they used a certain technology or cloud host or procured a model from a third party.

Risk 74

Risk Consulting Data Processing Publishing 74

AWS Big Data

APRIL 25, 2023

AnyCompany’s marketing team hosted an event at the Anaheim Convention Center, CA. Starting January 5, 2023, all new object uploads to Amazon S3 are automatically encrypted at no additional cost and with no impact on performance. Let’s take an example. The marketing team created leads based on the event in Adobe Marketo.

Sales 97

Sales Visualization Software Marketing 97

Alation

MAY 11, 2023

Our revAlation London event returns for 2023. This multi-brand online retailer hosts thousands of products for sale on the internet and collects millions of bits and bytes of data across customer touchpoints each day. In this blog, I’ll detail how we’ve grown in EMEA specifically, sharing exciting updates and plans for the future.

B2B 40

B2B Finance Data Governance Marketing 40

IBM Big Data Hub

JULY 17, 2023

Watsonx.data is built on 3 core integrated components: multiple query engines, a catalog that keeps track of metadata, and storage and relational data sources which the query engines directly access. 1 When comparing published 2023 list prices normalized for VPC hours of watsonx.data to several major cloud data warehouse vendors.

Machine Learning 62

Machine Learning Data Warehouse Modeling Cost-Benefit 62

AWS Big Data

APRIL 26, 2024

Note : All Amazon S3 buckets (created after January 5, 2023) have encryption configured by default (Amazon S3 managed keys (SSE-S3)), and all new objects that are uploaded to an S3 bucket are automatically encrypted at rest. This allows users to directly access EMR Studio with their enterprise credentials.

Analytics 116

Analytics Data Lake Management Enterprise 116

Laminar Security

MAY 3, 2023

According to our recent State of Cloud Data Security Report 2023 , 77% of organizations experienced a cloud data breach in 2022. In fact, 93% of security professionals surveyed in 2023 are concerned about it. Gartner, Innovation Insight: Data Security Posture Management, Brian Lowans, Joerg Fritsch, Andrew Bales, 28 March 2023.

Management 40

Management Risk Risk Management Data Processing 40

Alation

APRIL 14, 2023

In his talk, Mitesh revealed that Alation delivers useful information about data via metadata, and explored why context is key to building reliable data pipelines. The post Fivetran Modern Data Stack Conference 2023: Key Takeaways appeared first on Alation.

Data Warehouse 52

Data Warehouse Data-driven Metadata Digital Transformation 52

Cloudera

APRIL 21, 2022

The centerpiece of MHS Genesis is Cerner’s Millennium services management platform, which provides hosted software-as-a-service functionality in the cloud. A key reason for selecting Cerner, the DoD said , was the company’s data center allows direct access to proprietary data that it couldn’t obtain from a government-hosted environment.

Informatics 87

Informatics Metadata Insurance Data Processing 87

Rita Sallam

APRIL 2, 2023

Domo Key Findings: Year-over-Year (YoY) analysis has shown that, based on data from the first quarter of 2023, the Northern Gulf Coast of Florida (Leon County) has a hotter average temperature than the previous 4 years. The Entire United States – Built-up Area Exposure is significant.

Optimization 52

Optimization Machine Learning Insurance Data Science 52

AWS Big Data

OCTOBER 31, 2024

In 2023, Volkswagen Autoeuropa represented 1.3% Absence of data catalog and metadata management – Data didn’t have any metadata associated with it, and so use cases couldn’t consume the data without further explanation from the data source owners and specialists. This led to reduced trust in the data.

Digital Transformation 111

Digital Transformation Metadata Data Quality Manufacturing 111

CIO Business Intelligence

DECEMBER 2, 2024

What has changed are the critical design factors in the interconnected world of cloud computing: the physical location of the data, metadata, and the governance surrounding it. This solution is hosted and managed by the enterprise or in conjunction with a partner, with strict oversight from regulators. Published: December 6, 2019

Metadata 94

Metadata Data Processing Publishing Data-driven 94

AWS Big Data

MARCH 20, 2025

Solution overview For our use case, an enterprise data warehouse with business data is hosted on an on-premises TiDB platform, an AWS Global Partner that is also available on AWS through AWS Marketplace. Install DolphinScheduler on an EC2 instance with an RDS for MySQL instance storing DolphinScheduler metadata. bin.tar.gz bin.tar.gz

Data Warehouse 104

Data Warehouse Metadata Testing Management 104

Ontotext

JANUARY 16, 2025

The first version of Talk to Your Graph (or TTYG for short) was released in 2023 and it was my baby. Use of assistant and thread metadata. So what is that metadata? The OpenAI Assistants API provides a set of custom metadata fields for both assistants and threads. Thats pretty much everything you need to get started.

Metadata 52

Metadata Modeling Snapshot Interactive 52

Andrew White

MARCH 31, 2023

How would I sum up several days in Orlando at our 2023 Data and Analytics conference last week – March 19th-22nd, 2023: Confusion Hype Voice of the Business Fort of all it was a fun time. I hosted 25 1-1s in between the meetings and presentations. You can’t beat getting out and meeting people.

Analytics 40

Analytics Marketing Data-driven Visualization 40