O'Reilly on Data

MARCH 31, 2020

But there’s a host of new challenges when it comes to managing AI projects: more unknowns, non-deterministic outcomes, new infrastructures, new processes and new tools. AI products are automated systems that collect and learn from data to make user-facing decisions. Why AI software development is different.

Management 363

Management Machine Learning Experimentation Metrics 363

AWS Big Data

OCTOBER 30, 2024

Amazon DataZone now launched authentication supports through the Amazon Athena JDBC driver, allowing data users to seamlessly query their subscribed data lake assets via popular business intelligence (BI) and analytics tools like Tableau, Power BI, Excel, SQL Workbench, DBeaver, and more.

Visualization 119

Visualization Data Lake Testing Data Governance 119

CIO Business Intelligence

SEPTEMBER 23, 2024

Data-driven insights are only as good as your data Imagine that each source of data in your organization—from spreadsheets to internet of things (IoT) sensor feeds—is a delegate set to attend a conference that will decide the future of your organization.

Manufacturing 121

Manufacturing Internet of Things Metadata Risk 121

AWS Big Data

MAY 7, 2024

Data governance is a key enabler for teams adopting a data-driven culture and operational model to drive innovation with data. Amazon DataZone allows you to simply and securely govern end-to-end data assets stored in your Amazon Redshift data warehouses or data lakes cataloged with the AWS Glue data catalog.

Metadata 107

Metadata Data Lake Data Processing Data-driven 107

AWS Big Data

OCTOBER 11, 2023

Organizations with legacy, on-premises, near-real-time analytics solutions typically rely on self-managed relational databases as their data store for analytics workloads. Near-real-time streaming analytics captures the value of operational data and metrics to provide new insights to create business opportunities.

Management 131

Management Metadata Analytics Dashboards 131

AWS Big Data

DECEMBER 5, 2024

Enterprises that need to share and access large amounts of data across multiple domains and services need to build a cloud infrastructure that scales as need changes. To achieve this, the different technical products within the company regularly need to move data across domains and services efficiently and reliably.

Metrics 97

Metrics Dashboards Testing Optimization 97

AWS Big Data

APRIL 17, 2024

With this new instance family, OpenSearch Service uses OpenSearch innovation and AWS technologies to reimagine how data is indexed and stored in the cloud. Today, customers widely use OpenSearch Service for operational analytics because of its ability to ingest high volumes of data while also providing rich and interactive analytics.

Optimization 128

Optimization Snapshot Metadata Cost-Benefit 128

erwin

AUGUST 28, 2020

Organizations with a solid understanding of data governance (DG) are better equipped to keep pace with the speed of modern business. In this post, the erwin Experts address: What Is Data Governance? Why Is Data Governance Important? What Is Good Data Governance? What Are the Key Benefits of Data Governance?

Data Governance 145

Data Governance IT Cost-Benefit Metadata 145

erwin

APRIL 16, 2021

Data governance is best defined as the strategic, ongoing and collaborative processes involved in managing data’s access, availability, usability, quality and security in line with established internal policies and relevant data regulations. Data Governance Is Business Transformation. Enhanced : Data managed equally.

Data Governance 128

Data Governance Metadata Cost-Benefit Data-driven 128

Domino Data Lab

JULY 2, 2019

Paco Nathan ‘s latest article covers program synthesis, AutoPandas, model-driven data queries, and more. In other words, using metadata about data science work to generate code. In this case, code gets generated for data preparation, where so much of the “time and labor” in data science work is concentrated.

Metadata 105

Metadata Data Science Machine Learning Data-driven 105

AWS Big Data

DECEMBER 13, 2023

In addition to using native managed AWS services that BMS didn’t need to worry about upgrading, BMS was looking to offer an ETL service to non-technical business users that could visually compose data transformation workflows and seamlessly run them on the AWS Glue Apache Spark-based serverless data integration engine.

Metadata 111

Metadata Data Lake Visualization Data Quality 111

AWS Big Data

DECEMBER 19, 2024

Data has become an invaluable asset for businesses, offering critical insights to drive strategic decision-making and operational optimization. Today, this is powering every part of the organization, from the customer-favorite online cake customization feature to democratizing data to drive business insight.

Data Governance 52

Data Governance Publishing Data-driven Metadata 52

Smart Data Collective

APRIL 14, 2021

Advancement in big data technology has made the world of business even more competitive. The proper use of business intelligence and analytical data is what drives big brands in a competitive market. Business intelligence tools can include data warehousing, data visualizations, dashboards, and reporting.

Business Intelligence 138

Business Intelligence Dashboards Visualization Big Data 138

erwin

APRIL 2, 2021

Organizations are managing more data than ever. With more companies increasingly migrating their data to the cloud to ensure availability and scalability, the risks associated with data management and protection also are growing. Data Security Starts with Data Governance. Who is authorized to use it and how?

Data Governance 106

Data Governance Cost-Benefit Metadata Risk 106

CIO Business Intelligence

JUNE 9, 2022

A data management platform (DMP) is a group of tools designed to help organizations collect and manage data from a wide array of sources and to create reports that help explain what is happening in those data streams. Deploying a DMP can be a great way for companies to navigate a business world dominated by data.

Management 144

Management Advertising Data Lake Sales 144

AWS Big Data

JULY 14, 2023

FinAuto has a unique position to look across FinOps and provide solutions that help satisfy multiple use cases with accurate, consistent, and governed delivery of data and related services. These datasets can then be used to power front end systems, ML pipelines, and data engineering teams.

Finance 98

Finance Metadata Big Data Recreation/Entertainment 98

AWS Big Data

SEPTEMBER 12, 2024

We use leading-edge analytics, data, and science to help clients make intelligent decisions. We developed and host several applications for our customers on Amazon Web Services (AWS). Data ingestion: The data ingestion layer is the first step of the proposed framework.

Unstructured Data 111

Unstructured Data Metadata Machine Learning Consulting 111

AWS Big Data

MAY 31, 2024

This encompasses tasks such as integrating diverse data from various sources with distinct formats and structures, optimizing the user experience for performance and security, providing multilingual support, and optimizing for cost, operations, and reliability.

Metadata 135

Metadata Data-driven Management Testing 135

AWS Big Data

JANUARY 27, 2023

To build a data-driven business, it is important to democratize enterprise data assets in a data catalog. With a unified data catalog, you can quickly search datasets and figure out data schema, data format, and location. For metadata read/write, Flink has the catalog interface.

Data Lake 88

Data Lake Metadata Business Analysis Data-driven 88

AWS Big Data

MARCH 29, 2024

QuickSight makes it straightforward for business users to visualize data in interactive dashboards and reports. You can slice data by different dimensions like job name, see anomalies, and share reports securely across your organization. With these insights, teams have the visibility to make data integration pipelines more efficient.

Metrics 128

Metrics Visualization Dashboards Publishing 128

AWS Big Data

JANUARY 22, 2024

The company uses AWS Cloud services to build data-driven products and scale engineering best practices. To ensure a sustainable data platform amid growth and profitability phases, their tech teams adopted a decentralized data mesh architecture. The solution Acast implemented is a data mesh, architected on AWS.

Data-driven 118

Data-driven Advertising Metadata Data Architecture 118

Domino Data Lab

JUNE 2, 2019

Co-chair Paco Nathan provides highlights of Rev 2 , a data science leaders summit. We held Rev 2 May 23-24 in NYC, as the place where “data science leaders and their teams come to learn from each other.” Nick Elprin, CEO and co-founder of Domino Data Lab. First item on our checklist: did Rev 2 address how to lead data teams?

Data Science 110

Data Science Data-driven Machine Learning Modeling 110

Cloudera

AUGUST 16, 2021

We just announced Cloudera DataFlow for the Public Cloud (CDF-PC), the first cloud-native runtime for Apache NiFi data flows. Apache Nifi is a powerful tool to build data movement pipelines using a visual flow designer. Implementing an automated scale up and scale down procedure for NiFi clusters is complex and time consuming.

Dashboards 122

Dashboards Metrics KPI Data-driven 122

AWS Big Data

JUNE 12, 2024

In today’s data-driven world, organizations are continually confronted with the task of managing extensive volumes of data securely and efficiently. A common use case that we see amongst customers is to search and visualize data. A common use case that we see amongst customers is to search and visualize data.

Dashboards 122

Dashboards Visualization Sales IoT 122

AWS Big Data

DECEMBER 21, 2023

This is a guest post co-written by Alex Naumov, Principal Data Architect at smava. smava believes in and takes advantage of data-driven decisions in order to become the market leader. smava believes in and takes advantage of data-driven decisions in order to become the market leader.

Data Lake 115

Data Lake Data Warehouse Data-driven B2B 115

AWS Big Data

AUGUST 6, 2024

INSITE applications are in general data intensive. They ingest and transform large volumes of data in different formats and processing patterns (such as batch and near real time) from various sources internal and external to Amazon. To enable and meet these requirements, GTTS built its own data platform.

Cost-Benefit 111

Cost-Benefit Metadata Snapshot Metrics 111

Ontotext

SEPTEMBER 15, 2020

What Makes a Data Fabric? Data Fabric’ has reached where ‘Cloud Computing’ and ‘Grid Computing’ once trod. Data Fabric hit the Gartner top ten in 2019. This multiplicity of data leads to the growth silos, which in turns increases the cost of integration. It is a buzzword.

Metadata 69

Metadata Knowledge Discovery Data Quality Strategy 69

bridgei2i

MARCH 3, 2021

Episode 4: Unlocking the Value of Enterprise AI with Data Engineering Capabilities. Unlocking the Value of Enterprise AI with Data Engineering Capabilities. They discuss how the data engineering team is instrumental in easing collaboration between analysts, data scientists and ML engineers to build enterprise AI solutions.

Enterprise 98

Enterprise Digital Transformation Data-driven Interactive 98

AWS Big Data

MARCH 7, 2024

Organizations often need to manage a high volume of data that is growing at an extraordinary rate. At the same time, they need to optimize operational costs to unlock the value of this data for timely insights and do so with a consistent performance. We think of this concept as inside-out data movement. Example Corp.

Data Lake 131

Data Lake Analytics Dashboards Metrics 131

CIO Business Intelligence

SEPTEMBER 22, 2023

Data management platform definition A data management platform (DMP) is a suite of tools that helps organizations to collect and manage data from a wide array of first-, second-, and third-party sources and to create reports and build customer profiles as part of targeted personalization campaigns.

Management 105

Management Advertising Data Lake Sales 105

CIO Business Intelligence

JANUARY 30, 2024

The foundation for ESG reporting, of course, is data. What companies need more than anything is good data for ESG reporting. That means ensuring ESG data is available, transparent, and actionable, says Ivneet Kaur, EVP and chief information technology officer at identity services provider Sterling.

Reporting 114

Reporting Data Quality Strategy Data-driven 114

AWS Big Data

NOVEMBER 22, 2023

Today, we’re making available a new capability of AWS Glue Data Catalog that allows generating column-level statistics for AWS Glue tables. Data lakes are designed for storing vast amounts of raw, unstructured, or semi-structured data at a low cost, and organizations share those datasets across multiple departments and teams.

Statistics 130

Statistics Data Lake Optimization Data-driven 130

Cloudera

SEPTEMBER 29, 2022

Data teams have the impossible task of delivering everything (data and workloads) everywhere (on premise and in all clouds) all at once (with little to no latency). Each of these trends claim to be complete models for their data architectures to solve the “everything everywhere all at once” problem. Data mesh defined.

Data Architecture 74

Data Architecture Data Warehouse Metadata Sales 74

AWS Big Data

JUNE 12, 2024

Swisscom’s Data, Analytics, and AI division is building a One Data Platform (ODP) solution that will enable every Swisscom employee, process, and product to benefit from the massive value of Swisscom’s data. The following high-level architecture diagram shows ODP with different layers of the modern data architecture.

Data Architecture 116

Data Architecture Cost-Benefit Data-driven Experimentation 116

AWS Big Data

MAY 16, 2024

Apache Airflow is a popular platform for enterprises looking to orchestrate complex data pipelines and workflows. In this post, we’re excited to introduce two new features that address common customer challenges and unlock new possibilities for building robust, scalable, and flexible data orchestration solutions using Amazon MWAA.

Testing 121

Testing Metrics Interactive Management 121

Ontotext

NOVEMBER 22, 2020

Data and content are organized in a way that facilitates discoverability, insights and decision making rather than be bound by limitations of data formats and legacy systems. GraphQL has a number of advantages for developers, especially for data-centric applications. Content Enrichment and Metadata Management.

Metadata 72

Metadata Cost-Benefit Unstructured Data Technology 72

AWS Big Data

MARCH 26, 2024

This view is used to identify patterns and trends in customer behavior, which can inform data-driven decisions to improve business outcomes. In this post, we discuss how you can use purpose-built AWS services to create an end-to-end data strategy for C360 to unify and govern customer data that address these challenges.

Data Strategy 99

Data Strategy Strategy Data Warehouse Prescriptive Analytics 99