Rocket-Powered Data Science

MARCH 20, 2023

Content includes reports, documents, articles, presentations, visualizations, video, and audio representations of the insights and knowledge that have been extracted from data. We could further refine our opening statement to say that our business users are too often in a state of being data-rich, but insights-poor, and content-hungry.

Data Warehouse 325

Data Warehouse Metadata Digital Transformation Machine Learning 325

CIO Business Intelligence

JUNE 7, 2022

What is data analytics? Data analytics is a discipline focused on extracting insights from data. It comprises the processes, tools and techniques of data analysis and management, including the collection, organization, and storage of data. What are the four types of data analytics?

Data Analytics 135

Data Analytics Diagnostic Analytics Management Analytics 135

KDnuggets

OCTOBER 3, 2024

Learn the data engineering tools for data orchestration, database management, batch processing, ETL (Extract, Transform, Load), data transformation, data visualization, and data streaming.

Visualization 140

Visualization Data Transformation Management 140

Cloudera

AUGUST 17, 2021

When we announced the GA of Cloudera Data Engineering back in September of last year, a key vision we had was to simplify the automation of data transformation pipelines at scale. Figure 1: Pipeline composed of Spark and Hive jobs deployed to run within CDE’s managed Apache Airflow service. CDP Airflow operators.

Management 115

Management Cost-Benefit Data Transformation Optimization 115

AWS Big Data

JULY 10, 2024

We are excited to announce a new capability of the AWS Glue Studio visual editor that offers a new visual user experience. Now you can author data preparation transformations and edit them with the AWS Glue Studio visual editor. Within the new experience, you can choose from hundreds of prebuilt transformations.

Interactive 106

Interactive Visualization Data Integration Statistics 106

AWS Big Data

JANUARY 15, 2025

Their terminal operations rely heavily on seamless data flows and the management of vast volumes of data. With the addition of these technologies alongside existing systems like terminal operating systems (TOS) and SAP, the number of data producers has grown substantially.

IoT 100

IoT Machine Learning Metadata Data-driven 100

datapine

MAY 2, 2023

Benefits Of Big Data In Logistics Before we look at our selection of practical examples and applications, let’s look at the benefits of big data in logistics – starting with the (not so) small matter of costs. A testament to the rising role of optimization in logistics. Why are logistics companies so interested in optimization?

Big Data 275

Big Data Internet of Things Cost-Benefit Optimization 275

AWS Big Data

DECEMBER 16, 2024

For each service, you need to learn the supported authorization and authentication methods, data access APIs, and framework to onboard and test data sources. This fragmented, repetitive, and error-prone experience for data connectivity is a significant obstacle to data integration, analysis, and machine learning (ML) initiatives.

Visualization 71

Visualization Data Processing Testing Publishing 71

AWS Big Data

OCTOBER 11, 2023

Organizations with legacy, on-premises, near-real-time analytics solutions typically rely on self-managed relational databases as their data store for analytics workloads. Near-real-time streaming analytics captures the value of operational data and metrics to provide new insights to create business opportunities.

Management 117

Management Metadata Analytics Dashboards 117

AWS Big Data

AUGUST 26, 2024

You can use AWS Glue Studio to set up data replication and mask PII with no coding required. AWS Glue Studio visual editor provides a low-code graphic environment to build, run, and monitor extract, transform, and load (ETL) scripts. An AWS Identity and Access Management (IAM) role is used for AWS Glue. 16 10.2.10.0/24

Visualization 107

Visualization Metadata Data Transformation Testing 107

AWS Big Data

JULY 27, 2023

AWS Glue Studio is a graphical interface that makes it easy to create, run, and monitor extract, transform, and load (ETL) jobs in AWS Glue. DataBrew is a visual data preparation tool that enables you to clean and normalize data without writing any code. Choose Visual with a blank canvas and create the visual job.

Visualization 89

Visualization Cost-Benefit Data Quality Publishing 89

Wayne Yaddow

FEBRUARY 18, 2025

Selecting the strategies and tools for validating data transformations and data conversions in your data pipelines. Introduction Data transformations and data conversions are crucial to ensure that raw data is organized, processed, and ready for useful analysis.

Testing 52

Testing Data Transformation Data-driven Data Quality 52

AWS Big Data

DECEMBER 13, 2023

In collaboration with AWS, BMS identified a business need to migrate and modernize their custom extract, transform, and load (ETL) platform to a native AWS solution to reduce complexities, resources, and investment to upgrade when new Spark, Python, or AWS Glue versions are released.

Metadata 101

Metadata Data Lake Visualization Data Quality 101

CIO Business Intelligence

JULY 5, 2022

While quantitative analysis, operational analysis, and data visualizations are key components of business analytics, the goal is to use the insights gained to shape business decisions. What is the difference between business analytics and data analytics? Business analytics is a subset of data analytics.

Business Analytics 136

Business Analytics Prescriptive Analytics Data mining Diagnostic Analytics 136

AWS Big Data

DECEMBER 4, 2024

Recognizing this paradigm shift, ANZ Institutional Division has embarked on a transformative journey to redefine its approach to data management, utilization, and extracting significant business value from data insights. This enables global discoverability and collaboration without centralizing ownership or operations.

Metadata 93

Metadata Data Governance Data Quality Data-driven 93

CIO Business Intelligence

APRIL 30, 2024

Together the technologies aim to help business users and “novice” data analysts explore their data and gain insights without having to resort to data experts. This is really empowering everyone to be a data expert,” Maxon said. “It Shared Dimensions and Composable Data Sources.

Analytics 96

Analytics Metrics Visualization Dashboards 96

FineReport

JUNE 7, 2024

In 2024, data visualization companies play a pivotal role in transforming complex data into captivating narratives. This blog provides an insightful exploration of the leading entities shaping the data visualization landscape.

Visualization 52

Visualization Predictive Analytics Dashboards Predictive Modeling 52

DataKitchen

JULY 27, 2023

Azure Databricks Delta Live Table s: These provide a more straightforward way to build and manage Data Pipelines for the latest, high-quality data in Delta Lake. It provides data prep, management, and enterprise data warehousing tools. It has a data pipeline tool , as well. It does the job.

Machine Learning 130

Machine Learning Cost-Benefit Data Transformation Testing 130

Cloudera

OCTOBER 13, 2020

Machine Learning – has grown from a collaborative workbench to an end-to-end Production ML platform that enables data scientists to deploy a model or an application to production in minutes with production-level monitoring, governance and performance tracking. Enrich – Data Engineering (Apache Spark and Apache Hive).

Data Warehouse 97

Data Warehouse Machine Learning Visualization Data Lake 97

AWS Big Data

MAY 22, 2024

Amazon OpenSearch Ingestion is a fully managed serverless pipeline that allows you to ingest, filter, transform, enrich, and route data to an Amazon OpenSearch Service domain or Amazon OpenSearch Serverless collection. When you create a new pipeline on the OpenSearch Service console, you’re presented with a new catalog page.

Data Architecture 112

Data Architecture Visualization Data Transformation Management 112

AWS Big Data

DECEMBER 21, 2023

AWS Glue is a serverless data integration service that makes it straightforward to discover, prepare, and combine data for analytics, machine learning (ML), and application development. AWS Glue provides both visual and code-based interfaces to make data integration effortless. Choose Create job and Visual ETL.

Analytics 107

Analytics IT Data Lake Visualization 107

AWS Big Data

AUGUST 13, 2024

AWS Glue is a serverless data integration service that helps analytics users to discover, prepare, move, and integrate data from multiple sources for analytics, machine learning (ML), and application development. The SFTP connector is used to manage the connection to the SFTP server. Create the gateway endpoint.

Data Processing 98

Data Processing Visualization Data Lake Data Processing 98

AWS Big Data

OCTOBER 11, 2023

The availability of machine-readable files opens up new possibilities for data analytics, allowing organizations to analyze large amounts of pricing data. Using machine learning (ML) and data visualization tools, these datasets can be transformed into actionable insights that can inform decision-making.

Visualization 110

Visualization Dashboards Data-driven Gap analysis 110

AWS Big Data

OCTOBER 27, 2023

AWS Glue eliminates complexities and costs, allowing organizations to perform data integration tasks in minutes, boosting efficiency. This blog post explores the newly announced managed connector for Google BigQuery and demonstrates how to build a modern ETL pipeline with AWS Glue Studio without writing code.

Analytics 110

Analytics Visualization Data Integration Cost-Benefit 110

AWS Big Data

JULY 18, 2024

OpenSearch is an open source, distributed search engine suitable for a wide array of use-cases such as ecommerce search, enterprise search (content management search, document search, knowledge management search, and so on), site search, application search, and semantic search. You use the schema API to manage schema.

Dashboards 98

Dashboards Testing Data-driven Visualization 98

Octopai

MARCH 31, 2021

In other words, kind of like Hansel and Gretel in the forest, your data leaves a trail of breadcrumbs – the metadata – to record where it came from and who it really is. So the first step in any data lineage mapping project is to ensure that all of your data transformation processes do in fact accurately record metadata.

Metadata 133

Metadata Data Transformation Business Intelligence Reporting 133

O'Reilly on Data

JANUARY 17, 2023

Related to the previous point, a company could go from “raw data” to “it’s serving predictions on live data” in a single work day. You need to coordinate with stakeholders and product managers to suss out what kinds of models you need and how to embed them into the company’s processes.

Machine Learning 363

Machine Learning Predictive Modeling Software Modeling 363

AWS Big Data

NOVEMBER 15, 2023

Overview of the BMW Cloud Data Hub At the BMW Group, Cloud Data Hub (CDH) is the central platform for managing company-wide data and data solutions. They can use their own toolsets or rely on provided blueprints to ingest the data from source systems.

Analytics 106

Analytics Dashboards Metadata Data Warehouse 106

DataKitchen

OCTOBER 25, 2022

It’s because it’s a hard thing to accomplish when there are so many teams, locales, data sources, pipelines, dependencies, data transformations, models, visualizations, tests, internal customers, and external customers. They all have different roles and different relationships with the data.

Testing 130

Testing Data-driven Visualization Dashboards 130

CIO Business Intelligence

JANUARY 19, 2024

Data science certifications give you an opportunity to not only develop skills that are hard to find in your desired industry, but also validate your data science know-how so recruiters and hiring managers know what they get if they hire you.

Data Science 126

Data Science Machine Learning Predictive Modeling Forecasting 126

Alation

JUNE 28, 2022

The real challenge lies in getting people to access, manage, and search for it appropriately. This is where metadata, or the data about data, comes into play. Having a data catalog is the cornerstone of your data governance strategy, but what supports your data catalog? Your metadata gives users context.

Metadata 52

Metadata Management Data Governance Machine Learning 52

CIO Business Intelligence

JUNE 29, 2022

Analytics is the means for discovering those insights, and doing it well requires the right tools for ingesting and preparing data, enriching and tagging it, building and sharing reports, and managing and protecting your data and insights. Azure Data Factory. Everything is visual. Azure Synapse Analytics.

Data Lake 116

Data Lake Analytics Data Warehouse Machine Learning 116

AWS Big Data

JUNE 20, 2023

You can easily deliver data to supported destinations using the Amazon Kinesis Data Firehose integration with VPC flow logs. Kinesis Data Firehose is a fully managed service for delivering near-real-time streaming data to various destinations for storage and performing near-real-time analytics.

Dashboards 92

Dashboards Visualization Metrics Data Transformation 92

AWS Big Data

DECEMBER 5, 2023

This dynamic tool, powered by AWS and CARTO, provided robust visualizations of which regions and populations were interacting with our survey, enabling us to zoom in quickly and address gaps in coverage. Figure 1: Workflow illustrating data ingesting, transformation, and visualization using Redshift and CARTO.

Measurement 93

Measurement Dashboards Data Warehouse Analytics 93

erwin

APRIL 29, 2020

These tools range from enterprise service bus (ESB) products, data integration tools; extract, transform and load (ETL) tools, procedural code, application program interfaces (API)s, file transfer protocol (FTP) processes, and even business intelligence (BI) reports that further aggregate and transform data.

Data Governance 111

Data Governance Key Performance Indicator Metadata Data Quality 111

Alation

FEBRUARY 2, 2023

Data product managers are in high demand these days. In 2020, Glassdoor rated product manager as the 4th best job in the US. This makes it more important for aspiring data product managers to stay ahead of the competition. So what sets data product managers apart from the pack? Sounds exciting?

Management 52

Management Data-driven Visualization Strategy 52

AWS Big Data

AUGUST 19, 2024

This allows business analysts and decision-makers to gain valuable insights, visualize key metrics, and explore the data in depth, enabling informed decision-making and strategic planning for pricing and promotional strategies. The AWS Glue job uses the secure connection established by the VPC endpoints to access Snowflake data.

Analytics 107

Analytics Data-driven Data Integration Data Lake 107