O'Reilly on Data

JANUARY 17, 2023

A common task for a data scientist is to build a predictive model. You know the drill: pull some data, carve it up into features, feed it into one of scikit-learn’s various algorithms. Collectively, your attempts teach you about your data and its relation to the problem you’re trying to solve.

Machine Learning 363

Machine Learning Predictive Modeling Software Modeling 363

AWS Big Data

NOVEMBER 22, 2024

Redshift Data API provides a secure HTTP endpoint and integration with AWS SDKs. With Data API session reuse, you can use a single long-lived session at the start of the ETL pipeline and use that persistent context across all ETL phases. In the next step, copy data from Amazon Simple Storage Service (Amazon S3) to the temporary table.

Data Warehouse 100

Data Warehouse Recreation/Entertainment Cost-Benefit Data-driven 100

AWS Big Data

NOVEMBER 15, 2023

The CLEA dashboards were built on the foundation of the Well-Architected Lab. For more information on this foundation, refer to A Detailed Overview of the Cost Intelligence Dashboard. Overview of the BMW Cloud Data Hub At the BMW Group, Cloud Data Hub (CDH) is the central platform for managing company-wide data and data solutions.

Dashboards 110

Dashboards Analytics Metadata Data Warehouse 110

Wayne Yaddow

FEBRUARY 26, 2025

AI is transforming how senior data engineers and data scientists validate data transformations and conversions. Artificial intelligence-based verification approaches aid in the detection of anomalies, the enforcement of data integrity, and the optimization of pipelines for improved efficiency.

Data Transformation 52

Data Transformation Testing Data-driven Data Quality 52

AWS Big Data

JULY 18, 2024

The main driving factors include lower total cost of ownership, scalability, stability, improved ingestion connectors (such as Data Prepper , Fluent Bit, and OpenSearch Ingestion), elimination of external cluster managers like Zookeeper, enhanced reporting, and rich visualizations with OpenSearch Dashboards.

Dashboards 106

Dashboards Testing Data-driven Visualization 106

FineReport

MARCH 7, 2024

In the realm of big data utilization , we often romanticize its profound impact, envisioning scenarios like precision-targeted advertising, streamlined social security management, and the intelligent evolution of the pharmaceutical sector. Why Big Data Analysis Report? Try FineReport Now 1. Try FineReport Now 1.1

Dashboards 52

Dashboards Reporting Advertising Statistics 52

AWS Big Data

NOVEMBER 27, 2024

The data in Amazon Redshift is transactionally consistent and updates are automatically and continuously propagated. Together with price-performance, Amazon Redshift offers capabilities such as serverless architecture, machine learning integration within your data warehouse and secure data sharing across the organization.

Data Warehouse 101

Data Warehouse Analytics Testing Modeling 101

Smart Data Collective

APRIL 29, 2020

What is data management? Data management can be defined in many ways. The techniques for managing organisational data in a standardised approach that minimises inefficiency. Extraction, Transform, Load (ETL). Data transformation. Data analytics and visualisation. Data analytics and visualisation.

Management 98

Management Data Warehouse Digital Transformation Dashboards 98

DataKitchen

OCTOBER 5, 2021

Data operations (or data production) is a series of pipeline procedures that take raw data, progress through a series of processing and transformation steps, and output finished products in the form of dashboards, predictions, data warehouses or whatever the business requires. Their product is the data.

Testing 152

Testing Dashboards Measurement Experimentation 152

AWS Big Data

OCTOBER 11, 2023

The lift and shift migration approach is limited in its ability to transform businesses because it relies on outdated, legacy technologies and architectures that limit flexibility and slow down productivity. It shows a call center streaming data source that sends the latest call center feed in every 15 seconds.

Management 124

Management Metadata Analytics Dashboards 124

CIO Business Intelligence

JULY 5, 2022

What is the difference between business analytics and data analytics? Business analytics is a subset of data analytics. Data analytics is used across disciplines to find trends and solve problems using data mining , data cleansing, data transformation, data modeling, and more.

Business Analytics 136

Business Analytics Prescriptive Analytics Data mining Diagnostic Analytics 136

AWS Big Data

DECEMBER 5, 2023

HR&A has used Amazon Redshift Serverless and CARTO to process survey findings more efficiently and create custom interactive dashboards to facilitate understanding of the results. The first step in this process is mapping the digital divide.

Measurement 100

Measurement Dashboards Data Warehouse Analytics 100

AWS Big Data

MARCH 9, 2023

Amazon QuickSight is a fully managed, cloud-native business intelligence (BI) service that makes it easy to connect to your data, create interactive dashboards and reports, and share these with tens of thousands of users, either within QuickSight or embedded in your application or website. SDK Feature overview The QuickSight SDK v2.0

Slice and Dice 94

Slice and Dice Dashboards Analytics Interactive 94

CIO Business Intelligence

JUNE 7, 2022

What is data analytics? Data analytics is a discipline focused on extracting insights from data. It comprises the processes, tools and techniques of data analysis and management, including the collection, organization, and storage of data. What are the four types of data analytics? Data analytics tools.

Data Analytics 135

Data Analytics Diagnostic Analytics Management Analytics 135

AWS Big Data

JULY 25, 2024

With CloudSearch, you can search large collections of data such as webpages, document files, forum posts, or product information. In addition, with OpenSearch Service, you get advanced security with fine-grained access control, the ability to store and analyze log data for observability and security, along with dashboarding and alerting.

Cost-Benefit 123

Cost-Benefit Machine Learning Dashboards Management 123

AWS Big Data

NOVEMBER 9, 2023

Building a data platform involves various approaches, each with its unique blend of complexities and solutions. In this post, we delve into a case study for a retail use case, exploring how the Data Build Tool (dbt) was used effectively within an AWS environment to build a high-performing, efficient, and modern data platform.

Data Warehouse 124

Data Warehouse Testing Data Quality Reporting 124

Jen Stirrup

NOVEMBER 30, 2021

In this session, we will start R right from the beginning, from installing R through to data transformation and integration, through to visualizing data by using R in PowerBI. Then, we will move towards powerful but simple to use datatypes in R such as data frames. CuRious about R in Power BI? I hope it is useful.

Dashboards 92

Dashboards Visualization Data Transformation Publishing 92

AWS Big Data

JANUARY 6, 2025

With Amazon AppFlow, you can run data flows at nearly any scale and at the frequency you chooseon a schedule, in response to a business event, or on demand. You can configure data transformation capabilities such as filtering and validation to generate rich, ready-to-use data as part of the flow itself, without additional steps.

Analytics 97

Analytics Data Warehouse Metrics Big Data 97

AWS Big Data

OCTOBER 11, 2023

Due to this low complexity, the solution uses AWS serverless services to ingest the data, transform it, and make it available for analytics. AWS Glue is a serverless data integration service that makes it easier to discover, prepare, move, and integrate data from multiple sources for analytics, ML, and application development.

Visualization 116

Visualization Dashboards Data-driven Gap analysis 116

Sisense

OCTOBER 15, 2020

We live in a world of data: There’s more of it than ever before, in a ceaselessly expanding array of forms and locations. Dealing with Data is your window into the ways data teams are tackling the challenges of this new world to help their companies and their customers thrive. Cleaning up dirty data. Step 4: Query.

Dashboards 98

Dashboards IoT Optimization Internet of Things 98

Cloudera

JULY 21, 2022

Cloudera users can securely connect Rill to a source of event stream data, such as Cloudera DataFlow , model data into Rill’s cloud-based Druid service, and share live operational dashboards within minutes via Rill’s interactive metrics dashboard or any connected BI solution. Data is made queryable in real time.

Metrics 87

Metrics Slice and Dice Data Warehouse Dashboards 87

DataKitchen

OCTOBER 25, 2022

Observability is a methodology for providing visibility of every journey that data takes from source to customer value across every tool, environment, data store, team, and customer so that problems are detected and addressed immediately. Data journey observability is the first step in implementing DataOps.

Testing 130

Testing Data-driven Visualization Dashboards 130

AWS Big Data

MAY 16, 2023

QuickSight meets varying analytics needs with modern interactive dashboards, paginated reports, natural language queries, ML-insights, and embedded analytics, from one unified service. The AWS Glue Data Catalog contains the table definitions for the smart sensor data sources stored in the S3 buckets.

Dashboards 92

Dashboards Statistics Data Collection Business Intelligence 92

AWS Big Data

JUNE 20, 2023

Kinesis Data Firehose is a fully managed service for delivering near-real-time streaming data to various destinations for storage and performing near-real-time analytics. You can perform analytics on VPC flow logs delivered from your VPC using the Kinesis Data Firehose integration with Datadog as a destination.

Dashboards 96

Dashboards Visualization Metrics Data Transformation 96

AWS Big Data

JANUARY 30, 2025

These include data discovery, modern ETL, cleansing, transforming, and centralized cataloging. We used it for executing long-running scripts, such as for ingesting data from an external API. We used it to define flows that would periodically load data from selected operational systems into our data warehouse.

Data Warehouse 52

Data Warehouse Data Architecture Machine Learning Data Transformation 52

Jen Stirrup

SEPTEMBER 30, 2021

Before we dive in, let’s define strands of AI, Machine Learning and Data Science: Business intelligence (BI) leverages software and services to transform data into actionable insights that inform an organization’s strategic and tactical business decisions. What does this mean for the Microsoft Data Platform Professional?

Business Intelligence 135

Business Intelligence Data mining Machine Learning Testing 135

Octopai

JUNE 9, 2024

.” The Data Strategy HealthCo, like many forward-thinking organizations, recognized early on that data is not just a valuable asset but a strategic imperative. They put data at the forefront of their business, integrating it into decision-making processes, products, and services. The lack of trust in data created inertia.

IT 52

IT Data-driven Predictive Analytics Data Strategy 52

AWS Big Data

FEBRUARY 6, 2023

Amazon QuickSight dashboards showcase the results from the analyzer. With QuickSight, you can visualize YARN log data and conduct analysis against the datasets generated by pre-built dashboard templates and a widget. This step creates datasets on QuickSight dashboards in your AWS target account.

Dashboards 91

Dashboards Optimization Data Lake Cost-Benefit 91

AWS Big Data

JANUARY 27, 2023

In this post, we show you how to use PCA’s data to build automated QuickSight dashboards for advanced analytics to assist in quality assurance (QA) and quality management (QM) processes. You can apply data, agent, call duration, and language filters for targeted search. Select -PCA-Dashboard and choose Share.

Analytics 71

Analytics Reporting Dashboards Visualization 71

AWS Big Data

NOVEMBER 13, 2023

Amazon Redshift is a fully managed data warehousing service that offers both provisioned and serverless options, making it more efficient to run and scale analytics without having to manage your data warehouse. Changing all interleaved key tables on the producer cluster to compound sortkey tables to seamlessly transition data.

Data Warehouse 109

Data Warehouse Analytics Data Lake Data Science 109

Sisense

OCTOBER 30, 2019

A critical part of effectively exploring your data, transforming it into actionable insights, and enhancing decision-making for your business is being empowered to slice and dice your data, and be less dependent on technical resources for new updates. Improved visibility into insights will enable you to get more out of them.

Data-driven 70

Data-driven Reporting Management Slice and Dice 70

AWS Big Data

AUGUST 1, 2024

However, you might face significant challenges when planning for a large-scale data warehouse migration. The data warehouse is highly business critical with minimal allowable downtime. Identify all upstream and downstream applications, as well as business processes that rely on the data warehouse.

Data Warehouse 107

Data Warehouse KPI Optimization Cost-Benefit 107

AWS Big Data

MAY 3, 2023

The key requirements for SOCAR included achieving maximum performance for real-time data analytics, which required storing data in an in-memory data store. After careful consideration, ElastiCache for Redis was selected as the optimal solution due to its ability to handle complex data aggregation rules with ease.

IoT 111

IoT Internet of Things Data Transformation Management 111

TDAN

DECEMBER 3, 2019

Data is the key to unlocking insight— the secret sauce that will help you get predictive, the fuel for business intelligence. The transformative potential in AI? It relies on data. The thing that powers your CRM, your monthly report, your Tableau dashboard. The good news is that data has never […].

Business Intelligence 72

Business Intelligence Dashboards Reporting Data Architecture 72

AWS Big Data

SEPTEMBER 5, 2024

Amazon Redshift , a warehousing service, offers a variety of options for ingesting data from diverse sources into its high-performance, scalable environment. It uses massively parallel processing (MPP) architecture in Amazon Redshift to read and load large amounts of data in parallel from files or data from supported data sources.

IoT 110

IoT Data Warehouse Cost-Benefit Reporting 110

Cloudera

NOVEMBER 29, 2021

Data transforms businesses. That’s where the data lifecycle comes into play. Managing data and its flow, from the edge to the cloud, is one of the most important tasks in the process of gaining data intelligence. . The firm also worked on creating a solid pipeline from the data warehouse to the data lake.

Data Lake 77

Data Lake Data Warehouse Data Architecture Reporting 77

AWS Big Data

MARCH 3, 2023

You can then apply transformations and store data in Delta format for managing inserts, updates, and deletes. Amazon EMR Serverless is a serverless option in Amazon EMR that makes it easy for data analysts and engineers to run open-source big data analytics frameworks without configuring, managing, and scaling clusters or servers.

Data Lake 96

Data Lake Dashboards Metrics Metadata 96