AWS Big Data

MARCH 6, 2025

In todays data-driven world, securely accessing, visualizing, and analyzing data is essential for making informed business decisions. The Amazon Redshift Data API simplifies access to your Amazon Redshift data warehouse by removing the need to manage database drivers, connections, network configurations, data buffering, and more.

Visualization 102

Visualization Sales Data Warehouse Management 102

Smart Data Collective

DECEMBER 13, 2022

Technology is quickly becoming a critical component of our existence. However, computerization in the digital age creates massive volumes of data, which has resulted in the formation of several industries, all of which rely on data and its ever-increasing relevance. Data analytics and visualization help with many such use cases.

Visualization 145

Visualization Key Performance Indicator Sales Advertising 145

AWS Big Data

SEPTEMBER 13, 2023

The Analytics specialty practice of AWS Professional Services (AWS ProServe) helps customers across the globe with modern data architecture implementations on the AWS Cloud. In this post, we discuss a common use case in relation to operational data processing and the solution we built using Apache Hudi and AWS Glue.

Data Lake 111

Data Lake Data Processing Metadata Snapshot 111

AWS Big Data

SEPTEMBER 13, 2024

CFM takes a scientific approach to finance, using quantitative and systematic techniques to develop the best investment strategies. Using social network data has also often been cited as a potential source of data to improve short-term investment decisions.

Interactive 109

Interactive Strategy Cost-Benefit Data Governance 109

CIO Business Intelligence

APRIL 12, 2023

By George Trujillo, Principal Data Strategist, DataStax I recently had a conversation with a senior executive who had just landed at a new organization. He had been trying to gather new data insights but was frustrated at how long it was taking. Real-time AI involves processing data for making decisions within a given time frame.

Machine Learning 145

Machine Learning Cost-Benefit Data-driven Strategy 145

CIO Business Intelligence

APRIL 29, 2022

This first article emphasizes data as the ‘foundation-stone’ of AI-based initiatives. Establishing a Data Foundation. Software development, once solely the domain of human programmers, is now increasingly the by-product of data being carefully selected, ingested, and analysed by machine learning (ML) systems in a recurrent cycle.

Data Governance 145

Data Governance IT Risk Data Lake 145

Cloudera

JULY 26, 2021

With this first article of the two-part series on data product strategies, I am presenting some of the emerging themes in data product development and how they inform the prerequisites and foundational capabilities of an Enterprise data platform that would serve as the backbone for developing successful data product strategies.

Strategy 119

Strategy Data Science Unstructured Data Marketing 119

AWS Big Data

FEBRUARY 27, 2024

In the ever-evolving world of finance and lending, the need for real-time, reliable, and centralized data has become paramount. Bluestone , a leading financial institution, embarked on a transformative journey to modernize its data infrastructure and transition to a data-driven organization.

Data-driven 111

Data-driven Data Lake Data Quality Data Governance 111

AWS Big Data

JANUARY 17, 2024

With Amazon EMR 6.15, we launched AWS Lake Formation based fine-grained access controls (FGAC) on Open Table Formats (OTFs), including Apache Hudi, Apache Iceberg, and Delta lake. Many large enterprise companies seek to use their transactional data lake to gain insights and improve decision-making.

Data Lake 116

Data Lake Snapshot Big Data Data-driven 116

CIO Business Intelligence

AUGUST 12, 2022

The rapid growth left the company highly dependent on fragmented, manual processes and disparate data sources and systems. So, we have a lot of disparate systems across our company — ERPs, CRMs, middleware — but our go-to-market strategy for our customers, you have to make that all invisible for them.”. Catalyzing change.

IT 105

IT Data Lake Sales Machine Learning 105

AWS Big Data

NOVEMBER 29, 2023

dbt is an open source, SQL-first templating engine that allows you to write repeatable and extensible data transforms in Python and SQL. dbt is predominantly used by data warehouses (such as Amazon Redshift ) customers who are looking to keep their data transform logic separate from storage and engine.

Data Lake 122

Data Lake Management Metrics Data Warehouse 122

Cloudera

DECEMBER 11, 2020

The Data Security and Governance category, at the annual Data Impact Awards, has never been so important. The sudden rise in remote working, a huge influx in data as the world turned digital, not to mention the never-ending list of regulations businesses need to remain compliant with (how many acronyms can you name in full?

Data Lake 98

Data Lake Cost-Benefit Unstructured Data Data Governance 98

AWS Big Data

JULY 20, 2023

With data becoming the driving force behind many industries today, having a modern data architecture is pivotal for organizations to be successful. In this post, we describe Orca’s journey building a transactional data lake using Amazon Simple Storage Service (Amazon S3), Apache Iceberg, and AWS Analytics.

Data Lake 98

Data Lake Analytics Snapshot Data Quality 98

AWS Big Data

MARCH 3, 2023

Building data lakes from continuously changing transactional data of databases and keeping data lakes up to date is a complex task and can be an operational challenge. You can then apply transformations and store data in Delta format for managing inserts, updates, and deletes. with Apache Spark version 3.3.0)

Data Lake 98

Data Lake Dashboards Metrics Metadata 98

AWS Big Data

JUNE 21, 2023

In traditional databases, we would model such applications using a normalized data model (entity-relation diagram). Storing different types of data in a single table allows you to retrieve multiple, heterogeneous item types using a single request. These types of queries are suited for a data warehouse.

Data Warehouse 105

Data Warehouse Data Lake OLAP Cost-Benefit 105

CIO Business Intelligence

JULY 31, 2024

For Melanie Kalmar, the answer is data literacy and a strong foundation in tech. How do data and digital technologies impact your business strategy? At the core, digital at Dow is about changing how we work, which includes how we interact with systems, data, and each other to be more productive and to grow.

Manufacturing 122

Manufacturing Cost-Benefit Digital Transformation Forecasting 122

AWS Big Data

MAY 7, 2024

Data governance is a key enabler for teams adopting a data-driven culture and operational model to drive innovation with data. Amazon DataZone allows you to simply and securely govern end-to-end data assets stored in your Amazon Redshift data warehouses or data lakes cataloged with the AWS Glue data catalog.

Metadata 107

Metadata Data Lake Data Processing Data-driven 107

AWS Big Data

AUGUST 19, 2024

In today’s data-driven world, the ability to seamlessly integrate and utilize diverse data sources is critical for gaining actionable insights and driving innovation. Use case Consider a large ecommerce company that relies heavily on data-driven insights to optimize its operations, marketing strategies, and customer experiences.

Analytics 119

Analytics Data-driven Data Integration Data Lake 119

CIO Business Intelligence

NOVEMBER 28, 2023

Making the most of enterprise data is a top concern for IT leaders today. With organizations seeking to become more data-driven with business decisions, IT leaders must devise data strategies gear toward creating value from data no matter where — or in what form — it resides.

Unstructured Data 130

Unstructured Data Data-driven Visualization Data Quality 130

CIO Business Intelligence

JANUARY 10, 2024

Optimizing cloud investments requires close collaboration with the rest of the business to understand current and future needs, building effective FinOps teams, partnering with providers, and ongoing monitoring of key performance metrics. Over the years, McMasters bought overcapacity and hoped he had enough. Then there’s housekeeping.

Cost-Benefit 124

Cost-Benefit Measurement Optimization Metrics 124

Octopai

AUGUST 24, 2022

From mesh to data mesh. The term “mesh”’s latest appearance is in the concept of data mesh , coined by Zhamak Dehghani in her landmark 2019 article, How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh. How is data mesh a mesh? . For years, centralization was the direction of data management.

Strategy 92

Strategy Data-driven Sales Enterprise 92

AWS Big Data

JULY 13, 2023

Altron is a pioneer of providing data-driven solutions for their customers by combining technical expertise with in-depth customer understanding to provide highly differentiated technology solutions. This is a guest post co-authored by Jacques Steyn, Senior Manager Professional Services at Altron Group.

Optimization 98

Optimization B2B Data Quality Sales 98

Cloudera

OCTOBER 6, 2022

In reflecting on these definitions, I particularly like how Gartner highlights legacy modernization as a common component of such initiatives, noting that digital transformation can be more about digitization than transformation. The key here is prioritization, iteration, and execution excellence. Strategies to maximize impact.

Digital Transformation 90

Digital Transformation Cost-Benefit Data Lake Machine Learning 90

AWS Big Data

MARCH 26, 2024

This view is used to identify patterns and trends in customer behavior, which can inform data-driven decisions to improve business outcomes. In this post, we discuss how you can use purpose-built AWS services to create an end-to-end data strategy for C360 to unify and govern customer data that address these challenges.

Data Strategy 99

Data Strategy Strategy Data Warehouse Prescriptive Analytics 99

AWS Big Data

MAY 1, 2024

To transform Fujitsu from an IT company to a digital transformation (DX) company, and to become a world-leading DX partner, Fujitsu has declared a shift to data-driven management. To achieve data-driven management, we built OneData, a data utilization platform used in the four global AWS Regions, which started operation in April 2022.

Dashboards 124

Dashboards Publishing Data-driven Cost-Benefit 124

AWS Big Data

OCTOBER 4, 2023

Amazon DataZone enables customers to discover, access, share, and govern data at scale across organizational boundaries, reducing the undifferentiated heavy lifting of making data and analytics tools accessible to everyone in the organization. Then we explain the benefits of Amazon DataZone and walk you through key features.

Metadata 119

Metadata Data Lake Publishing Data Governance 119

IBM Big Data Hub

JULY 5, 2023

Data Lakes have been around for well over a decade now, supporting the analytic operations of some of the largest world corporations. Such data volumes are not easy to move, migrate or modernize. The challenges of a monolithic data lake architecture Data lakes are, at a high level, single repositories of data at scale.

Data Lake 60

Data Lake Metadata Cost-Benefit Data Warehouse 60

AWS Big Data

MAY 16, 2023

In today’s digital age, logging is a critical aspect of application development and management, but efficiently managing logs while complying with data protection regulations can be a significant challenge. The exact length of time required for data storage varies depending on the specific regulation and the type of data being stored.

Data Lake 101

Data Lake Cost-Benefit Optimization Testing 101

Cloudera

JUNE 16, 2022

Every large enterprise organization is attempting to accelerate their digital transformation strategies to engage with their customers in a more personalized, relevant, and dynamic way. The ability to perform analytics on data as it is created and collected (a.k.a. Faster data ingestion: streaming ingestion pipelines.

Data Lake 88

Data Lake Manufacturing Metadata Dashboards 88

Cloudera

JANUARY 30, 2024

With the ability of manufacturers to store a huge volume of historical data, AI can be applied in general business areas of any industry, like developing recommendations for marketing, supply chain optimization, and new product development. With AI, it can even prescribe the appropriate action that needs to be taken and when.

Manufacturing 81

Manufacturing Contextual Data IoT Internet of Things 81

Alation

MAY 16, 2023

Data is a valuable resource, especially in the world of business. But with the sheer amount of data continually increasing, how can a business make sense of it? Robust data pipelines. What is a Data Pipeline? What is a Data Pipeline? The end result is data that is ready to be analyzed. The answer?

Data Lake 69

Data Lake Data Governance Data Warehouse Data Processing 69

AWS Big Data

APRIL 11, 2023

Forecasting is another critical component of effective inventory management. Such a solution should use the latest technologies, including Internet of Things (IoT) sensors, cloud computing, and machine learning (ML), to provide accurate, timely, and actionable data. The solution includes the following components.

Forecasting 98

Forecasting Management IoT Data-driven 98

Cloudera

FEBRUARY 4, 2019

Late last year, the news of the merger between Hortonworks and Cloudera shook the industry and gave birth to the new Cloudera – the combined company with a focus on being an Enterprise Data Cloud leader and a product offering that spans from edge to AI. So, what happens to HDF in the new Cloudera? What should customers expect?

IoT 73

IoT Prescriptive Analytics Internet of Things Digital Transformation 73

BizAcuity

APRIL 1, 2023

Thanks to the recent technological innovations and circumstances to their rapid adoption, having a data warehouse has become quite common in various enterprises across sectors. Data governance and security measures are critical components of data strategy. What is Business Intelligence?

Business Intelligence 52

Business Intelligence Consulting KPI Data Warehouse 52

BizAcuity

JANUARY 31, 2023

Thanks to the recent technological innovations and circumstances to their rapid adoption, having a data warehouse has become quite common in various enterprises across sectors. Data governance and security measures are critical components of data strategy. What is Business Intelligence?

Business Intelligence 52

Business Intelligence Consulting KPI Data Warehouse 52

Sisense

MAY 11, 2021

You can’t talk about data analytics without talking about data modeling. The reasons for this are simple: Before you can start analyzing data, huge datasets like data lakes must be modeled or transformed to be usable. Building the right data model is an important part of your data strategy.

Modeling 84

Modeling Big Data IoT Data Warehouse 84

Alation

JULY 28, 2022

There was a time when most CIOs would never consider putting their crown jewels — AKA customer data and associated analytics — into the cloud. As enterprises migrate to the cloud, two key questions emerge: What’s driving this change? As enterprises migrate to the cloud, two key questions emerge: What’s driving this change?

Data Warehouse 69

Data Warehouse Cost-Benefit Data-driven Data Governance 69