AWS Big Data

DECEMBER 21, 2023

This is a guest post co-written by Alex Naumov, Principal Data Architect at smava. smava believes in and takes advantage of data-driven decisions in order to become the market leader. smava believes in and takes advantage of data-driven decisions in order to become the market leader.

Data Lake 103

Data Lake Data Warehouse Data-driven B2B 103

Sisense

JULY 22, 2020

We live in a world of data: there’s more of it than ever before, in a ceaselessly expanding array of forms and locations. Dealing with Data is your window into the ways organizations tackle the challenges of this new world to help their companies and their customers thrive. Understanding how data becomes insights.

Slice and Dice 98

Slice and Dice Digital Transformation Data Warehouse Data Lake 98

AWS Big Data

AUGUST 27, 2024

Director of Product, Salesforce Data Cloud. In today’s ever-evolving business landscape, organizations must harness and act on data to fuel analytics, generate insights, and make informed decisions to deliver exceptional customer experiences. What is Salesforce Data Cloud? What is Amazon Redshift?

Data Lake 95

Data Lake Analytics Data-driven Management 95

CIO Business Intelligence

OCTOBER 25, 2023

Our recent data analysis of AI/ML trends and usage confirms this: enterprises across industries have substantially increased their use of generative AI, across many kinds of AI tools. Once shared, this data can be fed into the data lakes used to train large language models (LLMs) and can be discovered by other users.

Enterprise 133

Enterprise Manufacturing Risk Data-driven 133

AWS Big Data

MAY 30, 2024

Amazon Redshift is a fast, scalable, and fully managed cloud data warehouse that allows you to process and run your complex SQL analytics workloads on structured and semi-structured data. Both the API and data store had to support a highly volatile workload pattern.

Data Warehouse 99

Data Warehouse Data Lake Cost-Benefit Structured Data 99

Sisense

JUNE 30, 2020

Everyone wants to get more out of their data, but how exactly to do that can leave you scratching your head. In a world increasingly dominated by data, users of all kinds are gathering, managing, visualizing, and analyzing data in a wide variety of ways. Data visualization: painting a picture of your data.

Visualization 93

Visualization Analytics Dashboards Data-driven 93

AWS Big Data

NOVEMBER 22, 2023

Today, we’re making available a new capability of AWS Glue Data Catalog that allows generating column-level statistics for AWS Glue tables. Data lakes are designed for storing vast amounts of raw, unstructured, or semi-structured data at a low cost, and organizations share those datasets across multiple departments and teams.

Statistics 113

Statistics Data Lake Optimization Data-driven 113

Sisense

OCTOBER 6, 2020

Digging into quantitative data Why is quantitative data important What are the problems with quantitative data Exploring qualitative data Qualitative data benefits Getting the most from qualitative data Better together. Almost every modern organization is now a data-generating machine. or “how often?”

Statistics 98

Statistics Unstructured Data Data-driven Visualization 98

AWS Big Data

MARCH 25, 2024

FMs are multimodal; they work with different data types such as text, video, audio, and images. Large language models (LLMs) are a type of FM and are pre-trained on vast amounts of text data and typically have application uses such as text generation, intelligent chatbots, or summarization.

Data Lake 104

Data Lake Unstructured Data Management Snapshot 104

Cloudera

JULY 26, 2021

With this first article of the two-part series on data product strategies, I am presenting some of the emerging themes in data product development and how they inform the prerequisites and foundational capabilities of an Enterprise data platform that would serve as the backbone for developing successful data product strategies.

Strategy 119

Strategy Data Science Unstructured Data Marketing 119

IBM Big Data Hub

JANUARY 18, 2023

Data platform architecture has an interesting history. A read-optimized platform that can integrate data from multiple applications emerged. In another decade, the internet and mobile started the generate data of unforeseen volume, variety and velocity. It required a different data platform solution. It is too expensive.

Data Lake 52

Data Lake Data Warehouse Data-driven Metadata 52

Cloudera

SEPTEMBER 12, 2022

It sounds straightforward: you just need data and the means to analyze it. The data is there, in spades. Data volumes have been growing for years and are predicted to reach 175 ZB by 2025. First, organizations have a tough time getting their arms around their data. Unified data fabric. Yes and no.

Unstructured Data 75

Unstructured Data Data Architecture Data Lake Snapshot 75

AWS Big Data

JANUARY 22, 2024

The company uses AWS Cloud services to build data-driven products and scale engineering best practices. To ensure a sustainable data platform amid growth and profitability phases, their tech teams adopted a decentralized data mesh architecture. The solution Acast implemented is a data mesh, architected on AWS.

Data-driven 99

Data-driven Advertising Metadata Data Architecture 99

AWS Big Data

AUGUST 31, 2023

Data warehousing provides a business with several benefits such as advanced business intelligence and data consistency. Nowadays, more verification steps are applied to source data before processing them which so often add an administration overhead.

Data Warehouse 95

Data Warehouse Data-driven Testing Business Intelligence 95

Cloudera

NOVEMBER 15, 2024

In fact, according to the Identity Theft Resource Center (ITRC) Annual Data Breach Report , there were 2,365 cyber attacks in 2023 with more than 300 million victims, and a 72% increase in data breaches since 2021. However, there is a fundamental challenge standing in the way of being successful: data.

Analytics 59

Analytics Metadata Snapshot Data-driven 59

Sisense

MAY 11, 2021

You can’t talk about data analytics without talking about data modeling. The reasons for this are simple: Before you can start analyzing data, huge datasets like data lakes must be modeled or transformed to be usable. Building the right data model is an important part of your data strategy.

Modeling 84

Modeling Big Data IoT Data Warehouse 84

AWS Big Data

OCTOBER 2, 2023

Organizations are grappling with the ever-expanding spectrum of data formats in today’s data-driven landscape. From Avro’s binary serialization to the efficient and compact structure of Protobuf, the landscape of data formats has expanded far beyond the traditional realms of CSV and JSON.

Cost-Benefit 99

Cost-Benefit Metadata Structured Data Data-driven 99

AWS Big Data

APRIL 20, 2023

Customers use Amazon Redshift to run their business-critical analytics on petabytes of structured and semi-structured data. Apache Spark enables you to build applications in a variety of languages, such as Java, Scala, and Python, by accessing the data in your Amazon Redshift data warehouse.

Data Lake 84

Data Lake Data Warehouse Sales Data-driven 84

AWS Big Data

JUNE 6, 2023

SumUp is a leading global financial technology company driven by the purpose of leveling the playing field for small businesses. Unless, of course, the rest of their data also resides in the Google Cloud. AWS Glue gave us a cost-efficient option to migrate the data and we further optimized storage cost by pruning cold data.

Analytics 59

Analytics Data Lake Testing Optimization 59

IBM Big Data Hub

APRIL 25, 2023

In a prior blog , we pointed out that warehouses, known for high-performance data processing for business intelligence, can quickly become expensive for new data and evolving workloads. To do so, Presto and Spark need to readily work with existing and modern data warehouse infrastructures. Some use case examples will help.

Optimization 56

Optimization Strategy Data Warehouse Cost-Benefit 56

AWS Big Data

APRIL 4, 2024

Amazon Redshift is a recommended service for online analytical processing (OLAP) workloads such as cloud data warehouses, data marts, and other analytical data stores. You can use simple SQL to analyze structured and semi-structured data, operational databases, and data lakes to deliver the best price/performance at any scale.

Big Data 77

Big Data Data Warehouse Advertising OLAP 77

CIO Business Intelligence

DECEMBER 4, 2023

Although less complex than the “4 Vs” of big data (velocity, veracity, volume, and variety), orienting to the variety and volume of a challenging puzzle is similar to what CIOs face with information management. Operationalizing data to drive revenue CIOs report that their roles are rising in importance and impact. What’s changed?

Unstructured Data 52

Unstructured Data Data Lake Business Objectives Metadata 52

AWS Big Data

MARCH 26, 2024

This view is used to identify patterns and trends in customer behavior, which can inform data-driven decisions to improve business outcomes. In this post, we discuss how you can use purpose-built AWS services to create an end-to-end data strategy for C360 to unify and govern customer data that address these challenges.

Data Strategy 78

Data Strategy Strategy Data Warehouse Prescriptive Analytics 78

BizAcuity

MARCH 1, 2019

IoT is basically an exchange of data or information in a connected or interconnected environment. As IoT devices generate large volumes of data, AI is functionally necessary to make sense of this data. Data is only useful when it is actionable for which it needs to be supplemented with context and creativity.

IoT 56

IoT Internet of Things Big Data Data-driven 56

Octopai

MAY 30, 2019

If the point of Business Intelligence (BI) data governance is to leverage your datasets to support information transparency and decision-making, then it’s fair to say that the data catalog is key for your BI strategy. At least, as far as data analysis is concerned. The Benefits of Structured Data Catalogs.

Metadata 40

Metadata Data Governance Data Lake IoT 40

Peter James Thomas

AUGUST 29, 2018

Today I am talking to Christopher Bannocks , who is Group Chief Data Officer at ING. As stressed in other recent In-depth interviews [1] , data is a critical asset in banking and related activities, so Christopher’s role is a pivotal one. 2] I was asked to help solve the data problem.

Data-driven 61

Data-driven Cost-Benefit Metadata Technology 61

Ontotext

MARCH 8, 2023

Gartner predicts that graph technologies will be used in 80% of data and analytics innovations by 2025, up from 10% in 2021. Use Case #1: Customer 360 / Enterprise 360 Customer data is typically spread across multiple applications, departments, and regions. Several factors are driving the adoption of knowledge graphs. million users.

Enterprise 52

Enterprise Knowledge Discovery Risk Machine Learning 52

Alation

OCTOBER 21, 2021

Data Swamp vs Data Lake. When you imagine a lake, it’s likely an idyllic image of a tree-ringed body of reflective water amid singing birds and dabbling ducks. I’ll take the lake, thank you very much. I’ll take the lake, thank you very much. And so will your data. Benefits of a Data Lake.

Data Lake 52

Data Lake Metadata Data Warehouse Data Governance 52

Corinium

APRIL 25, 2019

Ahead of the Chief Data Analytics Officers & Influencers, Insurance event we caught up with Dominic Sartorio, Senior Vice President for Products & Development, Protegrity to discuss how the industry is evolving. The last 10+ years or so have seen Insurance become as data-driven as any vertical industry.

Insurance 150

Insurance Risk IoT Data-driven 150

Jet Global

MAY 9, 2024

A data pipeline is a series of processes that move raw data from one or more sources to one or more destinations, often transforming and processing the data along the way. Data pipelines support data science and business intelligence projects by providing data engineers with high-quality, consistent, and easily accessible data.

Data Lake 52

Data Lake Data Warehouse Business Intelligence Machine Learning 52

CIO Business Intelligence

DECEMBER 9, 2024

Streamlining workflows and boosting productivity The next set of re:Invent announcements focused on streamlining workflows for enterprises and helping businesses boost the productivity of developers and data professionals. AWS announced that it will unify analytics and AI services under its SageMaker service.

Metadata 116

Metadata Unstructured Data Data Lake Data-driven 116

AWS Big Data

DECEMBER 19, 2024

Data lakes were originally designed to store large volumes of raw, unstructured, or semi-structured data at a low cost, primarily serving big data and analytics use cases. Enabling automatic compaction on Iceberg tables reduces metadata overhead on your Iceberg tables and improves query performance.

Data Lake 91

Data Lake IoT Metadata Testing 91

Cloudera

NOVEMBER 15, 2024

In fact, according to the Identity Theft Resource Center (ITRC) Annual Data Breach Report , there were 2,365 cyber attacks in 2023 with more than 300 million victims, and a 72% increase in data breaches since 2021. However, there is a fundamental challenge standing in the way of being successful: data.

Analytics 84

Analytics Metadata Snapshot Data-driven 84

BI-Survey

FEBRUARY 27, 2025

A Checklist to Challenge Your Vendor At first glance, data catalogs might seem like straightforward tools for organizing information an apparently mundane task. However, a closer look reveals that these systems are far more than simple repositories: Data catalogs are at the forefront of bringing AI into your business for at least two reasons.

Unstructured Data 52

Unstructured Data Metadata Data Quality Data Governance 52

AWS Big Data

OCTOBER 30, 2024

This is the final part of a three-part series where we show how to build a data lake on AWS using a modern data architecture. This post shows how to process data with Amazon Redshift Spectrum and create the gold (consumption) layer. The following diagram illustrates the different layers of the data lake.

Data Lake 72

Data Lake Machine Learning Data Architecture Data-driven 72

AWS Big Data

NOVEMBER 14, 2024

Key services in the solution include Amazon API Gateway , Amazon Data Firehose , and Amazon Location Service. The challenge In the event of a disaster e.g. water flood, there is usually a lack of terrestrial data connectivity that prevents monitoring stations from taking actionable measures in real time.

Data Lake 93

Data Lake Metadata Testing Data-driven 93