AWS Big Data

SEPTEMBER 11, 2024

This post describes how HPE Aruba automated their Supply Chain management pipeline, and re-architected and deployed their data solution by adopting a modern data architecture on AWS. The new solution has helped Aruba integrate data from multiple sources, along with optimizing their cost, performance, and scalability.

Data Architecture 110

Data Architecture Optimization Data Warehouse Metadata 110

Cloudera

SEPTEMBER 6, 2022

Data has continued to grow both in scale and in importance through this period, and today telecommunications companies are increasingly seeing data architecture as an independent organizational challenge, not merely an item on an IT checklist. Why telco should consider modern data architecture. The challenges.

Data Architecture 84

Data Architecture Cost-Benefit Digital Transformation Business Driver 84

datapine

AUGUST 20, 2019

Operations data: Data generated from a set of operations such as orders, online transactions, competitor analytics, sales data, point of sales data, pricing data, etc. The gigantic evolution of structured, unstructured, and semi-structured data is referred to as Big data. Big Data Ingestion.

Big Data 100

Big Data B2B Cost-Benefit Structured Data 100

Smart Data Collective

AUGUST 9, 2019

Big data in the gaming industry has played a phenomenal role in the field. We have previously talked about the benefits of using big data by gaming providers that offer cash games, such as slots. However, more mainstream games use big data as well. Big Data is the Lynchpin of the Fortnite Gaming Experience.

Big Data 98

Big Data Data Lake Data Architecture Machine Learning 98

TDAN

JANUARY 5, 2022

The world now runs on Big Data. Defined as information sets too large for traditional statistical analysis, Big Data represents a host of insights businesses can apply towards better practices. But what exactly are the opportunities present in big data? In manufacturing, this means opportunity.

Manufacturing 89

Manufacturing Big Data Statistics Data Processing 89

DataKitchen

DECEMBER 30, 2020

DBTA Big Data Quarterly’s Big Data 50—Companies Driving Innovation in 2020. CRN’s The 10 Coolest Big Data Startups of 2020. DataKitchen and its DataKitchen DataOps platform have been attracting attention in the emerging realm of data operations or “DataOps.”.

Testing 241

Testing Big Data Statistics Manufacturing 241

AWS Big Data

NOVEMBER 14, 2024

The landscape of big data management has been transformed by the rising popularity of open table formats such as Apache Iceberg, Apache Hudi, and Linux Foundation Delta Lake. These formats, designed to address the limitations of traditional data storage systems, have become essential in modern data architectures.

Metadata 122

Metadata Data Warehouse Big Data Data Lake 122

Cloudera

JULY 29, 2022

Corporations are generating unprecedented volumes of data, especially in industries such as telecom and financial services industries (FSI). However, not all these organizations will be successful in using data to drive business value and increase profits. Is yours among the organizations hoping to cash in big with a big data solution?

Data Architecture 89

Data Architecture Data Strategy Risk Management Strategy 89

IBM Big Data Hub

MAY 21, 2019

A modern data architecture (MDA) must support the next generation cognitive enterprise which is characterized by the ability to fully exploit data using exponential technologies like pervasive artificial intelligence (AI) , automation, Internet of Things (IoT) and blockchain.

Data Architecture 76

Data Architecture Internet of Things IoT Enterprise 76

AWS Big Data

NOVEMBER 22, 2024

This enables you to extract insights from your data without the complexity of managing infrastructure. dbt has emerged as a leading framework, allowing data teams to transform and manage data pipelines effectively. Selman Ay is a Data Architect in the AWS Professional Services team.

Data Lake 102

Data Lake Data Warehouse Cost-Benefit Data Transformation 102

CIO Business Intelligence

OCTOBER 13, 2023

Data architecture is a complex and varied field and different organizations and industries have unique needs when it comes to their data architects. Solutions data architect: These individuals design and implement data solutions for specific business needs, including data warehouses, data marts, and data lakes.

Data Architecture 132

Data Architecture Data Warehouse Statistics Visualization 132

TDAN

OCTOBER 21, 2020

The term “big data” has been bandied about for a number of years now, and it has gotten to the point where it has been used so much that it is a part of IT culture. It’s hard to specifically define, yet everyone seems to have a good idea what is meant by it; big […].

Big Data 69

Big Data IT Data Architecture Data Strategy 69

AWS Big Data

APRIL 12, 2024

Today’s fast-paced world demands timely insights and decisions, which is driving the importance of streaming data. Streaming data refers to data that is continuously generated from a variety of sources.

Data Architecture 119

Data Architecture IoT Internet of Things Recreation/Entertainment 119

IBM Big Data Hub

JANUARY 5, 2023

Several factors determine the quality of your enterprise data like accuracy, completeness, consistency, to name a few. But there’s another factor of data quality that doesn’t get the recognition it deserves: your data architecture. How the right data architecture improves data quality.

Data Architecture 52

Data Architecture Data Quality Strategy Data Lake 52

AWS Big Data

JANUARY 6, 2025

He has helped customers build scalable data warehousing and big data solutions for over 16 years. He has worked with building data warehouses and big data solutions for over 13 years. He specializes in migrating enterprise data warehouses to AWS Modern Data Architecture.

Analytics 98

Analytics Data Warehouse Metrics Big Data 98

AWS Big Data

NOVEMBER 7, 2024

He has helped customers build scalable data warehousing and big data solutions for over 16 years. He has over 13 years of professional experience building and optimizing enterprise data warehouses and is passionate about enabling customers to realize the power of their data.

Data Warehouse 105

Data Warehouse Reporting Big Data Data Lake 105

AWS Big Data

DECEMBER 4, 2024

SageMaker brings together widely adopted AWS ML and analytics capabilities—virtually all of the components you need for data exploration, preparation, and integration; petabyte-scale big data processing; fast SQL analytics; model development and training; governance; and generative AI development.

Data Analytics 103

Data Analytics Analytics Data Lake Data Quality 103

AWS Big Data

OCTOBER 30, 2024

Users can begin ingesting data to Redshift from Amazon S3 with simple SQL commands and gain access to the most up-to-date data without the need for third-party tools or custom implementation. He has worked with building data warehouses and big data solutions for over 15+ years.

Data Warehouse 109

Data Warehouse Sales Data Lake Recreation/Entertainment 109

AWS Big Data

NOVEMBER 8, 2024

He has worked with building data warehouses and big data solutions for over 15+ years. He has over 13 years of professional experience building and optimizing enterprise data warehouses and is passionate about enabling customers to realize the power of their data. Outside of work, he enjoys traveling and cooking.

Data Lake 105

Data Lake Data Warehouse Optimization Testing 105

AWS Big Data

APRIL 29, 2024

The construction of big data applications based on open source software has become increasingly uncomplicated since the advent of projects like Data on EKS , an open source project from AWS to provide blueprints for building data and machine learning (ML) applications on Amazon Elastic Kubernetes Service (Amazon EKS).

Management 116

Management Big Data Data Warehouse Metadata 116

AWS Big Data

DECEMBER 4, 2024

While traditional extract, transform, and load (ETL) processes have long been a staple of data integration due to its flexibility, for common use cases such as replication and ingestion, they often prove time-consuming, complex, and less adaptable to the fast-changing demands of modern data architectures.

Data Integration 114

Data Integration Data Lake Statistics Data-driven 114

AWS Big Data

JANUARY 15, 2025

Need for a data mesh architecture Because entities in the EUROGATE group generate vast amounts of data from various sourcesacross departments, locations, and technologiesthe traditional centralized data architecture struggles to keep up with the demands for real-time insights, agility, and scalability.

IoT 111

IoT Machine Learning Metadata Data-driven 111

AWS Big Data

NOVEMBER 26, 2024

This post was co-written with Dipankar Mazumdar, Staff Data Engineering Advocate with AWS Partner OneHouse. Data architecture has evolved significantly to handle growing data volumes and diverse workloads. For more examples and references to other posts on using XTable on AWS, refer to the following GitHub repository.

Metadata 105

Metadata Data Lake Snapshot Data Warehouse 105

AWS Big Data

DECEMBER 12, 2024

He has over 17 years of experience architecting, building, leading, and maintaining big data platforms. Rohit helps customers modernize their analytic workloads using the breadth of AWS services and ensures that customers get the best price/performance with utmost security and data governance.

Data Warehouse 98

Data Warehouse Cost-Benefit Data Lake Data Architecture 98

AWS Big Data

OCTOBER 17, 2024

He is deeply passionate about Data Architecture and helps customers build analytics solutions at scale on AWS. Get ready to elevate your search and analytics skills and be part of shaping the future of this channel and powerful service.

Analytics 115

Analytics Optimization Data-driven Data Architecture 115

AWS Big Data

APRIL 3, 2024

They understand that a one-size-fits-all approach no longer works, and recognize the value in adopting scalable, flexible tools and open data formats to support interoperability in a modern data architecture to accelerate the delivery of new solutions. Andries has over 20 years of experience in the field of data and analytics.

Data Lake 125

Data Lake Snapshot Metadata Data Architecture 125

Cloudera

JUNE 7, 2022

Big data is cool again. As the company who taught the world the value of big data, we always knew it would be. But this is not your grandfather’s big data. It has evolved into something new – hybrid data. For Cloudera this is a back to the future moment. Fuel growth with speed and control.

IT 112

IT Data Architecture Unstructured Data Big Data 112

AWS Big Data

JANUARY 24, 2023

He has over 12 years of professional experience building and optimizing enterprise data warehouses and is passionate about enabling customers to realize the power of their data. He specializes in migrating enterprise data warehouses to AWS Modern Data Architecture.

Data Architecture 92

Data Architecture Metadata Data Lake Snapshot 92

AWS Big Data

NOVEMBER 27, 2024

His role is to help customers architect big data solutions to process data at scale. Before AWS, he helped Amazon.com Supply Chain Optimization Technologies migrate its Oracle data warehouse to Amazon Redshift and build its next generation big data analytics platform using AWS technologies.

Data Warehouse 109

Data Warehouse Analytics Testing Modeling 109

Data Virtualization

OCTOBER 5, 2022

Reading Time: 3 minutes At the heart of every organization lies a data architecture, determining how data is accessed, organized, and used. For this reason, organizations must periodically revisit their data architectures, to ensure that they are aligned with current business goals.

Data Lake 52

Data Lake Data Architecture Data Integration Management 52

BizAcuity

APRIL 14, 2022

Big Data technology in today’s world. Did you know that the big data and business analytics market is valued at $198.08 Or that the US economy loses up to $3 trillion per year due to poor data quality? quintillion bytes of data which means an average person generates over 1.5 Big Data Ecosystem.

Big Data 52

Big Data Data Analytics Management Analytics 52

TDAN

JUNE 15, 2022

Choosing the right database for your business-related data could make or break how well you understand your customers and the larger business landscape. Qualities such as speed, scalability, how it responds in specific use cases, and the ability to integrate with third-party software are all important deciding factors.

Big Data 72

Big Data Software Data Architecture IT 72

AWS Big Data

FEBRUARY 26, 2025

The Gartner Magic Quadrant evaluates 20 data integration tool vendors based on two axesAbility to Execute and Completeness of Vision. Discover, prepare, and integrate all your data at any scale AWS Glue is a fully managed, serverless data integration service that simplifies data preparation and transformation across diverse data sources.

Data Integration 100

Data Integration Data Lake Data Warehouse Unstructured Data 100

AWS Big Data

OCTOBER 30, 2024

This is part two of a three-part series where we show how to build a data lake on AWS using a modern data architecture. This post shows how to load data from a legacy database (SQL Server) into a transactional data lake ( Apache Iceberg ) using AWS Glue.

Data Lake 105

Data Lake Data Processing Optimization Machine Learning 105

CIO Business Intelligence

JUNE 23, 2022

Big data is cool again. As the company who taught the world the value of big data, we always knew it would be. But this is not your grandfather’s big data. It has evolved into something new – hybrid data. Sure we can help you secure, manage, and analyze PetaBytes of structured and unstructured data.

IT 97

IT Data Architecture Unstructured Data Big Data 97

CIO Business Intelligence

MARCH 9, 2022

But the data repository options that have been around for a while tend to fall short in their ability to serve as the foundation for big data analytics powered by AI. Traditional data warehouses, for example, support datasets from multiple sources but require a consistent data structure.

Data Lake 119

Data Lake Unstructured Data Data Warehouse Big Data 119

Cloudera

JUNE 13, 2024

There were thousands of attendees at the event – lining up for book signings and meetings with recruiters to fill the endless job openings for developers experienced with MapReduce and managing Big Data. This was the gold rush of the 21st century, except the gold was data.

Big Data 103

Big Data Machine Learning Contextual Data Data Lake 103