AWS Big Data

NOVEMBER 14, 2024

The landscape of big data management has been transformed by the rising popularity of open table formats such as Apache Iceberg, Apache Hudi, and Linux Foundation Delta Lake. These formats, designed to address the limitations of traditional data storage systems, have become essential in modern data architectures.

Metadata 121

Metadata Data Warehouse Big Data Data Lake 121

CIO Business Intelligence

OCTOBER 13, 2023

The data architect also “provides a standard common business vocabulary, expresses strategic requirements, outlines high-level integrated designs to meet those requirements, and aligns with enterprise strategy and related business architecture,” according to DAMA International’s Data Management Body of Knowledge.

Data Architecture 132

Data Architecture Data Warehouse Statistics Visualization 132

AWS Big Data

OCTOBER 17, 2024

He is deeply passionate about Data Architecture and helps customers build analytics solutions at scale on AWS. Wendy Neu is a Senior Manager at AWS focused on leading the NoSQL Specialist Solutions Architecture team worldwide.

Analytics 115

Analytics Optimization Data-driven Data Architecture 115

IBM Big Data Hub

SEPTEMBER 6, 2023

According to the IBM survey, when CMOs were asked what they thought the primary challenges were in adopting generative AI, they listed three top concerns: managing the complexity of implementation, building the data set and brand and intellectual property (IP) risk. With the right generative AI strategy, marketers can mitigate these concerns.

Marketing 112

Marketing Strategy B2B Cost-Benefit 112

AWS Big Data

APRIL 29, 2024

The construction of big data applications based on open source software has become increasingly uncomplicated since the advent of projects like Data on EKS , an open source project from AWS to provide blueprints for building data and machine learning (ML) applications on Amazon Elastic Kubernetes Service (Amazon EKS).

Management 115

Management Big Data Data Warehouse Metadata 115

TDAN

OCTOBER 21, 2020

The term “big data” has been bandied about for a number of years now, and it has gotten to the point where it has been used so much that it is a part of IT culture. It’s hard to specifically define, yet everyone seems to have a good idea what is meant by it; big […].

Big Data 69

Big Data IT Data Architecture Data Strategy 69

IBM Big Data Hub

APRIL 10, 2023

A well-designed data architecture should support business intelligence and analysis, automation, and AI—all of which can help organizations to quickly seize market opportunities, build customer value, drive major efficiencies, and respond to risks such as supply chain disruptions.

Strategy 85

Strategy Data Architecture Cost-Benefit Reporting 85

Cloudera

JUNE 7, 2022

Big data is cool again. As the company who taught the world the value of big data, we always knew it would be. But this is not your grandfather’s big data. It has evolved into something new – hybrid data. Where data flows, ideas follow. Today, we are leading the way in hybrid data.

IT 112

IT Data Architecture Unstructured Data Big Data 112

IBM Big Data Hub

APRIL 11, 2023

Data and AI governance’s role A proper technology mix can be crucial to an effective data and AI governance strategy, with a modern data architecture such as data fabric being a key component.

Strategy 87

Strategy Data Architecture Data-driven Testing 87

TDAN

SEPTEMBER 17, 2019

Did you know that 90% of all data has been generated over the last 2 years? Big Data has been an important topic in the marketing scene for quite some time. It has been a major challenge for Chief Marketing Officers (CMOs) because it’s not easy to organize and extract useful insights from massive amounts of […].

Big Data 68

Big Data Marketing Data Architecture IT 68

CIO Business Intelligence

NOVEMBER 28, 2023

Still, to truly create lasting value with data, organizations must develop data management mastery. This means excelling in the under-the-radar disciplines of data architecture and data governance. Contributing to the general lack of data about data is complexity. Seven individuals raised their hands.

Management 131

Management Data Architecture Data Lake Data Strategy 131

Octopai

AUGUST 24, 2022

The term “mesh”’s latest appearance is in the concept of data mesh , coined by Zhamak Dehghani in her landmark 2019 article, How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh. How is data mesh a mesh? . Let’s take a look at some must-have components of a data mesh strategy. Well, no. .

Strategy 92

Strategy Data-driven Sales Enterprise 92

IBM Big Data Hub

JUNE 18, 2019

In my last blog , I stressed the need for a modern data architecture (MDA) to underpin the next generation of the cognitive enterprise , fully harness data using the latest technologies, and sustain a

Data Strategy 86

Data Strategy Strategy Data Architecture Enterprise 86

CIO Business Intelligence

JUNE 23, 2022

Big data is cool again. As the company who taught the world the value of big data, we always knew it would be. But this is not your grandfather’s big data. It has evolved into something new – hybrid data. Sure we can help you secure, manage, and analyze PetaBytes of structured and unstructured data.

IT 97

IT Data Architecture Unstructured Data Big Data 97

AWS Big Data

MARCH 26, 2024

A Gartner Marketing survey found only 14% of organizations have successfully implemented a C360 solution, due to lack of consensus on what a 360-degree view means, challenges with data quality, and lack of cross-functional governance structure for customer data.

Data Strategy 92

Data Strategy Strategy Data Warehouse Prescriptive Analytics 92

CIO Business Intelligence

MARCH 9, 2022

But the data repository options that have been around for a while tend to fall short in their ability to serve as the foundation for big data analytics powered by AI. Traditional data warehouses, for example, support datasets from multiple sources but require a consistent data structure.

Data Lake 119

Data Lake Unstructured Data Data Warehouse Big Data 119

AWS Big Data

JANUARY 24, 2023

Implementing it across Regions (multi-Region) is a good option if you are looking for the most separation and complete independence of your globally diverse data workloads. Implementing and operating this strategy, particularly using multi-Region, can be more complicated and more expensive, than other DR strategies.

Data Architecture 88

Data Architecture Metadata Data Lake Snapshot 88

AWS Big Data

OCTOBER 30, 2024

This is part two of a three-part series where we show how to build a data lake on AWS using a modern data architecture. This post shows how to load data from a legacy database (SQL Server) into a transactional data lake ( Apache Iceberg ) using AWS Glue.

Data Lake 105

Data Lake Data Processing Optimization Machine Learning 105

BizAcuity

APRIL 14, 2022

Big Data technology in today’s world. Did you know that the big data and business analytics market is valued at $198.08 Or that the US economy loses up to $3 trillion per year due to poor data quality? quintillion bytes of data which means an average person generates over 1.5 Big Data Ecosystem.

Big Data 52

Big Data Data Analytics Management Analytics 52

Cloudera

JUNE 13, 2024

There were thousands of attendees at the event – lining up for book signings and meetings with recruiters to fill the endless job openings for developers experienced with MapReduce and managing Big Data. This was the gold rush of the 21st century, except the gold was data.

Big Data 103

Big Data Machine Learning Contextual Data Data Lake 103

erwin

OCTOBER 24, 2019

Untapped data, if mined, represents tremendous potential for your organization. While there has been a lot of talk about big data over the years, the real hero in unlocking the value of enterprise data is metadata , or the data about the data. Addressing the Complexities of Metadata Management.

Metadata 104

Metadata Management Data-driven Data Architecture 104

TDAN

DECEMBER 3, 2019

When it comes to marketing, business owners need to be fast in adjusting their strategies to fit the continuous advancement in technologies. Today, nearly everyone has a mobile phone or another smart mobile device with them at all times.

Marketing 64

Marketing Strategy Statistics Technology 64

Cloudera

NOVEMBER 18, 2020

In fact, each of the 29 finalists represented organizations running cutting-edge use cases that showcase a winning enterprise data cloud strategy. The technological linchpin of its digital transformation has been its Enterprise Data Architecture & Governance platform.

Internet Publishing and Broadcasting 123

Internet Publishing and Broadcasting Data-driven Broadcasting Digital Transformation 123

Cloudera

DECEMBER 1, 2023

One notable example of a government initiative that has shaped the AI landscape is the United States’ federal AI strategy. Launched in 2019, this strategy aims to position the US as a leader in AI research, development, and deployment. This strategy has spurred a wave of AI innovation within the public sector.

Data Governance 109

Data Governance Data-driven Strategy Data Architecture 109

AWS Big Data

MARCH 10, 2023

Since the deluge of big data over a decade ago, many organizations have learned to build applications to process and analyze petabytes of data. Data lakes have served as a central repository to store structured and unstructured data at any scale and in various formats.

Data Lake 122

Data Lake Sales Data Warehouse Snapshot 122

IBM Big Data Hub

JUNE 30, 2022

The rise of data strategy. There’s a renewed interest in reflecting on what can and should be done with data, how to accomplish those goals and how to check for data strategy alignment with business objectives. The evolution of a multi-everything landscape, and what that means for data strategy.

Data Strategy 56

Data Strategy Strategy Business Objectives Data-driven 56

AWS Big Data

AUGUST 1, 2024

Effective planning, thorough risk assessment, and a well-designed migration strategy are crucial to mitigating these challenges and implementing a successful transition to the new data warehouse environment on Amazon Redshift. The success criteria are the key performance indicators (KPIs) for each component of the data workflow.

Data Warehouse 113

Data Warehouse KPI Optimization Cost-Benefit 113

CIO Business Intelligence

SEPTEMBER 14, 2023

They’re often responsible for building algorithms for accessing raw data, too, but to do this, they need to understand a company’s or client’s objectives, as aligning data strategies with business goals is important, especially when large and complex datasets and databases are involved.

Analytics 135

Analytics Data Science Unstructured Data Data mining 135

AWS Big Data

JUNE 10, 2024

A modern data strategy redefines and enables sharing data across the enterprise and allows for both reading and writing of a singular instance of the data using an open table format. As mentioned previously, data was partitioned by day and most queries ran on a specific time range.

Data Lake 126

Data Lake Metadata Snapshot Analytics 126

Cloudera

FEBRUARY 22, 2022

Over the past decade, the successful deployment of large scale data platforms at our customers has acted as a big data flywheel driving demand to bring in even more data, apply more sophisticated analytics, and on-board many new data practitioners from business analysts to data scientists.

Snapshot 110

Snapshot Metadata Cost-Benefit Data Architecture 110

CIO Business Intelligence

MARCH 24, 2023

Data governance framework Data governance may best be thought of as a function that supports an organization’s overarching data management strategy. Such a framework provides your organization with a holistic approach to collecting, managing, securing, and storing data.

Data Governance 142

Data Governance Management Metadata Data Quality 142

TDAN

DECEMBER 17, 2019

Data is commonly referred to as the new oil, a resource so immensely powerful that its true potential is yet to be discovered. We haven’t achieved enough with data research and other statistical modeling techniques to be able to see data for what it truly is and even our methods of accruing data are rudimentary […].

Data Architecture 52

Data Architecture Statistics Modeling IT 52

CIO Business Intelligence

AUGUST 9, 2022

Data engineers are often responsible for building algorithms for accessing raw data, but to do this, they need to understand a company’s or client’s objectives, as aligning data strategies with business goals is important, especially when large and complex datasets and databases are involved. Becoming a data engineer.

Analytics 131

Analytics Data Science Statistics Unstructured Data 131

AWS Big Data

MARCH 6, 2025

About the Authors Songzhi Liu is a Principal Big Data Architect with the AWS Identity Solutions team. He has over 19 years of experience architecting, building, leading, and maintaining big data platforms. She has experience in product vision and strategy in industry-leading data products and platforms.

Visualization 87

Visualization Sales Data Warehouse Management 87

AWS Big Data

JUNE 12, 2024

One Data Platform The ODP architecture is based on the AWS Well Architected Framework Analytics Lens and follows the pattern of having raw, standardized, conformed, and enriched layers as described in Modern data architecture. As a columnar database, it’s particularly well suited for consumer-oriented data products.

Data Architecture 115

Data Architecture Cost-Benefit Data-driven Experimentation 115

CIO Business Intelligence

SEPTEMBER 20, 2023

And in charge of the group’s technological strategy and digitalization processes is global CIO Vanessa Escrivá. The personalization of services and products is going to be fundamental in the insurance sector,” she says, an aspect she’s spearheading, along with a commitment to data and AI. The third pillar of our strategy is data.

Modeling 98

Modeling Insurance IT Cost-Benefit 98

Cloudera

SEPTEMBER 26, 2023

IBM and Cloudera’s common goal is to accelerate data-driven decision making for enterprise customers, working on defining and executing the best solution for each customer. You can now elevate your data potential and activate AI’s capabilities through the synergic integration between IBM watsonx and Cloudera.

Technology 95

Technology IT Data-driven Data Architecture 95