AWS Big Data

DECEMBER 9, 2024

This approach has been widely used in data warehouses to track changes in various dimensions such as customer information, product details, and employee data. In the example of the previous section, heres what the SCD Type-2 looks like assuming the update operation is performed on December 11, 2024.

Snapshot 64

Snapshot Data Warehouse Data Lake Data Quality 64

AWS Big Data

DECEMBER 4, 2024

This week on the keynote stages at AWS re:Invent 2024, you heard from Matt Garman, CEO, AWS, and Swami Sivasubramanian, VP of AI and Data, AWS, speak about the next generation of Amazon SageMaker , the center for all of your data, analytics, and AI. The relationship between analytics and AI is rapidly evolving.

Data Analytics 85

Data Analytics Analytics Data Lake Data Quality 85

Paul Turley

MARCH 18, 2024

As I write this in March of 2024, I'm at the Microsoft MVP Summit at the Microsoft campus in Redmond, Washington this week learning about what the product teams will be working on over the next year or so. I've been working with data and reporting solutions for about 30 years and have seen many products come and go.

Data Warehouse 128

Data Warehouse Data Processing Reporting Technology 128

David Menninger's Analyst Perspectives

OCTOBER 16, 2024

As I noted in the 2024 Buyers Guide for Operational Data Platforms , intelligent applications powered by artificial intelligence have impacted the requirements for operational data platforms. Traditionally, operational data platforms support applications used to run the business.

Internet of Things 214

Internet of Things Data-driven Data Warehouse Interactive 214

David Menninger's Analyst Perspectives

SEPTEMBER 19, 2024

In particular, the company made several announcements at its Snowflake Summit 2024 customer event in June that highlighted considerable advancements to its capabilities in relation to AI and GenAI. Snowflake was founded in 2012 to build a business around its cloud-based data warehouse with built-in data-sharing capabilities.

Data Warehouse 130

Data Warehouse Data Science Modeling Data Governance 130

AWS Big Data

NOVEMBER 26, 2024

This post was co-written with Dipankar Mazumdar, Staff Data Engineering Advocate with AWS Partner OneHouse. Data architecture has evolved significantly to handle growing data volumes and diverse workloads.

Metadata 94

Metadata Data Lake Snapshot Data Warehouse 94

AWS Big Data

DECEMBER 20, 2024

Amazon Q data integration , introduced in January 2024, allows you to use natural language to author extract, transform, load (ETL) jobs and operations in AWS Glue specific data abstraction DynamicFrame.

Data Integration 93

Data Integration Visualization Data Processing Big Data 93

David Menninger's Analyst Perspectives

OCTOBER 31, 2024

It was not until the addition of open table formats— specifically Apache Hudi, Apache Iceberg and Delta Lake—that data lakes truly became capable of supporting multiple business intelligence (BI) projects as well as data science and even operational applications and, in doing so, began to evolve into data lakehouses.

Data Lake 130

Data Lake Unstructured Data Data Warehouse Software 130

CIO Business Intelligence

NOVEMBER 27, 2024

Once the province of the data warehouse team, data management has increasingly become a C-suite priority, with data quality seen as key for both customer experience and business performance. But along with siloed data and compliance concerns , poor data quality is holding back enterprise AI projects.

Enterprise 141

Enterprise Data Quality Structured Data Modeling 141

Data Virtualization

JANUARY 25, 2024

Reading Time: 3 minutes As we head into 2024, it is imperative for data management leaders to look in their rear-view mirrors to assess and, if needed, refine their data management strategies.

Management 59

Management Data Integration Strategy Data Lake 59

Data Virtualization

FEBRUARY 6, 2025

Reading Time: 4 minutes In 2024, generative AI (GenAI) became top-of-mind, as companies began to leverage it for increased productivity. Additionally, storage continued to grow in capacity, epitomized by an optical disk designed to store a petabyte of data, and the global Internet population.

Data Integration 65

Data Integration Management Data Warehouse IT 65

Data Virtualization

MARCH 7, 2024

Reading Time: 3 minutes As we move deeper into 2024, it is imperative for data management leaders to look in their rear-view mirrors to assess and, if needed, refine their data management strategies. One thing is clear; if data-centric organizations want to succeed in.

Management 59

Management Data Integration Strategy Data Lake 59

AWS Big Data

SEPTEMBER 10, 2024

With the launch of Amazon Redshift Serverless and the various provisioned instance deployment options , customers are looking for tools that help them determine the most optimal data warehouse configuration to support their Amazon Redshift workloads. Enable audit logging following the guidance in Amazon Redshift Management Guide.

Testing 107

Testing Snapshot Data Warehouse Metrics 107

AWS Big Data

JUNE 19, 2024

Amazon Redshift is a fast, scalable, secure, and fully managed cloud data warehouse that makes it simple and cost-effective to analyze all your data using standard SQL and your existing ETL (extract, transform, and load), business intelligence (BI), and reporting tools. Tahir Aziz is an Analytics Solution Architect at AWS.

Data Warehouse 101

Data Warehouse Testing Sales Structured Data 101

CIO Business Intelligence

MARCH 26, 2024

Speaking at Mobile World Congress 2024 in Barcelona, Jason Cao, Huawei’s CEO of Digital Finance BU, acknowledged that digital financial services are “booming” and that the rise of open architecture as well as emerging technologies like generative AI will have an impact on key fields in the industry such as financial engagement and credit loans.

Strategy 59

Strategy Uncertainty Finance Data Warehouse 59

CIO Business Intelligence

JULY 30, 2024

IT analyst Forrester listed gen AI for language and AI agents as two of its top 10 emerging technologies for 2024. In early 2024, NVIDIA announced its AI-driven Clara computing platform targeting the healthcare industry and its BioNeMo, a gen AI platform for drug discovery.

Insurance 144

Insurance Machine Learning Interactive Finance 144

Data Virtualization

JANUARY 21, 2025

Reading Time: 2 minutes In 2024, generative AI (GenAI) has entered virtually every sphere of technology. However, companies are still struggling to manage data effectively, to implement GenAI applications that deliver proven business value. Gartner predicts that by the end of this year, 30%.

Management 52

Management Data Integration Technology Data Warehouse 52

FineReport

APRIL 21, 2024

Its interface combines spreadsheet-like usability with SQL power, enabling users to analyze data without coding. Sigma empowers users to break free from traditional dashboards and explore data independently for faster decision-making, leveraging the performance of cloud data warehouses for instant analysis.

Dashboards 52

Dashboards Visualization Interactive Business Intelligence 52

CIO Business Intelligence

MAY 16, 2022

The advent of distributed workforces, smart devices, and internet-of-things (IoT) applications is creating a deluge of data generated and consumed outside of traditional centralized data warehouses. How edge refines data strategy.

IoT 98

IoT Internet of Things Data Warehouse Machine Learning 98

AWS Big Data

SEPTEMBER 5, 2024

Federated queries allow querying data across Amazon RDS for MySQL and PostgreSQL data sources without the need for extract, transform, and load (ETL) pipelines. If storing operational data in a data warehouse is a requirement, synchronization of tables between operational data stores and Amazon Redshift tables is supported.

IoT 106

IoT Data Warehouse Cost-Benefit Reporting 106

AWS Big Data

AUGUST 21, 2024

The current scaling approach of Amazon Redshift Serverless increases your compute capacity based on the query queue time and scales down when the queuing reduces on the data warehouse. This post also includes example SQLs, which you can run on your own Redshift Serverless data warehouse to experience the benefits of this feature.

Optimization 88

Optimization Data Lake Data Warehouse Cost-Benefit 88

AWS Big Data

DECEMBER 4, 2024

With this new functionality, customers can create up-to-date replicas of their data from applications such as Salesforce, ServiceNow, and Zendesk in an Amazon SageMaker Lakehouse and Amazon Redshift. SageMaker Lakehouse gives you the flexibility to access and query your data in-place with all Apache Iceberg compatible tools and engines.

Data Integration 97

Data Integration Data Lake Statistics Data-driven 97

Dataiku

MAY 23, 2024

In 2024, being an intuition-driven business won't suffice; becoming a data-driven organization is the only path forward. Snowflake is a prominent leader in cloud-based data that is drastically reducing query times from hours to seconds and making cloud data warehouses accessible to both business users and data experts.

Data Warehouse 52

Data Warehouse Data-driven 52

AWS Big Data

JULY 29, 2024

Amazon DataZone is a powerful data management service that empowers data engineers, data scientists, product managers, analysts, and business users to seamlessly catalog, discover, analyze, and govern data across organizational boundaries, AWS accounts, data lakes, and data warehouses.

Data Warehouse 90

Data Warehouse Sales Metadata Publishing 90

CIO Business Intelligence

JUNE 12, 2024

The migration of approved workloads and applications to the cloud is set to be completed by October 2024 and has thus far been completed without any business disruption, he says.

Digital Transformation 116

Digital Transformation Cost-Benefit Forecasting Metrics 116

Paul Blogs on BI

MAY 13, 2024

Many BusinessObjects customers now use Cloud based data warehouses or data lakes and Snowflake is one of the most popular solutions chosen. By using the new Web Intelligence as a data source feature, you can dramatically reduce the number of times you would need to query your data warehouse.

Data Warehouse 52

Data Warehouse Data Lake Reporting Dashboards 52

CIO Business Intelligence

JANUARY 8, 2024

Cloud optimization is the new initiative in 2024,” says Rajeev Nair, general manager of IT infrastructure and security at Cathay, a major airliner and cargo carrier in the Asia-Pacific region, with headquarters in Hong Kong.

Optimization 119

Optimization Digital Transformation Cost-Benefit Data Warehouse 119

AWS Big Data

SEPTEMBER 4, 2024

In February 2024, we announced the release of the Data Solutions Framework (DSF) , an opinionated open source framework for building data solutions on AWS. In this post, we demonstrate how to use the AWS CDK and DSF to create a multi-data warehouse platform based on Amazon Redshift Serverless.

Management 69

Management Data Warehouse Data Lake Testing 69

AWS Big Data

AUGUST 8, 2024

For instance, consider a scenario where a user requests the estimated size of app com.demo and event af_purchase between April 2024 and end of June 2024 (as illustrated earlier, the segmentation is defined by the user and then translated to an atomic leaf, which is then broken down to multiple queries depending on the date range).

Interactive 117

Interactive Metadata Optimization Testing 117

AWS Big Data

MARCH 7, 2024

At the same time, they need to optimize operational costs to unlock the value of this data for timely insights and do so with a consistent performance. With this massive data growth, data proliferation across your data stores, data warehouse, and data lakes can become equally challenging.

Data Lake 124

Data Lake Analytics Dashboards Metrics 124

CIO Business Intelligence

SEPTEMBER 18, 2024

Per esempio, si può estrarre, trasformare e caricare i dati da Zendesk al data warehouse utilizzando strumenti per l’orchestrazione dei dati orchestration che evitano molte operazioni manuali che possono diventare anche molto impegnative.

Data Warehouse 64

Data Warehouse ROI Management Data-driven 64

Paul Blogs on BI

JULY 8, 2024

Well IBIS 2024, the BusinessObjects event of the year, was just brilliant. The sessions were outstanding, the keynotes inspiring, the interactions compelling and the BI 2025 test drives exciting. It really was the best IBIS ever! Once again, my favorite part was the compelling customer case studies, and this year was exceptional.

Dashboards 52

Dashboards Data Warehouse Business Intelligence Data-driven 52

IBM Big Data Hub

NOVEMBER 8, 2023

We are expanding IBM Db2 Warehouse on Power with a new Base Rack Express at a 30% lower entry list price, adding to today’s S, M and L configurations, while still providing the same total-solution experience, including Db2 Data Warehouse’s connectivity with watsonx.data to unlock the potential of data for analytics and AI.

Data-driven 93

Data-driven Strategy Data Warehouse Cost-Benefit 93

CIO Business Intelligence

APRIL 22, 2024

Il recepimento deve avvenire entro il 17 ottobre 2024 e le imprese sono chiamate, fin da ora, a verificare che i propri sistemi siano “a norma”. Ma tutti gli elementi dell’IT concorrono a costruire una robusta cybersecurity, perché sono collegati tra loro.

Data Lake 105

Data Lake Testing Management IoT 105

AWS Big Data

MARCH 11, 2024

Amazon Redshift is a fully managed, scalable cloud data warehouse that accelerates your time to insights with fast, straightforward, and secure analytics at scale. Tens of thousands of customers rely on Amazon Redshift to analyze exabytes of data and run complex analytical queries, making it the most widely used cloud data warehouse.

Analytics 72

Analytics Data Warehouse Optimization Metrics 72

IBM Big Data Hub

FEBRUARY 19, 2024

In 2023, the global data monetization market was valued at USD 3.5 from 2024 to 2032. Treating data as a strategic asset Data is one of the most valuable intangible assets for organizations. Therefore, adopting a holistic approach that prioritizes data-driven business transformation helps optimize value extraction.

Cost-Benefit 63

Cost-Benefit Data-driven Optimization Marketing 63

AWS Big Data

MAY 24, 2023

delete.tags.delete-tag-name":"deleted" : xxxxxx@3c22fb1238d8 ~ % aws s3api get-object-tagging --bucket avijit-iceberg-storage-blog --key iceberg/db/amazon_reviews_iceberg/data/review_date_year=2023/00000-43-2fb892e3-0a3f-4821-a356-83204a69fa74-00001.parquet show() The snapshots that have expired show the latest snapshot ID as null.

Data Lake 91

Data Lake Snapshot Metadata Optimization 91