AWS Big Data

AUGUST 9, 2024

After the read query validation stage was complete and we were satisfied with the performance, we reconnected our orchestrator so that the data transformation queries could be run in the new cluster. Do you want to know more about what we’re doing in the data area at Dafiti?

Data Lake 111

Data Lake Analytics Data Warehouse Data-driven 111

AWS Big Data

DECEMBER 21, 2023

The data products from the Business Vault and Data Mart stages are now available for consumers. smava decided to use Tableau for business intelligence, data visualization, and further analytics. The data transformations are managed with dbt to simplify the workflow governance and team collaboration.

Data Lake 115

Data Lake Data Warehouse Data-driven B2B 115

IBM Big Data Hub

APRIL 14, 2023

The implementation process was done in several stages, from January 2019 and until August 2022, with product profitability being added in the final phase. In August 2022, they implemented product profitability by allocating common costs at the product and channel level, which provided immediate management decision-making capabilities.

Forecasting 67

Forecasting Sales Dashboards Reporting 67

AWS Big Data

APRIL 25, 2024

Alternatively, you can use AWS Glue for Apache Spark, which provides built-in support for bucketing configurations during the data transformation process. AWS Glue allows you to define bucketing parameters, such as the number of buckets and the columns to bucket on, providing an optimized data layout for efficient querying with Athena.

Optimization 72

Optimization Data Lake Cost-Benefit Reporting 72

AWS Big Data

MAY 25, 2023

Data transformation plays a pivotal role in providing the necessary data insights for businesses in any organization, small and large. To gain these insights, customers often perform ETL (extract, transform, and load) jobs from their source systems and output an enriched dataset. 1X 1 4 16 64 G.2X 2X 2 8 32 128 G.4X

Reporting 97

Reporting Metrics Optimization Data Lake 97

AWS Big Data

MARCH 3, 2023

You can then apply transformations and store data in Delta format for managing inserts, updates, and deletes. Amazon EMR Serverless is a serverless option in Amazon EMR that makes it easy for data analysts and engineers to run open-source big data analytics frameworks without configuring, managing, and scaling clusters or servers.

Data Lake 98

Data Lake Dashboards Metrics Metadata 98

AWS Big Data

APRIL 5, 2023

The company also used the opportunity to reimagine its data pipeline and architecture. A key architectural decision that Showpad took during this time was to create a portable data layer by decoupling the data transformation from visualization, ML, or ad hoc querying tools and centralizing its business logic.

Dashboards 52

Dashboards Reporting Cost-Benefit Visualization 52

AWS Big Data

NOVEMBER 14, 2024

We use the built-in features of Data Firehose, including AWS Lambda for necessary data transformation and Amazon Simple Notification Service (Amazon SNS) for near real-time alerts. Data Architect at AWS. He has helped customers build scalable data warehousing and big data solutions for over 20 years.

Data Lake 105

Data Lake Metadata Testing Data-driven 105