Smart Data Collective

AUGUST 14, 2019

According to the IDC (International Data Corporation) study , the volume of big data will increase faster in healthcare than it will in other fields like manufacturing, financial services, and entertainment. However, the major concern they have when moving to the cloud is the lack of control over where their data is kept.

Big Data 101

Big Data Data Analytics Analytics Internet of Things 101

AWS Big Data

JULY 14, 2023

In this post, we discuss how the Amazon Finance Automation team used AWS Lake Formation and the AWS Glue Data Catalog to build a data mesh architecture that simplified data governance at scale and provided seamless data access for analytics, AI, and machine learning (ML) use cases.

Finance 98

Finance Metadata Big Data Recreation/Entertainment 98

Domino Data Lab

JULY 2, 2019

Apache Spark innovated on integrating a wide range of different data sources and sinks, especially for unstructured data, and structuring the “applications code” as SQL statements, with their result sets becoming DataFrames. Data-related events to mark on your calendars: spaCy IRL , Jul 5-6, Berlin. With me so far?

Metadata 105

Metadata Machine Learning Data Science Data-driven 105

Cloudera

NOVEMBER 12, 2020

Inability to maintain context – This is the worst of them all because every time a data set or workload is re-used, you must recreate its context including security, metadata, and governance. Alternatively, you can also spin up a different compute cluster and access the data by using CDP’s Shared Data Experience.

Data Warehouse 104

Data Warehouse Reporting Risk Cost-Benefit 104

AWS Big Data

FEBRUARY 19, 2024

Collaborate on live data with ease The are times when two teams use different warehouses for data governance, compute performance, or cost reasons, but also at times need to write to the same shared data. We use the publicly available 10 GB TPCH dataset from AWS Labs, hosted in an S3 bucket.

Cost-Benefit 115

Cost-Benefit Data Warehouse Marketing Interactive 115