AWS Big Data

NOVEMBER 17, 2023

Starting today, the Athena SQL engine uses a cost-based optimizer (CBO), a new feature that uses table and column statistics stored in the AWS Glue Data Catalog as part of the table’s metadata. By using these statistics, CBO improves query run plans and boosts the performance of queries run in Athena.

Optimization 124

Optimization Statistics Metadata Data Lake 124

Domino Data Lab

AUGUST 8, 2019

The gist is, leveraging metadata about research datasets, projects, publications, etc., Consider the following timeline: 2001 – Physics grad students are getting hired in quantity by hedge funds to work on Wall St. then building machine learning models to recommend methods and potential collaborators to scientists.

Data Science 71

Data Science Machine Learning Data Governance Statistics 71

Domino Data Lab

JULY 22, 2019

He was saying this doesn’t belong just in statistics. It involved a lot of work with applied math, some depth in statistics and visualization, and also a lot of communication skills. I can point to the year 2001. It was also the year, 2001, when “ Agile Manifesto ” was published. Tukey did this paper.

Data Science 109

Data Science Machine Learning Data Governance Modeling 109