Domino Data Lab

OCTOBER 7, 2020

The Curse of Dimensionality , or Large P, Small N, ((P >> N)) , problem applies to the latter case of lots of variables measured on a relatively few number of samples. Statistical methods for analyzing this two-dimensional data exist. This statistical test is correct because the data are (presumably) bivariate normal.

Statistics 145

Statistics Testing Predictive Modeling Big Data 145

AWS Big Data

MARCH 22, 2024

Table and column statistics were not present for any of the tables. The following graph shows performance improvements measured by the total query runtime (in seconds) for the benchmark queries. However, table statistics are often not available, out of date, or too expensive to collect on large tables.

Metadata 105

Metadata Statistics Broadcasting Optimization 105

datapine

FEBRUARY 23, 2023

2) Charts And Graphs Categories 3) 20 Different Types Of Graphs And Charts 4) How To Choose The Right Chart Type Data and statistics are all around us. That said, there is still a lack of charting literacy due to the wide range of visuals available to us and the misuse of statistics. Table of Contents 1) What Are Graphs And Charts?

Visualization 177

Visualization Dashboards Sales Measurement 177

datapine

MAY 2, 2019

In our example above, we are showing Sales by Payment Method for all of 2014. In the example above, the story isn’t about the total number of customers aged 15-25, but that 22% of the customers were 15-25 in the first quarter of 2014 (and 26% in Q4). With a table, you can display a large number of precise measures and dimensions.

Visualization 173

Visualization Dashboards Sales Data-driven 173

Data Science and Beyond

OCTOBER 15, 2017

Here are my thoughts from 2014 on defining data science as the intersection of software engineering and statistics , and a more recent post on defining data science in 2018. The hardest parts of data science are problem definition and solution measurement, not model fitting and data cleaning , because counting things is hard.

Data Science 71

Data Science Deep Learning Machine Learning Data-driven 71

The Unofficial Google Data Science Blog

APRIL 17, 2017

First, the system may not be understood, and even if it was understood it may be extremely difficult to measure the relationships that are assumed to govern its behavior. For this simple vignette, we might regard $X_1$ and $X_2$ as errors from a measuring scale and note that $X_2$ is not as precise an instrument as $X_1$. OTexts, 2014.

Forecasting 83

Forecasting Modeling Statistics Uncertainty 83

The Unofficial Google Data Science Blog

APRIL 23, 2024

the weight given to Likes in our video recommendation algorithm) while $Y$ is a vector of outcome measures such as different metrics of user experience (e.g., Taking measurements at parameter settings further from control parameter settings leads to a lower variance estimate of the slope of the line relating the metric to the parameter.

Experimentation 52

Experimentation Optimization Uncertainty Metrics 52