Data Science and Beyond

JUNE 2, 2017

Last year, I wrote about the Reef Life Survey (RLS) project and my experience with offline data collection on the Great Barrier Reef. Since publishing that post, I have improved the flashcards and built a tool for exploring the aggregate survey data. The RLS manual includes all the details on how surveys are performed.

Data Collection 58

Data Collection Testing Data Processing Publishing 58

Alation

AUGUST 26, 2021

Data intelligence first emerged to support search & discovery, largely in service of analyst productivity. For years, analysts in enterprises had struggled to find the data they needed to build reports. This problem was only exacerbated by explosive growth in data collection and volume. HBR Review May/June 2017.

Metadata 64

Metadata Data Governance Dashboards Software 64

IBM Big Data Hub

MAY 26, 2023

According to a report on mapping the cloud maturity curve from the EIU , 48% of industry executives said cloud has improved data access, analysis and utilization, 45% say cloud has sped up delivery of new IT services and capabilities, and 44% say cloud has expanded sales channels across digital avenues.

Consulting 73

Consulting Cost-Benefit Machine Learning Optimization 73

Domino Data Lab

OCTOBER 23, 2019

The first step to collecting all of the data is to figure out which data source to collect first, and where to get it. Knowing that the ultimate goal is to compare the social-media influence and power of NBA players, a great place to start is with the roster of the NBA players in the 2016–2017 season. 35,vjust=1).

Statistics 59

Statistics Machine Learning Testing Modeling 59

Domino Data Lab

MAY 8, 2019

The lens of reductionism and an overemphasis on engineering becomes an Achilles heel for data science work. Instead, consider a “full stack” tracing from the point of data collection all the way out through inference. Finale Doshi-Velez, Been Kim (2017-02-28) ; see also the Domino blog article about TCAV. 2018-06-21).

Machine Learning 105

Machine Learning Data Science Modeling Visualization 105

Domino Data Lab

AUGUST 1, 2021

After forming the X and y variables, we split the data into training and test sets. Looking at the target vector in the training subset, we notice that our training data is highly imbalanced. All we need to do is instantiate LimeTabularExplainer and give it access to the training data and the independent feature names.

Modeling 139

Modeling Deep Learning Machine Learning Knowledge Discovery 139

Occam's Razor

SEPTEMBER 15, 2014

In this post we will look mobile sites first, both data collection and analysis, and then mobile applications. Analyze your needs carefully, buy for now and the near future rather than for 2017, lest you spend all the time until 2017 on implementation, customization, reporting and re-implementation.

Metrics 143

Metrics Reporting Analytics Marketing 143

The Unofficial Google Data Science Blog

JULY 18, 2023

Measurement challenges Assessing reliability is essentially a process of data collection and analysis. To do this, we collect multiple measurements for each unit of observation, and we determine if these measurements are closely related. In this case, the scale is not measuring the construct that interests us.

Measurement 52

Measurement Metrics Uncertainty Slice and Dice 52