Remove tribal-knowledge-problem
article thumbnail

Eight Top DataOps Trends for 2022

DataKitchen

The problem is that algorithms can absorb and perpetuate racial, gender, ethnic and other social inequalities and deploy them at scale. The data industry realizes that AI bias is simply a quality problem, and AI systems should be subject to this same level of process control as an automobile rolling off an assembly line.

Testing 245
article thumbnail

The Tribal Knowledge Problem

TDAN

A recent report on data culture released by Alation shows that enterprises continue to make progress toward creating a data culture even while the pandemic has forced them to make tough decisions. Nearly all respondents report having lost personnel due to economic concerns. But things are looking up.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

DataOps Facilitates Remote Work

DataKitchen

Tools determine their approach to solving problems. The processes and workflows that depend on individuals with tribal knowledge huddling to solve problems are nearly impossible to execute through video conferences. Tools influence their optimal iteration cycle time, e.g., months/weeks/days.

Testing 147
article thumbnail

10 DataOps Principles for Overcoming Data Engineer Burnout

DataKitchen

When there is a problem in data pipelines, data engineers are expected to fix it using ad hoc processes that simply will not scale. There’s an unending wave of problems: customer requests, broken systems, and errors. One problem is that data engineers are seen as a cost minimization role instead of a generator of value.

Testing 246
article thumbnail

DataOps For Business Analytics Teams

DataKitchen

Instead of throwing people and budgets at problems, DataOps offers a way to utilize automation to systematize analytics workflows. Many large enterprises allow consultants and employees to keep tribal knowledge about the data architecture in their heads. In business analytics, fire-fighting and stress are common. Conclusion.

article thumbnail

Alation State of Data Culture Report: Bad Data Spells Trouble for AI

Alation

the tribal knowledge problem ). Subscribe to Alation's Blog. So naturally, the survey found that nearly nine out of ten respondents are somewhat or more concerned about inherent biases being used in AI to produce discriminatory output. Get the latest data cataloging news and trends in your inbox.

Reporting 105
article thumbnail

DataOps Observability: Taming the Chaos (Part 2)

DataKitchen

Observability is a methodology for providing visibility of every journey that data takes from source to customer value across every tool, environment, data store, team, and customer so that problems are detected and addressed immediately. But when there’s a problem, you need to know how these relationships could amplify it.

Testing 130