Remove topic
article thumbnail

30+ Big Data Interview Questions

Analytics Vidhya

Introduction In the realm of Big Data, professionals are expected to navigate complex landscapes involving vast datasets, distributed systems, and specialized tools.

Big Data 333
article thumbnail

Window Functions – A Must-Know Topic for Data Engineers and Data Scientists

Analytics Vidhya

The post Window Functions – A Must-Know Topic for Data Engineers and Data Scientists appeared first on Analytics Vidhya. Overview Get to know about the SQL Window Functions Understand what the Aggregate functions lack and why we need Window Functions in SQL.

Analytics 333
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Core technologies and tools for AI, big data, and cloud computing

O'Reilly on Data

Many companies are just beginning to address the interplay between their suite of AI, big data, and cloud technologies. I’ll also highlight some interesting uses cases and applications of data, analytics, and machine learning. Data Platforms. Data Integration and Data Pipelines. Model lifecycle management.

Big Data 271
article thumbnail

Build multi-Region resilient Apache Kafka applications with identical topic names using Amazon MSK and Amazon MSK Replicator

AWS Big Data

With Amazon MSK Replicator , you can build multi-Region resilient streaming applications to provide business continuity, share data with partners, aggregate data from multiple clusters for analytics, and serve global clients with reduced latency. During a failover, consumers might reprocess some messages from Kafka topics.

Metrics 107
article thumbnail

Data Ingestion Featuring AWS

Analytics Vidhya

This article was published as a part of the Data Science Blogathon. Introduction Big Data is everywhere, and it continues to be a gearing-up topic these days. And Data Ingestion is a process that assists a group or management to make sense of the ever-increasing volume and complexity of data and provide useful insights.

Big Data 354
article thumbnail

Diving Deeper into the Data Lake

David Menninger's Analyst Perspectives

A data lake is a centralized repository designed to house big data in structured, semi-structured and unstructured form. I have been covering the data lake topic for several years and encourage you to check out an earlier perspective called Data Lakes: Safe Way to Swim in Big Data?

Data Lake 352
article thumbnail

Hive Advance: Performance Tuning Techniques

Analytics Vidhya

This article was published as a part of the Data Science Blogathon. Introduction In this article, we will discuss advanced topics in hives which are required for Data-Engineering. Whenever we design a Big-data solution and execute hive queries on clusters it is the responsibility of a developer to optimize the hive queries.

Big Data 367