Remove 2012 Remove Data Lake Remove Interactive
article thumbnail

How Volkswagen streamlined access to data across multiple data lakes using Amazon DataZone – Part 1

AWS Big Data

Over the years, organizations have invested in creating purpose-built, cloud-based data lakes that are siloed from one another. A major challenge is enabling cross-organization discovery and access to data across these multiple data lakes, each built on different technology stacks.

Data Lake 116
article thumbnail

Introducing Amazon Q data integration in AWS Glue

AWS Big Data

Amazon Q Developer can now generate complex data integration jobs with multiple sources, destinations, and data transformations. Configure an IAM role to interact with Amazon Q. His team works on distributed systems & new interfaces for data integration and efficiently managing data lakes on AWS.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Run Spark SQL on Amazon Athena Spark

AWS Big Data

For interactive applications, Athena Spark allows you to spend less time waiting and be more productive, with application startup time in under a second. Running SQL on data lakes is fast, and Athena provides an optimized, Trino- and Presto-compatible API that includes a powerful optimizer.

Data Lake 110
article thumbnail

Federate Amazon QuickSight access with open-source identity provider Keycloak

AWS Big Data

Vamsi Bhadriraju is a Data Architect at AWS. He works closely with enterprise customers to build data lakes and analytical applications on the AWS Cloud. This policy grants the admin privileges in QuickSight to the federated user. Srikanth Baheti is a Specialized World Wide Principal Solutions Architect for Amazon QuickSight.

article thumbnail

Simplify and speed up Apache Spark applications on Amazon Redshift data with Amazon Redshift integration for Apache Spark

AWS Big Data

Customers use Amazon Redshift to run their business-critical analytics on petabytes of structured and semi-structured data. Apache Spark is a popular framework that you can use to build applications for use cases such as ETL (extract, transform, and load), interactive analytics, and machine learning (ML). enableHiveSupport().getOrCreate()

article thumbnail

Periscope Data Expands to Israel, Empowering Data Teams with Powerful Tools

Sisense

And he demonstrated how the Periscope Data platform overcomes the challenges of huge data volumes that can’t be easily modeled by traditional BI. Citing Tinder as a major example, Kyle explained how it constantly uses data to enhance users’ interactions and calibrate the user experience. A true unicorn.

article thumbnail

Generate security insights from Amazon Security Lake data using Amazon OpenSearch Ingestion

AWS Big Data

Optionally, specify the Amazon S3 storage class for the data in Amazon Security Lake. For more information, refer to Lifecycle management in Security Lake. Review the details and create the data lake. Choose Next. Additionally, the principal must have permission to pass the pipeline role to OpenSearch Ingestion.