article thumbnail

Octopai Acquisition Enhances Metadata Management to Trust Data Across Entire Data Estate

Cloudera

Founded in 2016, Octopai offers automated solutions for data lineage, data discovery, data catalog, mapping, and impact analysis across complex data environments. It leverages knowledge graphs to keep track of all the data sources and data flows, using AI to fill the gaps so you have the most comprehensive metadata management solution.

article thumbnail

What Your Phone Number’s Metadata Means for Data Privacy

Smart Data Collective

One of the issues that we need to be aware of is the role of phone metadata. Our Phone Metadata Can Be a Threat to Our Data Privacy Data privacy protections against government surveillance often focus on communications content and exclude communications metadata. This can lead to some serious data privacy concerns.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

A Few 2016 Technology Predictions

In(tegrate) the Clouds

I enjoy the end of the year technology predictions, even though it’s hard to argue with this tweet from Merv Adrian: By 2016, 99% of readers will be utterly sick of predictions. 2016 will be the year of the data lake. In 2016, which software company will be the biggest game-changer for the long term? Does Elon Musk count?

article thumbnail

The Increasing Importance of Open Table Formats

David Menninger's Analyst Perspectives

Apache Hudi was created at Uber in 2016 and became an Apache Software Foundation project in 2020, while Apache Iceberg was created at Netflix in 2017 and also became a project of the ASF the following year. They are separate and competing formats with different origins, however.

Data Lake 130
article thumbnail

Bringing the National Museum of African American History and Culture to the world

CIO Business Intelligence

The technology behind the Searchable Museum The Searchable Museum runs on Amazon Web Services and uses APIs created by the Smithsonian IT team to access all the metadata available in the massive catalog of artifacts, images, video clips, 3D objects, and other components that reside within the 11 inaugural exhibitions in the building.

article thumbnail

Build and manage your modern data stack using dbt and AWS Glue through dbt-glue, the new “trusted” dbt adapter

AWS Big Data

gold_cost_metrics" cm ON cm.type = pm.type AND cm.year = pm.year AND cm.month = pm.month WHERE cm.type = 'yellow' AND cm.year = '2016' AND cm.month = '6' The following screenshot shows the results of this query. gold_passengers_metrics" pm LEFT JOIN "dbt_glue_demo_nyc_metrics"."gold_cost_metrics" 11:41:51 Registered adapter: glue=1.7.1

Data Lake 122
article thumbnail

Upgrade Journey: The Path from CDH to CDP Private Cloud

Cloudera

ACID transactions, ANSI 2016 SQL SupportMajor Performance improvements. Transition from Navigator by migrating the business metadata (tags, entity names, custom properties, descriptions and technical metadata (Hive, Spark, HDFS, Impala) to Atlas. New Features CDH to CDP. Identifying areas of interest for Customer A. on roadmap).

Testing 132