IBM Big Data Hub

FEBRUARY 9, 2023

In our last blog , we delved into the seven most prevalent data challenges that can be addressed with effective data governance. Today we will share our approach to developing a data governance program to drive data transformation and fuel a data-driven culture.

Data Governance 76

Data Governance Business Objectives Data Quality Measurement 76

AWS Big Data

OCTOBER 30, 2024

After connecting, you can query, visualize, and share data—governed by Amazon DataZone—within the tools you already know and trust. Joel Farvault is Principal Specialist SA Analytics for AWS with 25 years’ experience working on enterprise architecture, data governance and analytics, mainly in the financial services industry.

Visualization 115

Visualization Data Lake Testing Data Governance 115

AWS Big Data

DECEMBER 4, 2024

Under the federated mesh architecture, each divisional mesh functions as a node within the broader enterprise data mesh, maintaining a degree of autonomy in managing its data products. By treating the data as a product, the outcome is a reusable asset that outlives a project and meets the needs of the enterprise consumer.

Metadata 93

Metadata Data Governance Data Quality Data-driven 93

CIO Business Intelligence

NOVEMBER 17, 2022

As companies start to adapt data-first strategies, the role of chief data officer is becoming increasingly important, especially as businesses seek to capitalize on data to gain a competitive advantage. According to the survey, 80% of the top KPIs that CDOs report focusing on are business oriented.

Data Governance 128

Data Governance Data Transformation Strategy Reporting 128

Alation

NOVEMBER 22, 2022

What Is Data Governance In The Public Sector? Effective data governance for the public sector enables entities to ensure data quality, enhance security, protect privacy, and meet compliance requirements. With so much focus on compliance, democratizing data for self-service analytics can present a challenge.

Data Governance 52

Data Governance Metadata Data-driven Unstructured Data 52

Alation

OCTOBER 28, 2021

This data is also a lucrative target for cyber criminals. Healthcare leaders face a quandary: how to use data to support innovation in a way that’s secure and compliant? Data governance in healthcare has emerged as a solution to these challenges. Uncover intelligence from data. Protect data at the source.

Data Governance 52

Data Governance Measurement Data Quality Metrics 52

erwin

SEPTEMBER 17, 2020

Replace manual and recurring tasks for fast, reliable data lineage and overall data governance. It’s paramount that organizations understand the benefits of automating end-to-end data lineage. The importance of end-to-end data lineage is widely understood and ignoring it is risky business.

Cost-Benefit 143

Cost-Benefit Data Governance Metadata Reporting 143

Alation

OCTOBER 26, 2021

Building a Data Culture Within a Finance Department. Our finance users tell us that their first exposure to the Alation Data Catalog often comes soon after the launch of organization-wide data transformation efforts. After all, finance is one of the greatest consumers of data within a business.

Finance 52

Finance Data Transformation Enterprise Metrics 52

erwin

APRIL 29, 2020

Business terms and data policies should be implemented through standardized and documented business rules. Compliance with these business rules can be tracked through data lineage, incorporating auditability and validation controls across data transformations and pipelines to generate alerts when there are non-compliant data instances.

Metadata 111

Metadata Key Performance Indicator Data Governance Data Quality 111

CIO Business Intelligence

JANUARY 24, 2024

“IT leaders should establish a process for continuous monitoring and improvement to ensure that insights remain actionable and relevant, by implementing regular review cycles to assess the effectiveness of the insights derived from unstructured data.” This type of environment can also be deeply rewarding for data and analytics professionals.”

Data Strategy 136

Data Strategy Strategy Unstructured Data Data Governance 136

TDAN

AUGUST 15, 2023

Nearly every data leader I talk to is in the midst of a data transformation. As businesses look for ways to increase sales, improve customer experience, and stay ahead of the competition, they are realizing that data is their competitive advantage and the key to achieving their goals. And it’s no surprise, really.

Data Transformation 52

Data Transformation Sales Metadata Data Governance 52

datapine

SEPTEMBER 29, 2022

To help you digest all that information, we put together a brief summary of all the points you should not forget when it comes to assessing your data. Ensure data governance : Data governance is a set of processes, roles, standards, and metrics that ensure that organizations use data in an efficient and secure way.

Data Quality 241

Data Quality Metrics Data-driven Management 241

CIO Business Intelligence

FEBRUARY 16, 2023

But to augment its various businesses with ML and AI, Iyengar’s team first had to break down data silos within the organization and transform the company’s data operations. Digitizing was our first stake at the table in our data journey,” he says.

Unstructured Data 105

Unstructured Data Data Lake Prescriptive Analytics Data Warehouse 105

erwin

JANUARY 11, 2019

Organizations have spent a lot of time and money trying to harmonize data across diverse platforms , including cleansing, uploading metadata, converting code, defining business glossaries, tracking data transformations and so on. Creating a High-Quality Data Pipeline.

Data Governance 40

Data Governance Risk Metadata Management 40

CIO Business Intelligence

NOVEMBER 7, 2023

Given the importance of sharing information among diverse disciplines in the era of digital transformation, this concept is arguably as important as ever. The aim is to normalize, aggregate, and eventually make available to analysts across the organization data that originates in various pockets of the enterprise.

Data Warehouse 142

Data Warehouse Digital Transformation Data-driven Reporting 142

erwin

JUNE 29, 2021

A key trend proving successful in data empowerment is investing in self-service technology. Self-service done right can enable a new level of productivity and operational efficiency to fuel the next generation of data transformation. What is data empowerment?

Data Governance 64

Data Governance Data-driven Reporting Technology 64

CIO Business Intelligence

JANUARY 9, 2023

To fuel self-service analytics and provide the real-time information customers and internal stakeholders need to meet customers’ shipping requirements, the Richmond, VA-based company, which operates a fleet of more than 8,500 tractors and 34,000 trailers, has embarked on a data transformation journey to improve data integration and data management.

Data Strategy 111

Data Strategy Strategy Data Governance Marketing 111

TDAN

MARCH 16, 2021

Taking Stock A year ago, organisations of all sizes around the world were catapulted into a cycle of digital and data transformation that saw many industries achieve in a matter of weeks in what would otherwise have taken many years to achieve. Small businesses pivoted to doing business online in a way that they might […].

Data Transformation 98

Data Transformation Risk Management Risk Data Governance 98

TDAN

JUNE 15, 2021

We have seen an impressive amount of hype and hoopla about “data as an asset” over the past few years. And one of the side effects of the COVID-19 pandemic has been an acceleration of data transformation in organisations of all sizes.

Data Transformation 98

Data Transformation Management Risk Management Risk 98

Cloudera

OCTOBER 11, 2021

And most importantly, it democratizes access to end-users, such as Data Engineering teams, Data Science teams, and even citizen data scientists, across the organization while ensuring compliance with data governance policies are met. Cloud Speed and Scale. Modak Nabu TM and CDE’s Spark-on-Kubernetes.

Data Lake 95

Data Lake Cost-Benefit Data-driven Dashboards 95

IBM Big Data Hub

JANUARY 9, 2024

The entire generative AI pipeline hinges on the data pipelines that empower it, making it imperative to take the correct precautions. 4 key components to ensure reliable data ingestion Data quality and governance: Data quality means ensuring the security of data sources, maintaining holistic data and providing clear metadata.

Enterprise 71

Enterprise Data Integration Data Quality Contextual Data 71

erwin

MARCH 26, 2020

In the whitepaper he states, the priority of the citizen analyst is straightforward: find the right data to develop reports and analyses that support a larger business case. Increased data variety, balancing structured, semi-structured and unstructured data, as well as data originating from a widening array of external sources.

Data-driven 90

Data-driven Unstructured Data Enterprise Machine Learning 90

Octopai

JUNE 22, 2023

In a self-service data management context, Octopai’s data lineage capabilities empower business users to navigate through complex data ecosystems. They can easily identify data sources, understand data transformations, and assess the impact of any changes they make.

Management 52

Management Data-driven Data Quality Data Governance 52

IBM Big Data Hub

JUNE 15, 2023

watsonx.data is truly open and interoperable The solution leverages not just open-source technologies, but those with open-source project governance and diverse communities of users and contributors, like Apache Iceberg and Presto, hosted by the Linux Foundation. This provides further opportunities for cost optimization.

Data Warehouse 86

Data Warehouse Data Lake Optimization Data-driven 86

AWS Big Data

SEPTEMBER 13, 2024

In the context of CFM, this requires a strong governance and security posture to apply fine-grained access control to this data. This data mesh approach allows CFM to have a clear view from an audit standpoint on dataset usage. He leverages his experience to advise customers on their data strategy and technology foundations.

Interactive 86

Interactive Strategy Cost-Benefit Data Governance 86

Alation

JUNE 28, 2022

This is where metadata, or the data about data, comes into play. Having a data catalog is the cornerstone of your data governance strategy, but what supports your data catalog? Your metadata management framework provides the underlying structure that makes your data accessible and manageable.

Metadata 52

Metadata Management Data Governance Machine Learning 52

Octopai

NOVEMBER 23, 2020

In fact, the LIBOR transition program marks one of the largest data transformation obstacles ever seen in financial services. Building an inventory of what will be affected is a huge undertaking across all of the data, reports, and structures that must be accounted for.

Metadata 72

Metadata Enterprise Business Intelligence Data Governance 72

Data Insight

JANUARY 21, 2020

Last year almost 200 data leaders attended DI Day, demonstrating an abundant thirst for knowledge and support to drive data transformation projects throughout their diverse organisations. This year we expect to see organisations continue to leverage the power of data to deliver business value and growth.

Internet of Things 52

Internet of Things Data Science Cost-Benefit Data Governance 52

IBM Big Data Hub

JULY 5, 2023

This was, without a question, a significant departure from traditional analytic environments, which often meant vendor-lock in and the inability to work with data at scale. Another unexpected challenge was the introduction of Spark as a processing framework for big data. Comprehensive data security and data governance (i.e.

Data Lake 60

Data Lake Metadata Cost-Benefit Data Warehouse 60

Octopai

JANUARY 19, 2021

With Octopai’s support and analysis of Azure Data Factory, enterprises can now view complete end-to-end data lineage from Azure Data Factory all the way through to reporting for the first time ever.

Metadata 52

Metadata ROI Machine Learning Data Quality 52

erwin

APRIL 16, 2024

In this blog, we’ll delve into the critical role of governance and data modeling tools in supporting a seamless data mesh implementation and explore how erwin tools can be used in that role. erwin also provides data governance, metadata management and data lineage software called erwin Data Intelligence by Quest.

Metadata 52

Metadata Data Quality Data Governance Modeling 52

Smarten

AUGUST 4, 2023

As your users become accustomed to augmented analytics, they will want the ability to quickly, and easily, gather data, integrated from disparate data sources. Users can then prepare that data – transforming, shaping, reducing, combining, exploring, cleaning, sampling, and aggregating data, to get the dataset users wish to analyze.

Data Lake 52

Data Lake Machine Learning Data Integration Data Quality 52

AWS Big Data

AUGUST 13, 2024

Introducing the SFTP connector for AWS Glue The SFTP connector for AWS Glue simplifies the process of connecting AWS Glue jobs to extract data from SFTP storage and to load data into SFTP storage. Solution overview In this example, you use AWS Glue Studio to connect to an SFTP server, then enrich that data and upload it to Amazon S3.

Data Processing 98

Data Processing Visualization Data Lake Data Processing 98

AWS Big Data

APRIL 19, 2023

Joel Farvault is Principal Specialist SA Analytics for AWS with 25 years’ experience working on enterprise architecture, data strategy, and analytics, mainly in the financial services industry. Joel has led data transformation projects on fraud analytics, claims automation, and data governance.

Technology 92

Technology Data-driven Machine Learning Sales 92

Alation

JANUARY 17, 2023

Data literacy — Employees can interpret and analyze data to draw logical conclusions; they can also identify subject matter experts best equipped to educate on specific data assets. Data governance is a key use case of the modern data stack. Who Can Adopt the Modern Data Stack?

Data Warehouse 52

Data Warehouse Cost-Benefit Data Science Data Transformation 52

AWS Big Data

DECEMBER 21, 2023

The data products from the Business Vault and Data Mart stages are now available for consumers. smava decided to use Tableau for business intelligence, data visualization, and further analytics. The data transformations are managed with dbt to simplify the workflow governance and team collaboration.

Data Lake 103

Data Lake Data Warehouse Data-driven B2B 103

Octopai

AUGUST 11, 2024

It helps organizations to capture, visualize, and track data lineage for Apache Spark applications. By integrating Spline into your data processing pipelines, you can gain insights into the flow of data, understand data transformations, and ensure data quality and compliance.

Metadata 40

Metadata Visualization Data Quality Data Governance 40