Smart Data Collective

FEBRUARY 3, 2021

Big data is changing the nature of the financial industry in countless ways. The market for data analytics in the banking industry alone is expected to be worth $5.4 However, the impact of big data on the stock market is likely to be even greater. Traders have been using this strategy for quite some time. billion by 2026.

Big Data 140

Big Data Marketing Data Analytics Analytics 140

CIO Business Intelligence

OCTOBER 30, 2023

CIOs are responsible for much more than IT infrastructure; they must drive the adoption of innovative technology and partner closely with their data scientists and engineers to make AI a reality–all while keeping costs down and being cyber-resilient. That’s because data is often siloed across on-premises, multiple clouds, and at the edge.

Unstructured Data 143

Unstructured Data Optimization Data-driven Strategy 143

AWS Big Data

MARCH 26, 2024

This view is used to identify patterns and trends in customer behavior, which can inform data-driven decisions to improve business outcomes. In this post, we discuss how you can use purpose-built AWS services to create an end-to-end data strategy for C360 to unify and govern customer data that address these challenges.

Data Strategy 99

Data Strategy Strategy Data Warehouse Prescriptive Analytics 99

IBM Big Data Hub

APRIL 25, 2023

In a prior blog , we pointed out that warehouses, known for high-performance data processing for business intelligence, can quickly become expensive for new data and evolving workloads. To do so, Presto and Spark need to readily work with existing and modern data warehouse infrastructures. Some use case examples will help.

Optimization 56

Optimization Strategy Data Warehouse Cost-Benefit 56

CIO Business Intelligence

MARCH 29, 2024

That’s why Rocket Mortgage has been a vigorous implementor of machine learning and AI technologies — and why CIO Brian Woodring emphasizes a “human in the loop” AI strategy that will not be pinned down to any one generative AI model. It’s a powerful strategy.” So too is keeping your options open.

Data Lake 134

Data Lake Machine Learning Data Warehouse Unstructured Data 134

CDW Research Hub

APRIL 28, 2020

As businesses strive to become modern data-driven organizations, many are drawn to the value that a data platform in the cloud can provide. Cloud data platforms provide the speed, performance and scalability that is required to handle an exponential growth in volume of data.

Data-driven 52

Data-driven Analytics Consulting ROI 52

erwin

JUNE 26, 2020

If you’re serious about a data-driven strategy , you’re going to need a data catalog. Organizations need a data catalog because it enables them to create a seamless way for employees to access and consume data and business assets in an organized manner. Three Types of Metadata in a Data Catalog.

Metadata 132

Metadata Cost-Benefit Measurement Data-driven 132

CIO Business Intelligence

JULY 28, 2023

JLL, for instance, provides facilities management services for many cloud and data center operators. More recently, the company launched Carbon Pathfinder, an AI-driven sustainability software planning tool that is sold as SaaS or a suite with professional services. “AI Of course, JLL has only just begun to use generative AI and LLMs.

Structured Data 98

Structured Data Data-driven Software Modeling 98

Sisense

JUNE 30, 2020

Everyone wants to get more out of their data, but how exactly to do that can leave you scratching your head. In a world increasingly dominated by data, users of all kinds are gathering, managing, visualizing, and analyzing data in a wide variety of ways. Data visualization: painting a picture of your data.

Visualization 93

Visualization Analytics Dashboards Data-driven 93

CIO Business Intelligence

JUNE 28, 2022

Some call data the new oil. Philosophers and economists may argue about the quality of the metaphor, but there’s no doubt that organizing and analyzing data is a vital endeavor for any enterprise looking to deliver on the promise of data-driven decision-making. And to do so, a solid data management strategy is key.

Management 138

Management Internet of Things Data Science Statistics 138

Octopai

JUNE 26, 2020

We’re dealing with data day in and day out, but if isn’t accurate then it’s all for nothing!” Steve needed a robust and automated metadata management solution as part of his organization’s data governance strategy. Enterprise data governance. Metadata in data governance.

Metadata 98

Metadata Data Governance Enterprise Reporting 98

Smart Data Collective

JUNE 11, 2019

Big data is everywhere , and it’s finding its way into a multitude of industries and applications. One of the most fascinating big data industries is manufacturing. In an environment of fast-paced production and competitive markets, big data helps companies rise to the top and stay efficient and relevant.

Manufacturing 111

Manufacturing Analytics Big Data Data mining 111

erwin

OCTOBER 24, 2019

Untapped data, if mined, represents tremendous potential for your organization. While there has been a lot of talk about big data over the years, the real hero in unlocking the value of enterprise data is metadata , or the data about the data. They don’t know exactly what data they have or even where some of it is.

Metadata 104

Metadata Management Data-driven Data Architecture 104

Sisense

JULY 22, 2020

We live in a world of data: there’s more of it than ever before, in a ceaselessly expanding array of forms and locations. Dealing with Data is your window into the ways organizations tackle the challenges of this new world to help their companies and their customers thrive. Understanding how data becomes insights.

Slice and Dice 98

Slice and Dice Digital Transformation Data Warehouse Data Lake 98

AWS Big Data

AUGUST 27, 2024

Director of Product, Salesforce Data Cloud. In today’s ever-evolving business landscape, organizations must harness and act on data to fuel analytics, generate insights, and make informed decisions to deliver exceptional customer experiences. What is Salesforce Data Cloud? What is Amazon Redshift?

Data Lake 111

Data Lake Analytics Data-driven Management 111

AWS Big Data

SEPTEMBER 12, 2024

We use leading-edge analytics, data, and science to help clients make intelligent decisions. As it relates to the use case in the post, ZS is a global leader in integrated evidence and strategy planning (IESP), a set of services that help pharmaceutical companies to deliver a complete and differentiated evidence package for new medicines.

Unstructured Data 111

Unstructured Data Metadata Machine Learning Consulting 111

AWS Big Data

FEBRUARY 26, 2025

Analytics remained one of the key focus areas this year, with significant updates and innovations aimed at helping businesses harness their data more efficiently and accelerate insights. From enhancing data lakes to empowering AI-driven analytics, AWS unveiled new tools and services that are set to shape the future of data and analytics.

Analytics 61

Analytics Data Lake Metadata Data Warehouse 61

Cloudera

JUNE 7, 2022

We live in a hybrid data world. In the past decade, the amount of structured data created, captured, copied, and consumed globally has grown from less than 1 ZB in 2011 to nearly 14 ZB in 2020. Impressive, but dwarfed by the amount of unstructured data, cloud data, and machine data – another 50 ZB.

IT 112

IT Data Architecture Unstructured Data Big Data 112

AWS Big Data

MAY 30, 2024

Amazon Redshift is a fast, scalable, and fully managed cloud data warehouse that allows you to process and run your complex SQL analytics workloads on structured and semi-structured data. Both the API and data store had to support a highly volatile workload pattern.

Data Warehouse 115

Data Warehouse Data Lake Cost-Benefit Structured Data 115

AWS Big Data

OCTOBER 2, 2023

Organizations are grappling with the ever-expanding spectrum of data formats in today’s data-driven landscape. From Avro’s binary serialization to the efficient and compact structure of Protobuf, the landscape of data formats has expanded far beyond the traditional realms of CSV and JSON.

Cost-Benefit 115

Cost-Benefit Metadata Structured Data Data-driven 115

AWS Big Data

APRIL 2, 2024

In March 2024, we announced the general availability of the generative artificial intelligence (AI) generated data descriptions in Amazon DataZone. In this post, we share what we heard from our customers that led us to add the AI-generated data descriptions and discuss specific customer use cases addressed by this capability.

Metadata 111

Metadata Metrics Data-driven Contextual Data 111

CIO Business Intelligence

JUNE 23, 2022

We live in a hybrid data world. In the past decade, the amount of structured data created, captured, copied, and consumed globally has grown from less than 1 ZB in 2011 to nearly 14 ZB in 2020. Impressive, but dwarfed by the amount of unstructured data, cloud data, and machine data – another 50 ZB.

IT 97

IT Data Architecture Unstructured Data Big Data 97

AWS Big Data

OCTOBER 1, 2024

Amazon Redshift enables you to efficiently query and retrieve structured and semi-structured data from open format files in Amazon S3 data lake without having to load the data into Amazon Redshift tables. Amazon Redshift extends SQL capabilities to your data lake, enabling you to run analytical queries.

Data Lake 115

Data Lake Statistics Broadcasting Optimization 115

Cloudera

SEPTEMBER 29, 2021

Through processing vast amounts of structured and semi-structured data, AI and machine learning enabled effective fraud prevention in real-time on a national scale. . Providing more value to citizens through data. The pandemic has highlighted the increasing importance of getting the most out of the data a government has.

Digital Transformation 83

Digital Transformation Data Governance Data-driven Machine Learning 83

Sisense

MAY 11, 2021

You can’t talk about data analytics without talking about data modeling. The reasons for this are simple: Before you can start analyzing data, huge datasets like data lakes must be modeled or transformed to be usable. Building the right data model is an important part of your data strategy.

Modeling 84

Modeling Big Data IoT Data Warehouse 84

DataRobot Blog

JANUARY 17, 2023

As a data scientist, one of the best things about working with DataRobot customers is the sheer variety of highly interesting questions that come up. For counterparty behavior prediction: some form of structured data which contains not only won trades but also unsuccessful requests/responses. For price discovery (e.g.,

Machine Learning 87

Machine Learning Marketing Experimentation Data-driven 87

Cloudera

JANUARY 11, 2018

For them, they may understand that they need a data-driven strategy or the culture may aim to take a shift to being guided by data. We have introduced the research in a blog released last week called “Introduction to Six Strategies for Advancing Customer Knowledge” and the full research can be accessed here.

Strategy 40

Strategy Data Warehouse Cost-Benefit Marketing 40

Sisense

JULY 23, 2021

During this period, those working for each city’s Organising Committee for the Olympic Games (OCOG) collect a huge amount of data about the planning and delivery of the Games. At the Information, Knowledge, and Games Learning (IKL) unit, we anticipate collecting about 1TB of data from primary sources.

Unstructured Data 105

Unstructured Data Internet of Things Data-driven Data Processing 105

CDW Research Hub

APRIL 20, 2020

Many organizations move from a traditional data warehouse to a hybrid or cloud-based data warehouse to help alleviate their struggles with rapidly expanding data, new users and use cases, and a growing number of diverse tools and applications. Snowflake, a data warehouse built specifically for the cloud, is one popular option.

Data Warehouse 52

Data Warehouse Data-driven Consulting Structured Data 52

CDW Research Hub

JULY 22, 2019

Companies today are struggling under the weight of their legacy data warehouse. These old and inefficient systems were designed for a different era, when data was a side project and access to analytics was limited to the executive team. To do so, these companies need a modern data warehouse, such as Snowflake. Development tools.

Data Warehouse 54

Data Warehouse Business Intelligence Structured Data Data-driven 54

IBM Big Data Hub

AUGUST 15, 2023

To overcome these challenges will require a shift in many of the processes and models that businesses use today: changes in IT architecture, data management and culture. A common phrase you’ll hear around AI is that artificial intelligence is only as good as the data foundation that shapes it.

IT 74

IT Data Governance Modeling Cost-Benefit 74

Ontotext

SEPTEMBER 15, 2020

What Makes a Data Fabric? Data Fabric’ has reached where ‘Cloud Computing’ and ‘Grid Computing’ once trod. Data Fabric hit the Gartner top ten in 2019. This multiplicity of data leads to the growth silos, which in turns increases the cost of integration. It is a buzzword.

Metadata 69

Metadata Knowledge Discovery Data Quality Strategy 69

Ontotext

NOVEMBER 2, 2023

Achieving this advantage is dependent on their ability to capture, connect, integrate, and convert data into insight for business decisions and processes. This is the goal of a “data-driven” organization. We call this the “ Bad Data Tax ”. This is partly because integrating and moving data is not the only problem.

IT 69

IT Cost-Benefit Data-driven Technology 69

CIO Business Intelligence

DECEMBER 4, 2023

Although less complex than the “4 Vs” of big data (velocity, veracity, volume, and variety), orienting to the variety and volume of a challenging puzzle is similar to what CIOs face with information management. Operationalizing data to drive revenue CIOs report that their roles are rising in importance and impact. What’s changed?

Unstructured Data 52

Unstructured Data Data Lake Business Objectives Metadata 52

Wayne Yaddow

FEBRUARY 26, 2025

AI is transforming how senior data engineers and data scientists validate data transformations and conversions. Artificial intelligence-based verification approaches aid in the detection of anomalies, the enforcement of data integrity, and the optimization of pipelines for improved efficiency.

Data Transformation 52

Data Transformation Testing Data-driven Data Quality 52

Wayne Yaddow

MARCH 14, 2025

How dbt Core aids data teams test, validate, and monitor complex data transformations and conversions Photo by NASA on Unsplash Introduction dbt Core, an open-source framework for developing, testing, and documenting SQL-based data transformations, has become a must-have tool for modern data teams as the complexity of data pipelines grows.

Data Transformation 52

Data Transformation Testing Unstructured Data Data Quality 52

Ontotext

FEBRUARY 26, 2024

This is part of Ontotext’s AI-in-Action initiative aimed at enabling data scientists and engineers to benefit from the AI capabilities of our products. RED’s focus on news content serves a pivotal function: identifying, extracting, and structuring data on events, parties involved, and subsequent impacts.

Data-driven 59

Data-driven Risk Modeling Risk Management 59