Rocket-Powered Data Science

JULY 19, 2023

I recently saw an informal online survey that asked users which types of data (tabular, text, images, or “other”) are being used in their organization’s analytics applications. The results showed that (among those surveyed) approximately 90% of enterprise analytics applications are being built on tabular data.

Data-driven 188

Data-driven Enterprise Analytics Machine Learning 188

O'Reilly on Data

MARCH 25, 2025

Weve seen this across dozens of companies, and the teams that break out of this trap all adopt some version of Evaluation-Driven Development (EDD), where testing, monitoring, and evaluation drive every decision from the start. Two big things: They bring the messiness of the real world into your system through unstructured data.

Testing 177

Testing Data-driven Software Measurement 177

AWS Big Data

DECEMBER 17, 2024

Amazon Redshift , launched in 2013, has undergone significant evolution since its inception, allowing customers to expand the horizons of data warehousing and SQL analytics. Industry-leading price-performance Amazon Redshift offers up to three times better price-performance than alternative cloud data warehouses.

Data Lake 97

Data Lake Data Warehouse Data-driven Optimization 97

CIO Business Intelligence

APRIL 30, 2025

Though loosely applied, agentic AI generally refers to granting AI agents more autonomy to optimize tasks and chain together increasingly complex actions. Another area is democratizing data analysis and reporting. By leveraging AI-driven solutions, we aim to provide an engaging and intuitive shopping experience.

IT 139

IT Sales Cost-Benefit Data-driven 139

Smart Data Collective

AUGUST 4, 2022

A growing number of businesses are discovering the importance of big data. Thirty-two percent of businesses have a formal data strategy and this number is rising year after year. Unfortunately, they often have to deal with a variety of challenges when they manage their data. One of them is knowing how to backup your data.

Data-driven 130

Data-driven Sales Big Data Dashboards 130

O'Reilly on Data

JUNE 14, 2024

Miso’s cofounders, Lucky Gunasekara and Andy Hsieh, are veterans of the Small Data Lab at Cornell Tech, which is devoted to private AI approaches for immersive personalization and content-centric explorations. The platform required a more effective way to connect learners directly to the key information that they sought.

Metadata 302

Metadata Publishing Data-driven Modeling 302

AWS Big Data

OCTOBER 30, 2024

Amazon DataZone is a data management service that makes it faster and easier for customers to catalog, discover, share, and govern data stored across AWS, on premises, and from third-party sources. Using Amazon DataZone lets us avoid building and maintaining an in-house platform, allowing our developers to focus on tailored solutions.

Analytics 118

Analytics Visualization Data Governance Data-driven 118

AWS Big Data

NOVEMBER 7, 2024

Amazon Redshift is a fully managed, AI-powered cloud data warehouse that delivers the best price-performance for your analytics workloads at any scale. It provides a conversational interface where users can submit queries in natural language within the scope of their current data permissions. Your data is not shared across accounts.

Metadata 105

Metadata Sales Data Warehouse Optimization 105

datapine

JULY 11, 2019

The rise of innovative, interactive, data-driven dashboard tools has made creating effective dashboards – like the one featured above – swift, simple, and accessible to today’s forward-thinking businesses. Dashboard design should be the cherry on top of your business intelligence (BI) project. Now, it’s time for the fun part.

Dashboards 319

Dashboards Metrics Visualization Key Performance Indicator 319

datapine

MAY 14, 2019

“Big data is at the foundation of all the megatrends that are happening.” – Chris Lynch, big data expert. We live in a world saturated with data. Zettabytes of data are floating around in our digital universe, just waiting to be analyzed and explored, according to AnalyticsWeek. Wondering which data science book to read?

Data Science 350

Data Science Machine Learning Big Data Data-driven 350

CIO Business Intelligence

JANUARY 9, 2025

It demands a robust foundation of consistent, high-quality data across all retail channels and systems. AI has the power to revolutionise retail, but success hinges on the quality of the foundation it is built upon: data. The Data Consistency Challenge However, this AI revolution brings its own set of challenges.

B2B 105

B2B Cost-Benefit Data-driven Sales 105

AWS Big Data

NOVEMBER 14, 2024

The landscape of big data management has been transformed by the rising popularity of open table formats such as Apache Iceberg, Apache Hudi, and Linux Foundation Delta Lake. These formats, designed to address the limitations of traditional data storage systems, have become essential in modern data architectures. Appendix 1.

Metadata 122

Metadata Data Warehouse Big Data Data Lake 122

David Menninger's Analyst Perspectives

MARCH 13, 2024

Interest in artificial intelligence (AI) is exploding driven in large part by the widespread interest in generative AI. The process of managing all these parts is referred to as Machine Learning Operations or MLOps. First, there is a shortage of skills.

Machine Learning 200

Machine Learning Data-driven Modeling Reporting 200

AWS Big Data

MARCH 10, 2025

Although traditional scaling primarily responds to query queue times, the new AI-driven scaling and optimization feature offers a more sophisticated approach by considering multiple factors including query complexity and data volume. We dont recommend using this feature for less than 32 base RPU or more than 512 base RPU workloads.

Optimization 85

Optimization Data Warehouse Data-driven Testing 85

AWS Big Data

APRIL 24, 2025

Amazon SageMaker Lakehouse now supports attribute-based access control (ABAC) with AWS Lake Formation , using AWS Identity and Access Management (IAM) principals and session tags to simplify data access, grant creation, and maintenance. You can then query, analyze, and join the data using Redshift, Amazon Athena , Amazon EMR , and AWS Glue.

Sales 87

Sales Data Lake Management Data-driven 87

datapine

NOVEMBER 27, 2019

Data exploded and became big. Spreadsheets finally took a backseat to actionable and insightful data visualizations and interactive business dashboards. The rise of self-service analytics democratized the data product chain. 1) Data Quality Management (DQM). We all gained access to the cloud.

Business Intelligence 361

Business Intelligence Analytics Prescriptive Analytics Data Quality 361

Rocket-Powered Data Science

FEBRUARY 12, 2021

In the rest of this article, we will refer to IPA as intelligent automation (IA), which is simply short-hand for intelligent process automation. Process automation is relatively clear – it refers to an automatic implementation of a process, specifically a business process in our case. Sound similar?

ROI 234

ROI Digital Transformation Reporting Machine Learning 234

AWS Big Data

APRIL 9, 2025

This yields results with exact precision, dramatically improving the speed and accuracy of data discovery. In this post, we demonstrate how to streamline data discovery with precise technical identifier search in Amazon SageMaker Unified Studio.

Metadata 110

Metadata Metrics Data-driven Cost-Benefit 110

AWS Big Data

DECEMBER 4, 2024

Open table formats are emerging in the rapidly evolving domain of big data management, fundamentally altering the landscape of data storage and analysis. By providing a standardized framework for data representation, open table formats break down data silos, enhance data quality, and accelerate analytics at scale.

Snapshot 84

Snapshot Metadata Data Lake Optimization 84

AWS Big Data

DECEMBER 4, 2024

Amazon SageMaker Unified Studio (preview) provides an integrated data and AI development environment within Amazon SageMaker. From the Unified Studio, you can collaborate and build faster using familiar AWS tools for model development, generative AI, data processing, and SQL analytics.

Visualization 118

Visualization Sales Data-driven Analytics 118

AWS Big Data

OCTOBER 21, 2024

Data is the most significant asset of any organization. However, enterprises often encounter challenges with data silos, insufficient access controls, poor governance, and quality issues. Embracing data as a product is the key to address these challenges and foster a data-driven culture.

Sales 115

Sales Data-driven Data Processing Key Performance Indicator 115

CIO Business Intelligence

NOVEMBER 7, 2024

TIAA has launched a generative AI implementation, internally referred to as “Research Buddy,” that pulls together relevant facts and insights from publicly available documents for Nuveen, TIAA’s asset management arm, on an as-needed basis. Investment-driven workflows should be just-in-case. This is part of the ethos of just-in-time AI.

IT 132

IT Manufacturing Data Science Modeling 132

DataKitchen

NOVEMBER 5, 2024

The Race For Data Quality In A Medallion Architecture The Medallion architecture pattern is gaining traction among data teams. It is a layered approach to managing and transforming data. By systematically moving data through these layers, the Medallion architecture enhances the data structure in a data lakehouse environment.

Data Quality 198

Data Quality Testing Metrics Reporting 198

datapine

APRIL 12, 2019

Also, implementing effective management reports will create a data-driven approach to making business decisions and obtaining sustainable business success. Centralized data. It’s clear that a project management dashboard is a powerful online data analysis tool. What Is A Project Management Dashboard?

Dashboards 233

Dashboards Management KPI Cost-Benefit 233

AWS Big Data

NOVEMBER 22, 2024

Amazon Redshift is a fast, scalable, secure, and fully managed cloud data warehouse that you can use to analyze your data at scale. Redshift Data API provides a secure HTTP endpoint and integration with AWS SDKs. Calls to the Data API are asynchronous.

Data Warehouse 105

Data Warehouse Recreation/Entertainment Cost-Benefit Data-driven 105

CIO Business Intelligence

JANUARY 3, 2025

At the same time, the scale of observability data generated from multiple tools exceeds human capacity to manage. Observability builds on the growth of sophisticated IT monitoring tools, starting with the premise that the operational state of every network node should be understandable from its data outputs.

IT 105

IT Cost-Benefit Data Science Data-driven 105

datapine

SEPTEMBER 16, 2022

Previously, we discussed the top 19 big data books you need to read, followed by our rundown of the world’s top business intelligence books as well as our list of the best SQL books for beginners and intermediates. Data visualization, or ‘data viz’ as it’s commonly known, is the graphic presentation of data.

Visualization 304

Visualization Dashboards Data-driven Statistics 304

CIO Business Intelligence

DECEMBER 11, 2024

In todays economy, as the saying goes, data is the new gold a valuable asset from a financial standpoint. A similar transformation has occurred with data. More than 20 years ago, data within organizations was like scattered rocks on early Earth.

Management 111

Management Data Governance Data Science Reporting 111

datapine

JANUARY 24, 2021

In our cutthroat digital age, the importance of setting the right data analysis questions can define the overall success of a business. That being said, it seems like we’re in the midst of a data analysis crisis. Your Chance: Want to perform advanced data analysis with a few clicks? Data Is Only As Good As The Questions You Ask.

IT 317

IT Statistics KPI Data-driven 317

CIO Business Intelligence

JANUARY 14, 2025

Similarly, modern architecture must enable: A/B testing of new features Canary releases for risk management Multiple service versions running simultaneously Hypothesis-driven development A key element of evolutionary architecture is the use of fitness functions automated checks that continuously validate architecture against desired qualities.

Enterprise 119

Enterprise Technology Metrics Measurement 119

datapine

MAY 9, 2019

“Without big data, you are blind and deaf and in the middle of a freeway.” – Geoffrey Moore, management consultant, and author. In a world dominated by data, it’s more important than ever for businesses to understand how to extract every drop of value from the raft of digital insights available at their fingertips.

Business Intelligence 270

Business Intelligence Dashboards Data Warehouse Sales 270

O'Reilly on Data

APRIL 5, 2023

That’s because AI algorithms are trained on data. By its very nature, data is an artifact of something that happened in the past. Data is a relic–even if it’s only a few milliseconds old. When we decide which data to use and which data to discard, we are influenced by our innate biases and pre-existing beliefs.

Cost-Benefit 312

Cost-Benefit Data-driven Measurement Visualization 312

AWS Big Data

DECEMBER 19, 2024

Organizational data is often fragmented across multiple lines of business, leading to inconsistent and sometimes duplicate datasets. This fragmentation can delay decision-making and erode trust in available data. This solution enhances governance and simplifies access to unstructured data assets across the organization.

Publishing 96

Publishing Unstructured Data Metadata Data-driven 96

O'Reilly on Data

APRIL 30, 2024

But over time, a misalignment between the initial promise of them providing user value and the need to expand profit margins as growth slows has driven bad platform behaviour. An Amazon spokesperson said: We disagree with a number of conclusions made in this research, which misrepresents and overstates the limited data it uses.

Risk 320

Risk Advertising Cost-Benefit Sales 320

AWS Big Data

MARCH 6, 2025

In todays data-driven world, securely accessing, visualizing, and analyzing data is essential for making informed business decisions. For instance, a global sports gear company selling products across multiple regions needs to visualize its sales data, which includes country-level details.

Visualization 102

Visualization Sales Data Warehouse Management 102

DataKitchen

DECEMBER 9, 2022

ChatGPT> DataOps, or data operations, is a set of practices and technologies that organizations use to improve the speed, quality, and reliability of their data analytics processes. The goal of DataOps is to help organizations make better use of their data to drive business decisions and improve outcomes.

Machine Learning 130

Machine Learning Data-driven Optimization Data Analytics 130

CIO Business Intelligence

MARCH 19, 2025

If a customer asks us to do a transaction or workflow, and Outlook or Word is open, the AI agent can access all the company data, he says. The data is kept in a private cloud for security, and the LLM is internally hosted as well. And the data is also used for sales and marketing. Thats been positive and powerful.

Software 143

Software Risk Enterprise Cost-Benefit 143