Modern data platforms like Databricks enable organizations to process massive volumes of batch and streaming data—but scaling reliably requires more than just compute power. It demands data observability: the ability to monitor, validate, and trace data through its lifecycle. This blog compares two powerful tools—Delta Live Tables and Great Expectations—that bring observability to life in […]
Data + Intelligence
Perficient Achieves AWS Glue Service Delivery Designation
Perficient has earned the AWS Glue Service Delivery Designation, demonstrating our deep technical expertise and proven success in delivering scalable, cost-effective, and high-performance data integration, data pipeline orchestration, and data catalog solutions. What is the AWS Service Delivery Program? The AWS Service Delivery Program is an AWS Specialization Program designed to validate AWS Partners with […]
How Automatic Liquid Clustering Supports Databricks FinOps at Scale
Perficient has a FinOps mindset with Databricks, so the Automatic Liquid Clustering announcement grabbed my attention. I’ve mentioned Liquid Clustering before when discussing the advantages of Unity Catalog beyond governance use cases. Unity Catalog: come for the data governance, stay for the predictive optimization. I am usually a fan of being able to tune the dials […]
AI & Quantum Computing: The End of Privacy?
In an age where everything is interconnected, we are on the verge of a technological revolution that could destroy privacy as we know it. With the accelerating breakthroughs in artificial intelligence (AI) and quantum computing, the concept of privacy—our ability to conceal secrets, preserve our personal data, and maintain control over our lives—may soon be […]
Responsible Design Starts within the Institution
The global business landscape is complex, and responsible design has emerged as a critical imperative for organizations across sectors. It represents a fundamental shift from viewing design merely as a creative output to recognizing it as an ethical responsibility embedded within institutional structures and processes True transformation toward responsible design practices cannot be achieved through […]
Exploring AI in Healthcare at the 2025 National Conference on Artificial Intelligence
The 2025 National Conference on Artificial Intelligence is an unparalleled opportunity to dive deep into the transformative potential of AI across various sectors. With topics ranging from responsible AI to workforce development, this conference explores the vast possibilities of AI. I am thrilled to be leading the AI in Healthcare Industry Panel on April 11 […]
Confidently Incorrect – Learning, Leading, and AI
A friend recently shared a research paper from Oxford Academic about Large Language Models (LLMs) and their human-like biases. I found it fascinating. The article explains how some groups use LLMs to simulate human participants. Since these models are trained on human-generated data, they can emulate human responses across diverse psychological and behavioral experiments. It […]
Python Optimization: Improve Code Performance
🚀 Python Optimization: Improve Code Performance 🎯 Introduction Python is an incredibly powerful and easy-to-use programming language. However, it can be slow if not optimized properly! 😱 This guide will teach you how to turbocharge your code, making it faster, leaner, and more efficient. Buckle up, and let’s dive into some epic optimization hacks! 💡🔥 […]
Engineering a Healthcare Analytics Center of Excellence (ACoE): A Strategic Framework for Innovation
In today’s rapidly evolving healthcare landscape, artificial intelligence (AI) and generative AI are no longer just buzzwords – they’re transformative technologies reshaping how we deliver care, manage operations, and drive innovation. As healthcare organizations navigate this complex technological frontier, establishing an Analytics Center of Excellence (ACoE) focused on AI and generative AI has become crucial […]
SAP and Databricks: Better Together
SAP Databricks is important because convenient access to governed data to support business initiatives is important. Breaking down silos has been a drumbeat of data professionals since Hadoop, but this SAP <-> Databricks initiative may help to solve one of the more intractable data engineering problems out there. SAP has a large, critical data footprint […]
Prospective Developments in API and APIGEE Management: A Look Ahead for the Next Five Years
Application programming interfaces, or APIs, are crucial to the ever-changing digital transformation landscape because they enable businesses to interact with their data and services promptly and effectively. Effective administration is therefore necessary to guarantee that these APIs operate as intended, remain secure, and offer the intended advantages. This is where Apigee, Google Cloud’s premier API […]
Revolutionizing Work With Microsoft Copilot: A Game-Changer in AI Integration
AI is no longer a futuristic concept—it’s here, transforming the way we work in real time. Organizations worldwide making AI a strategic priority, harnessing its power to enhance efficiency, accelerate decision-making, and drive growth. In fact, generative AI adoption has skyrocketed from 55% in 2023 to 75% in 2024, contributing to an estimated global economic impact of $19.9 trillion. […]