Databricks

A comprehensive understanding of Spark’s transformation and action is crucial for efficient Spark code. This blog provides a glimpse on the fundamental aspects of Spark.  Before we deep dive into Spark’s transformation and action, let us see a glance of RDD and Dataframe.  Resilient Distributed Dataset (RDD): Usually, Spark tasks operate on RDDs, which is […]

Client   Our client is an American multinational corporation that develops medical devices, pharmaceuticals, and consumer packaged goods. Industry Background Better understanding and engaging patients and members has never been more critical than it is today. To meet clinical, business, and evolving consumer needs, healthcare, and life sciences organizations are focused on care delivery that enables […]

Introducing: The Migration Factory In today’s ever-evolving business environment, staying up to date on best practices and technology is essential for remaining competitive.  Many Fortune 500s have realized the importance of making data work in favor of one’s business.  Without proper data management, corporations begin to fall behind the competition by struggling with things like […]

The worlds largest Data + AI conference is underway at the Moscone Center in San Francisco!  Perficient experts have been immersing themselves in all the conference has to offer. Whether it was the opening keynote with Databricks CEO, Ali Ghodsi or learning about brand new releases from the Databricks platform in breakout sessions, our leaders […]

In just two weeks Perficient leaders are headed to San Francisco to attend Data + AI Summit!  This key conference for the data, analytics, and AI community take places June 26th – 29th in Moscone Center and will attract an estimated 10,000 data professionals from every industry all over the globe.  The conference has something […]

Real-time data processing is a critical need for modern-day businesses. It involves processing data as soon as it is generated to derive insights and take immediate actions. Databricks Streaming and Apache Flink are two popular stream processing frameworks that enable developers to build real-time data pipelines, applications and services at scale. In this article, we […]

Databricks Databricks provides a powerful, spark-centric, cloud-based analytics platform that enables users to rapidly process, transform and explore data. However, its preconfigured security can be insufficient in regulating or monitoring confidential information due to the flexibility it offers. This can be of particular concern to highly regulated enterprise, such a financial and health-care companies. Policy-as-code […]

Delta Lake is an open-source framework under the Linux Foundation used to build Lakehouse architectures. A new project is Delta Sharing, which is an open protocol for secure real-time exchange of large datasets. Databricks provides production-grade implementations of the projects under delta-io, including Databricks Delta Sharing. Understanding the open-source foundation of the enterprise offering can […]

The Data and AI Summit 2022 had enormous announcements for the Databricks Lakehouse platform. Among these, there were several exhilarating enhancements to Databricks Workflows, the fully managed orchestration service that is deeply integrated with the Databricks Lakehouse Platform and Delta Live tables too. With these new efficacies, Workflows enables data engineers, data scientists and analysts […]

What is Databricks? Databricks is a unified cloud-based data platform that is powered by Apache Spark. It specializes in collaboration and analytics for big data. Databricks is a data science workspace, with Collaborative Notebooks, Machine Learning Runtime, and Managed ML flow. Collaborative Notebooks support multiple data analytics languages, such as SQL, Scala, R, Python, and […]