A comprehensive understanding of Spark’s transformation and action is crucial for efficient Spark code. This blog provides a glimpse on the fundamental aspects of Spark. Before we deep dive into Spark’s transformation and action, let us see a glance of RDD and Dataframe. Resilient Distributed Dataset (RDD): Usually, Spark tasks operate on RDDs, which is […]
Posts Tagged ‘Databricks’
Client Success Story: Ensuring the Safety and Efficacy of Clinical Trials
Client Our client is an American multinational corporation that develops medical devices, pharmaceuticals, and consumer packaged goods. Industry Background Better understanding and engaging patients and members has never been more critical than it is today. To meet clinical, business, and evolving consumer needs, healthcare, and life sciences organizations are focused on care delivery that enables […]
Nine Key Takeaways from Dreamforce 2023
Last week, Perficient attended the largest AI event in the world, Dreamforce, in San Francisco. During the three-day conference, 40,000 Salesforce partners, clients, and vendors got together to hear from Salesforce leadership, industry experts, clients, and a handful of celebrities, as well as get hands-on experience with the Salesforce platform. Fueled by generative AI, IDC […]
Unleash the Power of Data: The Migration Factory by Perficient on Databricks
Introducing: The Migration Factory In today’s ever-evolving business environment, staying up to date on best practices and technology is essential for remaining competitive. Many Fortune 500s have realized the importance of making data work in favor of one’s business. Without proper data management, corporations begin to fall behind the competition by struggling with things like […]
Data + AI Summit is in Full Swing!
The worlds largest Data + AI conference is underway at the Moscone Center in San Francisco! Perficient experts have been immersing themselves in all the conference has to offer. Whether it was the opening keynote with Databricks CEO, Ali Ghodsi or learning about brand new releases from the Databricks platform in breakout sessions, our leaders […]
Lets Meet at Data + AI Summit!
In just two weeks Perficient leaders are headed to San Francisco to attend Data + AI Summit! This key conference for the data, analytics, and AI community take places June 26th – 29th in Moscone Center and will attract an estimated 10,000 data professionals from every industry all over the globe. The conference has something […]
Simulating Synchronous Operations with Asynchronous Code in Distributed Systems
Ensuring real-time status updates for end users in web applications can be challenging, particularly when working with Databricks, which lacks native support for synchronous updates. This means that changes made in Databricks may not be immediately reflected to end users, impacting the real-time nature of status updates. In this technical blog post, we will explore […]
Integrating SAP Datasphere and Databricks Lakehouse for Unified Analytics
Integrating SAP and Databricks has typically required a lot of glue. Set up the SAP Data Hub environment, connect to the SAP data, set up a pipeline with Pipeline Modeler, configure the Streaming Analytics Service, setup Kafka or MQTT and receive the streaming data in Databricks with Spark Streaming. Most of these intermediate steps required […]
Real-time Data Processing: Databricks vs Flink
Real-time data processing is a critical need for modern-day businesses. It involves processing data as soon as it is generated to derive insights and take immediate actions. Databricks Streaming and Apache Flink are two popular stream processing frameworks that enable developers to build real-time data pipelines, applications and services at scale. In this article, we […]
Harden Databricks with Immuta’s Policy-As-Code Framework
Databricks Databricks provides a powerful, spark-centric, cloud-based analytics platform that enables users to rapidly process, transform and explore data. However, its preconfigured security can be insufficient in regulating or monitoring confidential information due to the flexibility it offers. This can be of particular concern to highly regulated enterprise, such a financial and health-care companies. Policy-as-code […]
Perficient Welcomes a New Data Solutions Alliance Manager!
Meet Our Newest Team Member Kyla Faust Our Partner Alliance team is growing, and we’re excited to introduce the newest member, Kyla Faust! With experience in sales and partnerships/alliances, Kyla is using her knowledge and skills to build relationships with her partners here at Perficient. This will result in powerful partnerships to ultimately work better […]
Next-Generation Data Cleanrooms with Delta Sharing
Data-driven companies are finding more and more use cases where their internal data could be supplemented with external datasets to deliver more business value. At the same time, there are legitimate data privacy concerns that need to be addressed, particularly among regulated enterprises in the financial and healthcare sector. There are opportunities here for a […]