What is MCP? Model Context Protocol (MCP) is an open-source standard for integrating AI applications to external systems. With AI use cases getting traction more and more, it becomes evident that AI applications tend to connect to multiple data sources to provide intelligent and relevant responses. Earlier AI systems interacted with users through Large language […]
Saravanan Ponnaiah
Saravanan Ponnaiah is a solutions architect working on cloud and data projects. He has 20 years of experience with deep expertise in cloud and data platforms, working in banking and financial, insurance, healthcare, and digital forensics domains. Has architected enterprise data solutions with expertise in Databricks and implemented scalable GenAI solutions.
Blogs from this Author
Why Databricks SQL Serverless is not PCI-DSS compliant
Databricks supports a wide range of compliance standards to meet the needs of highly regulated industries, including: HIPAA (Health Insurance Portability and Accountability Act) PCI-DSS (Payment Card Industry Data Security Standard) FedRAMP High & Moderate DoD IL5 IRAP (Australia) GDPR (EU) CCPA (California) However, I was surprised to read that Databricks Serverless workloads are not covered for PCI-DSS (Databricks PCI […]
Databricks Lakebase – Database Branching in Action
What is Databricks Lakebase? Databricks Lakebase is a Postgres OLTP engine, integrated into Databricks Data Intelligence Platform. A database instance is a compute type that provides fully managed storage and compute resources for a postgres database. Lakebase leverages an architecture that separates compute and storage, which allows independent scaling while supporting low latency (<10ms) and […]
PySpark – Coding Standards & Best Practices
Purpose: The primary objective for this document is to provide awareness and establish clear understanding of coding standards and best practices to adhere while developing PySpark components. Best Practices are any procedure that is accepted as being the most effective either by consensus or prescription. Practices can range from stylistic to in-depth design methodologies. In […]
Apache Spark for .Net – Kick Starter
Apache Spark: Apache Spark is a general-purpose distributed processing engine for analytics over large data sets – typically terabytes or petabytes of data. Apache Spark can be used for processing data in batches, real-time streams, machine learning and ad-hoc query. Processing tasks are distributed over a cluster of nodes and data is cached in-memory to […]
Azure Databricks – Capacity Planning for optimum Spark Cluster
Overview: Today the terminology “Data Analytics” becomes a buzz across all industries & enterprises. Every organization strongly believes Data Analytics greatly helps to get insight & accelerate the business strategies in order to grow & lead in their fast and ever-changing markets. Azure Databricks: Azure Databricks is a data analytics platform optimized for the Microsoft […]