DataFrame is a key abstraction in Spark which represents structured data and allows for easy manipulation and analysis. In this blog post, we’ll explore the various basic DataFrame methods available in Spark and how they can be used for data processing tasks using examples. Dataset: There are many DataFrame methods which are subclassified into Transformation […]
Posts Tagged ‘Transformations’
Understanding Spark Transformations and Actions – Spark RDD Operations
A comprehensive understanding of Spark’s transformation and action is crucial for efficient Spark code. This blog provides a glimpse on the fundamental aspects of Spark. Before we deep dive into Spark’s transformation and action, let us see a glance of RDD and Dataframe. Resilient Distributed Dataset (RDD): Usually, Spark tasks operate on RDDs, which is […]