Skip to main content

Posts Tagged ‘disk’

Computer 4484282 1920

Spark: Persistence Storage Levels

Spark Persistence is an optimization technique, which saves the results of RDD evaluation. Spark provides a convenient method for working with datasets by storing them in memory throughout various operations. When you persist a dataset, Spark stores the data on disk or in memory, or a combination of the two, so that it can be […]