pyspark.SparkFiles¶

class pyspark.SparkFiles[source]¶

Resolves paths to files added through SparkContext.addFile().

SparkFiles contains only classmethods; users should not create SparkFiles instances.

Methods

`get`(filename)	Get the absolute path of a file added through `SparkContext.addFile()`.
`getRootDirectory`()	Get the root directory that contains files added through `SparkContext.addFile()`.

pyspark.SparkConf pyspark.StorageLevel