pyspark.sql.DataFrame.sparkSession

property DataFrame.sparkSession

Returns Spark session that created this DataFrame.

New in version 3.3.0.

Changed in version 3.4.0: Supports Spark Connect.

Returns

SparkSession

Examples

>>> df = spark.range(1)
>>> type(df.sparkSession)
<class '...session.SparkSession'>

pyspark.sql.DataFrame.sortWithinPartitions pyspark.sql.DataFrame.stat