pyspark.sql.functions.make_date¶

pyspark.sql.functions.make_date(year: ColumnOrName, month: ColumnOrName, day: ColumnOrName) → pyspark.sql.column.Column[source]¶

Returns a column with a date built from the year, month and day columns.

New in version 3.3.0.

Changed in version 3.4.0: Supports Spark Connect.

Parameters

yearColumn or str: The year to build the date
monthColumn or str: The month to build the date
dayColumn or str: The day to build the date

Returns

Column: a date built from given parts.

Examples

>>> df = spark.createDataFrame([(2020, 6, 26)], ['Y', 'M', 'D'])
>>> df.select(make_date(df.Y, df.M, df.D).alias("datefield")).collect()
[Row(datefield=datetime.date(2020, 6, 26))]

pyspark.sql.functions.hour pyspark.sql.functions.from_unixtime