pyspark.sql.Catalog.tableExists¶

Catalog.tableExists(tableName: str, dbName: Optional[str] = None) → bool[source]¶

Check if the table or view with the specified name exists. This can either be a temporary view or a table/view.

New in version 3.3.0.

Parameters

tableNamestr: name of the table to check existence
dbNamestr, optional: name of the database to check table existence in. If no database is specified, the current database is used

Returns

bool: Indicating whether the table/view exists

Examples

This function can check if a table is defined or not:

>>> spark.catalog.tableExists("unexisting_table")
False
>>> df = spark.sql("CREATE TABLE tab1 (name STRING, age INT) USING parquet")
>>> spark.catalog.tableExists("tab1")
True
>>> df = spark.sql("DROP TABLE tab1")
>>> spark.catalog.tableExists("unexisting_table")
False

It also works for views:

>>> spark.catalog.tableExists("view1")
False
>>> df = spark.sql("CREATE VIEW view1 AS SELECT 1")
>>> spark.catalog.tableExists("view1")
True
>>> df = spark.sql("DROP VIEW view1")
>>> spark.catalog.tableExists("view1")
False

And also for temporary views:

>>> df = spark.sql("CREATE TEMPORARY VIEW view1 AS SELECT 1")
>>> spark.catalog.tableExists("view1")
True
>>> df = spark.sql("DROP VIEW view1")
>>> spark.catalog.tableExists("view1")
False

pyspark.sql.Catalog.setCurrentDatabase pyspark.sql.Catalog.uncacheTable