pyspark.BarrierTaskContext.get

classmethod BarrierTaskContext.get() → pyspark.taskcontext.BarrierTaskContext

Return the currently active BarrierTaskContext. This can be called inside of user functions to access contextual information about running tasks.

Notes

Must be called on the worker, not the driver. Returns None if not initialized. An Exception will raise if it is not in a barrier stage.

This API is experimental

pyspark.BarrierTaskContext.cpus pyspark.BarrierTaskContext.getLocalProperty