org.apache.spark

ExceptionFailure

case class ExceptionFailure(className: String, description: String, stackTrace: Array[StackTraceElement], fullStackTrace: String, metrics: Option[TaskMetrics], exceptionWrapper: Option[ThrowableSerializationWrapper]) extends TaskFailedReason with Product with Serializable

:: DeveloperApi :: Task failed due to a runtime exception. This is the most common failure case and also captures user program exceptions.

stackTrace contains the stack trace of the exception itself. It still exists for backward compatibility. It's better to use this(e: Throwable, metrics: Option[TaskMetrics]) to create ExceptionFailure as it will handle the backward compatibility properly.

fullStackTrace is a better representation of the stack trace because it contains the whole stack trace including the exception and its causes

exception is the actual exception that caused the task to fail. It may be None in the case that the exception is not in fact serializable. If a task fails more than once (due to retries), exception is that one that caused the last failure.

Annotations
@DeveloperApi()
Source
TaskEndReason.scala
Linear Supertypes
Serializable, Serializable, Product, Equals, TaskFailedReason, TaskEndReason, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ExceptionFailure
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. TaskFailedReason
  7. TaskEndReason
  8. AnyRef
  9. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ExceptionFailure(className: String, description: String, stackTrace: Array[StackTraceElement], fullStackTrace: String, metrics: Option[TaskMetrics], exceptionWrapper: Option[ThrowableSerializationWrapper])

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. val className: String

  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  9. def countTowardsTaskFailures: Boolean

    Whether this task failure should be counted towards the maximum number of times the task is allowed to fail before the stage is aborted.

    Whether this task failure should be counted towards the maximum number of times the task is allowed to fail before the stage is aborted. Set to false in cases where the task's failure was unrelated to the task; for example, if the task failed because the executor it was running on was killed.

    Definition Classes
    TaskFailedReason

  10. val description: String

  11. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  12. def exception: Option[Throwable]

  13. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  14. val fullStackTrace: String

  15. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  16. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  17. val metrics: Option[TaskMetrics]

  18. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  19. final def notify(): Unit

    Definition Classes
    AnyRef

  20. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  21. val stackTrace: Array[StackTraceElement]

  22. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  23. def toErrorString: String

    Error message displayed in the web UI.

    Error message displayed in the web UI.

    Definition Classes
    ExceptionFailure → TaskFailedReason

  24. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  25. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  26. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from TaskFailedReason

Inherited from TaskEndReason

Inherited from AnyRef

Inherited from Any

Ungrouped