Getting Started
User Guide
API Reference
Development
Migration Guide
Spark SQL
Pandas API on Spark
Structured Streaming
MLlib (DataFrame-based)
Spark Streaming
MLlib (RDD-based)
Spark Core
Resource Management
pyspark.streaming.DStream.foreachRDD
¶
DStream.
foreachRDD
(
func
:
Union[Callable[[pyspark.rdd.RDD[T]], None], Callable[[datetime.datetime, pyspark.rdd.RDD[T]], None]]
)
→ None
[source]
¶
Apply a function to each RDD in this DStream.
pyspark.streaming.DStream.flatMapValues
pyspark.streaming.DStream.fullOuterJoin