How many RDDs does DStream generate for a batch interval?

前端 未结 3 1389
礼貌的吻别
礼貌的吻别 2021-02-19 20:39

Does one batch interval of data generate one and only one RDD in DStream regardless of how big is the quantity of the data?

3条回答
  •  情书的邮戳
    2021-02-19 21:02

    In Spark Streaming Programming Guide - Discretized Streams (DStreams), there is:

    Each RDD in a DStream contains data from a certain interval

提交回复
热议问题