Hi, Time is usually the criteria if I’m understanding your question. An RDD is created for each batch interval. If your interval is 500ms then an RDD would be created every 500ms. If it’s 2 seconds then an RDD is created every 2 seconds.
Cheers, David From: Natu Lauchande [mailto:[email protected]] Sent: Tuesday, April 12, 2016 7:09 AM To: [email protected] Subject: DStream how many RDD's are created by batch Hi, What's the criteria for the number of RDD's created for each micro bath iteration ? Thanks, Natu
