> Is this python right? I'm not used to it, I'm used to scala, so
>
No. It is Java.
> val toDebug = rdd.foreachPartition(partition -> { //breakpoint stop here
> *// by val toDebug I mean to assign the result of foreachPartition to a
> variable*
> partition.forEachRemaining(message -> {
>
Try this:
Is this python right? I'm not used to it, I'm used to scala, so
val toDebug = rdd.foreachPartition(partition -> { //breakpoint stop here
*// by val toDebug I mean to assign the result of foreachPartition to a
variable*
partition.forEachRemaining(message -> {
//breakpoint doen
> Hi Marcelo, this is because the operations in rdd are lazy, you will only
> stop at this inside foreach breakpoint when you call a first, a collect or
> a reduce operation.
>
Does forEachRemaining isn't a final method as first, collect or reduce?
Anyway, I guess this is not the problem itself be
Hi Marcelo, this is because the operations in rdd are lazy, you will only
stop at this inside foreach breakpoint when you call a first, a collect or
a reduce operation.
This is when the spark will run the operations.
Have you tried that?
Cheers.
2016-05-31 17:18 GMT-03:00 Marcelo Oikawa :
> Hell
