w what is a connection between RDD and blocks (I
>> know that for every batch one RDD is produced)? what is a block in this
>> context? is it a disk block ? if so, what is it default size? and Finally,
>> why does the following error happens so often?
>>
>> java.lang.Except
nection between RDD and blocks (I know
> that for every batch one RDD is produced)? what is a block in this context?
> is it a disk block ? if so, what is it default size? and Finally, why does
> the following error happens so often?
>
> java.lang.Exception: Could not comput
ntext?
is it a disk block ? if so, what is it default size? and Finally, why does
the following error happens so often?
java.lang.Exception: Could not compute split, block input-0-1480539568000
not found
On Thu, Dec 1, 2016 at 12:42 AM, kant kodali wrote:
> I also use th
public void call(JavaPairRDD
>> stringIntegerJavaPairRDD) throws Exception {
>> Map map = new HashMap<>();
>> Gson gson = new Gson();
>> stringIntegerJavaPairRDD
>> .col
.forEach((Tuple2 KV) -> {
> String status = KV._1();
> Integer count = KV._2();
> map.put(status, count);
> }
>
}
);
NSQReceiver.send(producer, "output_777",
gson.toJson(map).getBytes());
}
});
Thanks,
kant
On Wed, Nov 30, 2016 at 2:11 PM, Marco Mistroni wrote:
> Could you paste reproducible snippet code?
> Kr
>
> On 30 Nov 2016 9
Could you paste reproducible snippet code?
Kr
On 30 Nov 2016 9:08 pm, "kant kodali" wrote:
> I have lot of these exceptions happening
>
> java.lang.Exception: Could not compute split, block input-0-1480539568000
> not found
>
>
> Any ideas what this could be?
>
I have lot of these exceptions happening
java.lang.Exception: Could not compute split, block input-0-1480539568000
not found
Any ideas what this could be?