Gotcha, thanks !
pk
Hmmm, I think this might be a bug which is only exposed when one of the mappers
gets zero rows of input.
If you have a Hive build, can you try adding this before line 238 of
GenericUDAFnGrams.java?
if (n == 0) {
return;
}
Just before this line:
if(myagg.n > 0 && n > 0 && myagg.n != n)
Hoping someone with more expertise could help on this:
I have no idea what's causing this to happen, but here is the exception:
java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
Hive Runtime Error while processing row (tag=0)
{"key":{},"value":{"_col0":["0","0","0","
Thanks Steven. Now I'm out of that bug, but another one pops when I'm trying
for
Dynamic partitions with larger tables. I have implemenetd the same on smaller
tables using the same approach mentioned below, but some how it fails for
larger
tables.
My Larger source Table(parameter_def) contain