On 6 Mar 2017, at 12:30, Nira Amit
mailto:amitn...@gmail.com>> wrote:
And it's very difficult if it's doing unexpected things.
All serialisations do unexpected things. Nobody understands them. Sorry
And by the way - I don't want the Avro details to be hidden away from me.
The whole purpose of the work I'm doing is to benchmark different
serialization tools and strategies. If I want to use Kryo serialization for
example, then I need to understand how the API works. And it's very
difficult if it
#x27;s just
>> confusing and makes it so much harder to pinpoint the real problem.
>>
>> As I said, this weird behavior cost me a lot of time, and I've been
>> googling
>> this for weeks and am getting the impression that very few Java developers
>
overflow.com/questions/41836851/wrong-runtime-type-in-rdd-when-reading-from-avro-with-custom-serializer
> >
> about it in StackOverflow and got several views and upvotes but no replies
> (a similar question
> <
> http://stackoverflow.com/questions/41834120/override-avroio-default-co
be considered a bug.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Wrong-runtime-type-when-using-newAPIHadoopFile-in-Java-tp28459.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
