If a feature added recently breaks using kryo serializer with 2000+ partitions then how can it not be a regression? I mean I use kryo with more than 2000 partitions all the time, and it worked before. Or was I simply not hitting this bug because there are other conditions that also need to be satisfied besides kryo and 2000+ partitions?
On Jun 19, 2017 2:20 AM, "Liang-Chi Hsieh" <vii...@gmail.com> wrote: I think it's not. This is a feature added recently. Hyukjin Kwon wrote > Is this a regression BTW? I am just curious. > > On 19 Jun 2017 1:18 pm, "Liang-Chi Hsieh" < > viirya@ > > wrote: > > -1. When using kyro serializer and partition number is greater than 2000. > There seems a NPE issue needed to fix. > > SPARK-21133 <https://issues.apache.org/jira/browse/SPARK-21133> > > > > > ----- > Liang-Chi Hsieh | @viirya > Spark Technology Center > http://www.spark.tc/ > -- > View this message in context: http://apache-spark- > developers-list.1001551.n3.nabble.com/VOTE-Apache-Spark- > 2-2-0-RC4-tp21677p21784.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: > dev-unsubscribe@.apache ----- Liang-Chi Hsieh | @viirya Spark Technology Center http://www.spark.tc/ -- View this message in context: http://apache-spark- developers-list.1001551.n3.nabble.com/VOTE-Apache-Spark- 2-2-0-RC4-tp21677p21786.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
