Found another bug about the case preserving of column names of persistent views. This regression was introduced in 2.2. https://issues.apache.org/jira/browse/SPARK-21150
Thanks, Xiao 2017-06-19 8:03 GMT-07:00 Liang-Chi Hsieh <vii...@gmail.com>: > > I mean it is not a bug has been fixed before this feature added. Of course > kryo serializer with 2000+ partitions are working before this feature. > > > Koert Kuipers wrote > > If a feature added recently breaks using kryo serializer with 2000+ > > partitions then how can it not be a regression? I mean I use kryo with > > more > > than 2000 partitions all the time, and it worked before. Or was I simply > > not hitting this bug because there are other conditions that also need to > > be satisfied besides kryo and 2000+ partitions? > > > > On Jun 19, 2017 2:20 AM, "Liang-Chi Hsieh" < > > > viirya@ > > > > wrote: > > > > > > I think it's not. This is a feature added recently. > > > > > > Hyukjin Kwon wrote > >> Is this a regression BTW? I am just curious. > >> > >> On 19 Jun 2017 1:18 pm, "Liang-Chi Hsieh" < > > > >> viirya@ > > > >> > wrote: > >> > >> -1. When using kyro serializer and partition number is greater than > 2000. > >> There seems a NPE issue needed to fix. > >> > >> SPARK-21133 <https://issues.apache.org/jira/browse/SPARK-21133> > >> > >> > >> > >> > >> ----- > >> Liang-Chi Hsieh | @viirya > >> Spark Technology Center > >> http://www.spark.tc/ > >> -- > >> View this message in context: http://apache-spark- > >> developers-list.1001551.n3.nabble.com/VOTE-Apache-Spark- > >> 2-2-0-RC4-tp21677p21784.html > >> Sent from the Apache Spark Developers List mailing list archive at > >> Nabble.com. > >> > >> --------------------------------------------------------------------- > >> To unsubscribe e-mail: > > > >> dev-unsubscribe@.apache > > > > > > > > > > > > ----- > > Liang-Chi Hsieh | @viirya > > Spark Technology Center > > http://www.spark.tc/ > > -- > > View this message in context: http://apache-spark- > > developers-list.1001551.n3.nabble.com/VOTE-Apache-Spark- > > 2-2-0-RC4-tp21677p21786.html > > Sent from the Apache Spark Developers List mailing list archive at > > Nabble.com. > > > > --------------------------------------------------------------------- > > To unsubscribe e-mail: > > > dev-unsubscribe@.apache > > > > > > ----- > Liang-Chi Hsieh | @viirya > Spark Technology Center > http://www.spark.tc/ > -- > View this message in context: http://apache-spark- > developers-list.1001551.n3.nabble.com/VOTE-Apache-Spark- > 2-2-0-RC4-tp21677p21790.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > >
