RE: IPv6 support

2020-10-19 Thread Rao, Abhishek (Nokia - IN/Bangalore)
Hi, I see there is some implementation done in spark towards supporting IPv6. https://issues.apache.org/jira/browse/SPARK-32103 As per the description, it says support for IPv6 in Yarn mode. Do we have any plans to have IPv6 support for other resource managers (specially Kubernetes)? Thanks a

Re: Scala 2.13 actual class used for Seq

2020-10-19 Thread Sean Owen
It's possible the changes do change the concrete return type in 2.12 too, though no API interface types should change. I recall that because 2.13 makes WrappedArray a typedef (not gone, actually) I believe some code had to change that expected it, to make it work on 2.12 and 2.13. Apps shouldn't de

Re: Scala 2.13 actual class used for Seq

2020-10-19 Thread Koert Kuipers
i rebuild master for Spark 2.12 and i see it also uses List instead of WrappedArray. so the change is in master (compared to 3.0.1) and it is not limited to Scala 2.13. this might impact user programs somewhat? List has different performance characteristics than WrappedArray... for starters it is n

Re: Scala 2.13 actual class used for Seq

2020-10-19 Thread Sean Owen
Scala 2.13 changed the typedef of Seq to an immutable.Seq, yes. So lots of things will now return an immutable Seq. Almost all code doesn't care what Seq it returns and we didn't change any of that in the code, so, this is just what we're getting as a 'default' from whatever operations produce the