Re: [VOTE] Apache Spark 2.2.0 (RC4)

Hi yeah sorry for slow response - I was RHEL and OpenJDK but will have to report back later with the versions as am AFK. R version not totally sure but again will revert asap On Wed, 14 Jun 2017 at 05:09, Felix Cheung wrote: > Thanks > This was with an external package and unrelated > > >> mac

Re: [VOTE] Apache Spark 2.2.0 (RC4)

Thanks This was with an external package and unrelated >> macOS Sierra 10.12.3 / R 3.2.3 - passed with a warning (https://gist.github.com/HyukjinKwon/85cbcfb245825852df20ed6a9ecfd845) As for CentOS - would it be possible to test against R older than 3.4.0? This is the same error reported by N

Re: [VOTE] Apache Spark 2.2.0 (RC4)

For the test failure on R, I checked: Per https://github.com/apache/spark/tree/v2.2.0-rc4, 1. Windows Server 2012 R2 / R 3.3.1 - passed ( https://ci.appveyor.com/project/spark-test/spark/build/755-r-test-v2.2.0-rc4 ) 2. macOS Sierra 10.12.3 / R 3.4.0 - passed 3. macOS Sierra 10.12.3 / R 3.2.3 -

Re: [VOTE] Apache Spark 2.2.0 (RC4)

-1 Spark 2.2 is unable to read the partitioned table created by Spark 2.1 or earlier. Opened a JIRA https://issues.apache.org/jira/browse/SPARK-21085 Will fix it soon. Thanks, Xiao Li 2017-06-13 9:39 GMT-07:00 Joseph Bradley : > Re: the QA JIRAs: > Thanks for discussing them. I still feel

Re: [RISE Research] [build system] jenkins currently down due to campus-wide power failure

Dodged a fire too! On Tue, Jun 13, 2017 at 3:31 PM, shane knapp wrote: > ok, we're back up... thankfully i didn't need to go to the colo! > > shane (who strongly feels he just dodged a bullet) > > On Tue, Jun 13, 2017 at 3:06 PM, shane knapp wrote: > > i'm able to VPN in, but not connect to th

Re: [build system] jenkins currently down due to campus-wide power failure

ok, we're back up... thankfully i didn't need to go to the colo! shane (who strongly feels he just dodged a bullet) On Tue, Jun 13, 2017 at 3:06 PM, shane knapp wrote: > i'm able to VPN in, but not connect to the master or any slaves. it's > looking like i'll need to head down from my building

[build system] jenkins currently down due to campus-wide power failure

i'm able to VPN in, but not connect to the master or any slaves. it's looking like i'll need to head down from my building to the colo and see what's up. shane - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: BUILD FAILURE at Spark Project Test Tags for 2.11.7?

this can also happen if your PATH is not set properly (but JAVA_HOME is), just in case anyone hits this in the future. This simply fixes it: $ export PATH=$PATH:$JAVA_HOME/bin and rerun build -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/BUILD-FAIL

Re: Can I use ChannelTrafficShapingHandler to control the network read/write speed in shuffle?

I took a look at ChannelTrafficShapingHandler. Looks like it's because it doesn't support FileRegion. Spark's messages use this interface. See org.apache.spark.network.protocol.MessageWithHeader. On Tue, Jun 13, 2017 at 4:17 AM, Niu Zhaojie wrote: > Hi All: > > I am trying to control the network

Re: [build system] jenkins firewall reboot

...and we're back! On Tue, Jun 13, 2017 at 10:17 AM, shane knapp wrote: > i have been seeing continuous and slow network speeds apparently being > caused by the VPN... it's currently rebooting and should be back up > in ~5 mins. > > sorry for the interruption is service! ---

[build system] jenkins firewall reboot

i have been seeing continuous and slow network speeds apparently being caused by the VPN... it's currently rebooting and should be back up in ~5 mins. sorry for the interruption is service! - To unsubscribe e-mail: dev-unsubscr.

Re: Performance regression for partitioned parquet data

Hi Bertrand, I encourage you to create a ticket for this and submit a PR if you have time. Please add me as a listener, and I'll try to contribute/review. Michael > On Jun 6, 2017, at 5:18 AM, Bertrand Bossy > wrote: > > Hi, > > since moving to spark 2.1 from 2.0, we experience a performanc

Re: [VOTE] Apache Spark 2.2.0 (RC4)

Re: the QA JIRAs: Thanks for discussing them. I still feel they are very helpful; I particularly notice not having to spend a solid 2-3 weeks of time QAing (unlike in earlier Spark releases). One other point not mentioned above: I think they serve as a very helpful reminder/training for the commu

how to debug app with cluster mode please?

Hi all, I am learning spark 2.1code. I write app with "master[4]", I run and debug code.It works well. when I change code with "master[2,2??1024]" and debug it as before, I meet error as follow: java.lang.classnotfindexception: com.xxx.xxx$$anonfun$main$1 the class is my main class. Would

Can I use ChannelTrafficShapingHandler to control the network read/write speed in shuffle?

Hi All: I am trying to control the network read/write speed with ChannelTrafficShapingHandler provided by Netty. In TransportContext.java I modify it as below: public TransportChannelHandler initializePipeline( SocketChannel channel, RpcHandler channelRpcHandler) { try {