Starter tasks to start contributing

2017-05-17 Thread vys6fudl
Hi! I would like to contribute to Spark since I use it at work. Are there some starter tasks related to Spark Core or Spark Streaming that I could work on? I couldn't find the right search in JIRA, so if someone could even point me to that if there is already stuff tagged there, then that would b

Re: [build system] jenkins got itself wedged...

2017-05-17 Thread shane knapp
i'm going to need to perform a quick reboot on the jenkins master. it looks like it's hung again. sorry about this! shane On Tue, May 16, 2017 at 12:55 PM, shane knapp wrote: > ...but just now i started getting alerts on system load, which was > rather high. i had to kick jenkins again, and w

Re: [build system] jenkins got itself wedged...

2017-05-17 Thread shane knapp
ok, we're back up, system load looks cromulent and we're happily building (again). shane On Wed, May 17, 2017 at 9:50 AM, shane knapp wrote: > i'm going to need to perform a quick reboot on the jenkins master. it > looks like it's hung again. > > sorry about this! > > shane > > On Tue, May 16,

Any plans to release 1.6.4 and/or 2.0.3?

2017-05-17 Thread Gerhard Fiedler
We’re interested in the Python 3.6 support that has been fixed in 2.1.1 and apparently has been backported to the unreleased versions 1.6.4 and 2.0.3. Are there any plans to release these versions? Thanks, Gerhard

unsubscribe

2017-05-17 Thread williamtellme123
unsubscribe From: Gerhard Fiedler [mailto:gfied...@algebraixdata.com] Sent: Wednesday, May 17, 2017 1:57 PM To: dev@spark.apache.org Subject: Any plans to release 1.6.4 and/or 2.0.3? We’re interested in the Python 3.6 support that has been fixed in 2.1.1 and apparently has been backported

Re: [VOTE] Apache Spark 2.2.0 (RC2)

2017-05-17 Thread Russell Spitzer
Seeing an issue with the DataScanExec and some of our integration tests for the SCC. Running dataframe read and writes from the shell seems fine but the Redaction code seems to get a "None" when doing SparkSession.getActiveSession.get in our integration tests. I'm not sure why but i'll dig into thi

Re: [build system] jenkins got itself wedged...

2017-05-17 Thread shane knapp
after another couple of restarts due to high load and system unresponsiveness, i finally found what is the most likely culprit: a typo in the jenkins config where the java heap size was configured. instead of -Xmx16g, we had -Dmx16G... which could easily explain the random and non-deterministic s

Local compilation with test is slow

2017-05-17 Thread xianyang liu
Hi all, When I compile the spark code with test in local (I didn’t download sbt or configure it). I see it takes about 10~20 minutes to pass the test case 'test("ivy path works correctly”)’ of `SparkSubmitUtilsSuite`. Looking at the log of jstack, it seems still reading something. And after i

Zeppelin - Spark2 Hortworks

2017-05-17 Thread Raj, Deepu
Hi Team, Can we have Spark 2 configured for Zeppelin on a Hortonworks cluster 2.5 ? Thanks, Deepu Raj