Re: [E] Re: SPARK-19547

2017-06-15 Thread Sree V
Hi Pankaj, >> After the second consumer group comes upDo you mean a second consumer starts >> with the same consumer group as the first ? createDirectStream is overloaded. One of the method, doesn't need you to specify partitions of a topic. Cheers - Sree On Thursday, June 8, 2017 9:56 AM

Re: [discuss] ending support for Java 6?

2015-04-30 Thread Sree V
If there is any possibility of getting the download counts,then we can use it as EOS criteria as well.Say, if download counts are lower than 30% (or another number) of Life time highest,then it qualifies for EOS. Thanking you. With Regards Sree On Thursday, April 30, 2015 2:22 PM, Sree

Re: [discuss] ending support for Java 6?

2015-04-30 Thread Sree V
Hi Team, Should we take this opportunity to layout and evangelize a pattern for EOL of dependencies.I propose, we follow the official EOL of java, python, scala, .And add say 6-12-24 months depending on the popularity. Java 6 official EOL Feb 2013Add 6-12 monthsAug 2013 - Feb 2014 official En

Re: Tungsten + Flink

2015-04-29 Thread Sree V
I agree, Ewan. We should also look into combining both Flink and Spark into one.This eases the industry adaptation instead. Thanking you. With Regards Sree On Wednesday, April 29, 2015 3:21 AM, Ewan Higgs wrote: Hi all, A quick question about Tungsten. The announcement of the Tun

Re: [RESULT] [VOTE] Release Apache Spark 1.2.2

2015-04-17 Thread Sree V
onfluence/display/MAVEN/PluginExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR]   mvn -rf :spark-streaming-flume_2.10   Thanking you. With Regards Sree On Friday, April 17, 2015 3:18 PM, Sree V wrote: Hi Sean, Thi

Re: [RESULT] [VOTE] Release Apache Spark 1.2.2

2015-04-17 Thread Sree V
ilt with the same flags when I tested and it succeeded. On Fri, Apr 17, 2015 at 8:53 AM, Sree V wrote: > Sorry, I couldn't catch up before closing the voting.If it still counts, mvn > package fails (1).  And didn't run test (2).  So, -1.1.mvn -Phadoop-2.4 > -Pyarn -Phive -Phive

Re: [RESULT] [VOTE] Release Apache Spark 1.2.2

2015-04-17 Thread Sree V
ilt with the same flags when I tested and it succeeded. On Fri, Apr 17, 2015 at 8:53 AM, Sree V wrote: > Sorry, I couldn't catch up before closing the voting.If it still counts, mvn > package fails (1).  And didn't run test (2).  So, -1.1.mvn -Phadoop-2.4 > -Pyarn -Phive -Phive

Re: [RESULT] [VOTE] Release Apache Spark 1.2.2

2015-04-17 Thread Sree V
ck On Thu, Apr 16, 2015 at 3:27 PM, Sean Owen wrote: > No, of course Jenkins runs tests. The way some of the tests work, they > need the build artifacts to have been created first. So it runs "mvn > ... -DskipTests package" then "mvn ... test" > > On Thu, Apr 16

Re: [VOTE] Release Apache Spark 1.2.2

2015-04-16 Thread Sree V
In my effort to vote for this release, I found these along: This is from jenkins. It uses "-DskipTests". [centos] $ /home/jenkins/tools/hudson.tasks.Maven_MavenInstallation/Maven_3.0.5/bin/mvn -Dhadoop.version=2.0.0-mr1-cdh4.1.2 -Dlabel=centos -DskipTests clean packageWe build on our locals /

Re: how long does it takes for full build ?

2015-04-16 Thread Sree V
6, 2015 at 12:42 PM, Sree V wrote: > 1. > 40 min+ to 1hr+, from jenkins. > I didn't find the commands of the job. Does it require a login ? > > Part of the console output: > >  > git checkout -f 3ae37b93a7c299bd8b22a36248035bca5de3422f >  > git rev-list de4fa6b6

Re: how long does it takes for full build ?

2015-04-16 Thread Sree V
+ ShaneHi Shane, Would you address 1. please ?  Thanking you. With Regards Sree On Thursday, April 16, 2015 12:46 PM, Sree V wrote: 1. 40 min+ to 1hr+, from jenkins.I didn't find the commands of the job. Does it require a login ? Part of the console output: > git che

Re: how long does it takes for full build ?

2015-04-16 Thread Sree V
/Spark/job/Spark-1.2-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/ Cheers On Thu, Apr 16, 2015 at 11:56 AM, Sree V wrote: Hi Team, How long does it takes for a full build 'mvn clean package' on spark 1.2.2-rc1 ? Thanking you. With Regards Sree

how long does it takes for full build ?

2015-04-16 Thread Sree V
Hi Team, How long does it takes for a full build 'mvn clean package' on spark 1.2.2-rc1 ? Thanking you. With Regards Sree

Re: start-slaves.sh uses local path from master on remote slave nodes

2015-04-14 Thread Sree V
https://issues.apache.org/jira/browse/SPARK-967 Hi Team, The reporter hasn't replied for the suggested change for this issue. Also, there is a work around suggested. Change or Work-A-Round, so we can close this issue ? Thanking you. With Regards Sree

Re: Streamline contribution process with update to Contribution wiki, JIRA rules

2015-04-13 Thread Sree V
Hi Sean, This is not the first time, I am hearing it. I agree with JIRA suggestion. In most of the companies that I worked, we have 'no status', 'no type', when a jira is created. And we set both, in sprint planning meetings. I am not sure, how easy it would be for apache jira.  As any change mig

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-13 Thread Sree V
+1builds - checktests - checkinstalls and sample run - check Thanking you. With Regards Sree On Friday, April 10, 2015 11:07 PM, Patrick Wendell wrote: Please vote on releasing the following candidate as Apache Spark version 1.3.1! The tag to be voted on is v1.3.1-rc2 (commit 3e8

Re: SPARK-5364

2015-04-13 Thread Sree V
Thank you, Raynold.  Thanking you. With Regards Sree On Sunday, April 12, 2015 11:18 AM, Reynold Xin wrote: I closed it. Thanks. On Sun, Apr 12, 2015 at 11:08 AM, Sree V wrote: > Hi, > I was browsing through the JIRAs and found this can be closed.If anyone > who

Re: SPARK-5364

2015-04-12 Thread Sree V
Hi, I was browsing through the JIRAs and found this can be closed.If anyone who has edit permissions on Spark JIRA, please close this. https://issues.apache.org/jira/browse/SPARK-5364 It is OpenIts Pull Request already merged Its parent and grand parent Resolved Thanking you. With Regards Sree