Re: [discuss] ending support for Java 7 in Spark 2.0

2016-03-24 Thread Ram Sriharsha
27;ve looked into in the past that support only > Java 8. This is more common in high performance libraries such as Aeron (a > messaging library). Having to support Java 7 means we are not able to use > these. It is not that big of a deal right now, but will become increasingly > more

Re: Welcoming two new committers

2016-02-08 Thread Ram Sriharsha
;>>> Tungsten, adding new features, optimizations and APIs. Please join me in >>>>> welcoming Herman and Wenchen. >>>>> >>>>> Matei >>>>> - >>>>> To unsubscri

Re: Predicate push-down bug?

2015-09-15 Thread Ram Sriharsha
Hi Ravi This does look like a bug.. I have created a JIRA to track it here: https://issues.apache.org/jira/browse/SPARK-10623 Ram On Tue, Sep 15, 2015 at 10:47 AM, Ram Sriharsha wrote: > Hi Ravi > > Can you share more details? What Spark version are you running? > > Ram >

Re: Predicate push-down bug?

2015-09-15 Thread Ram Sriharsha
Hi Ravi Can you share more details? What Spark version are you running? Ram On Tue, Sep 15, 2015 at 10:32 AM, Ravi Ravi wrote: > Turning on predicate pushdown for ORC datasources results in a > NoSuchElementException: > > scala> val df = sqlContext.sql("SELECT name FROM people WHERE age < 15")

Re: [discuss] Removing individual commit messages from the squash commit message

2015-07-18 Thread Ram Sriharsha
+1 Sent from my iPhone > On Jul 18, 2015, at 2:44 PM, Patrick Wendell wrote: > > +1 from me too > >> On Sat, Jul 18, 2015 at 3:32 AM, Ted Yu wrote: >> +1 to removing commit messages. >> >> >> >>> On Jul 18, 2015, at 1:35 AM, Sean Owen wrote: >>> >>> +1 to removing them. Sometimes there

Re: TableScan vs PrunedScan

2015-07-07 Thread Ram Sriharsha
Hi Gil You would need to prune the resulting Row as well based on the requested columns. Ram Sent from my iPhone > On Jul 7, 2015, at 3:12 AM, Gil Vernik wrote: > > Hi All, > > I wanted to experiment a little bit with TableScan and PrunedScan. > My first test was to print columns from var

Re: Remove Hadoop 1 support (Hadoop <2.2) for Spark 1.5?

2015-06-12 Thread Ram Sriharsha
+1 for Hadoop 2.2+ On Fri, Jun 12, 2015 at 8:45 AM, Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > I'm personally in favor, but I don't have a sense of how many people still > rely on Hadoop 1. > > Nick > > 2015년 6월 12일 (금) 오전 9:13, Steve Loughran > ste...@hortonworks.com>님이 작성: > > +1 f

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-05 Thread Ram Sriharsha
+1 , tested with hadoop 2.6/ yarn on centos 6.5 after building w/ -Pyarn -Phadoop-2.4 -Dhadoop.version=2.6.0 -Phive -Phive-thriftserver and ran a few SQL tests and the ML examples On Fri, Jun 5, 2015 at 10:55 AM, Hari Shreedharan wrote: > +1. Build looks good, ran a couple apps on YARN > > > T

Re: Contribute code to MLlib

2015-05-20 Thread Ram Sriharsha
than another in every scenario etc I think the guideline explains what a good contribution to the core library should look like better than I initially attempted to ! Sent from my iPhone > On May 20, 2015, at 9:31 AM, Ram Sriharsha wrote: > > Hi Trevor > > Good point, I d

Re: Contribute code to MLlib

2015-05-20 Thread Ram Sriharsha
nt than > calculus in large class of cases", maybe its true- but geometry won't help > you if you are in a case where you need calculus. > > This all relies on the assumption that MLib is destined to be a rich data > science/machine learning package. It may be that the

Re: Contribute code to MLlib

2015-05-19 Thread Ram Sriharsha
Hi Trevor, Tarek You make non standard algorithms (PCA or otherwise) available to users of Spark as Spark Packages. http://spark-packages.org https://databricks.com/blog/2014/12/22/announcing-spark-packages.html With the availability of spark packages, adding powerful experimental / alternative m

Re: [discuss] ending support for Java 6?

2015-04-30 Thread Ram Sriharsha
+1 for end of support for Java 6 On Thursday, April 30, 2015 3:08 PM, Vinod Kumar Vavilapalli wrote: FYI, after enough consideration, we the Hadoop community dropped support for JDK 6 starting release Apache Hadoop 2.7.x. Thanks +Vinod On Apr 30, 2015, at 12:02 PM, Reynold Xin w

Re: Should we let everyone set Assignee?

2015-04-22 Thread Ram Sriharsha
agreed, what Patrick suggests seems very reasonable. On Wednesday, April 22, 2015 1:26 PM, Mark Hamstra wrote: Agreed.  The Spark project and community that Vinod describes do not resemble the ones with which I am familiar. On Wed, Apr 22, 2015 at 1:20 PM, Patrick Wendell wrote: