Re: SparkR dataframe error

2016-05-18 Thread Sun Rui
I saw it, but I can’t see the complete error message on it. I mean the part after “error in invokingJava(…)” > On May 19, 2016, at 08:37, Gayathri Murali > wrote: > > There was a screenshot attached to my original email. If you did not get it, > attaching here again. > > On Wed, May 18, 2016

Re: SparkR dataframe error

2016-05-18 Thread Sun Rui
It’s wrong behaviour that head(df) outputs no row Could you send a screenshot displaying whole error message? > On May 19, 2016, at 08:12, Gayathri Murali > wrote: > > I am trying to run a basic example on Interactive R shell and run into the > following error. Also note that head(df) does not

Re: Query parsing error for the join query between different database

2016-05-18 Thread JaeSung Jun
Thanks Herman, I didn't recognise the "user" is reserved word. it works now. On 19 May 2016 at 08:02, Herman van Hövell tot Westerflier < hvanhov...@questtec.nl> wrote: > 'User' is a SQL2003 keyword. This is normally not a problem, except when > you use it as a table alias (which you are doing).

Re: Query parsing error for the join query between different database

2016-05-18 Thread Herman van Hövell tot Westerflier
'User' is a SQL2003 keyword. This is normally not a problem, except when you use it as a table alias (which you are doing). Change the alias or place it between backticks and you should be fine. 2016-05-18 23:51 GMT+02:00 JaeSung Jun : > It's spark 1.6.1 and hive 1.2.1 (spark-sql saying "SET > s

Re: Query parsing error for the join query between different database

2016-05-18 Thread JaeSung Jun
It's spark 1.6.1 and hive 1.2.1 (spark-sql saying "SET spark.sql.hive.version=1.2.1"). Thanks On 18 May 2016 at 23:31, Ted Yu wrote: > Which release of Spark / Hive are you using ? > > Cheers > > On May 18, 2016, at 6:12 AM, JaeSung Jun wrote: > > Hi, > > I'm working on custom data source prov

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

2016-05-18 Thread Reynold Xin
Hi Ovidiu-Cristian , The best source of truth is change the filter with target version to 2.1.0. Not a lot of tickets have been targeted yet, but I'd imagine as we get closer to 2.0 release, more will be retargeted at 2.1.0. On Wed, May 18, 2016 at 10:43 AM, Ovidiu-Cristian MARCU < ovidiu-crist

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

2016-05-18 Thread Ovidiu-Cristian MARCU
Yes, I can filter.. Did that and for example: https://issues.apache.org/jira/browse/SPARK-15370?jql=project%20%3D%20SPARK%20AND%20resolution%20%3D%20Unresolved%20AND%20affectedVersion%20%3D%202.0.0

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

2016-05-18 Thread Michael Armbrust
+1, excited for 2.0! On Wed, May 18, 2016 at 10:06 AM, Krishna Sankar wrote: > +1. Looks Good. > The mllib results are in line with 1.6.1. Deprecation messages. I will > convert to ml and test later in the day. > Also will try GraphX exercises for our Strata London Tutorial > > Quick Notes: > >

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

2016-05-18 Thread Krishna Sankar
+1. Looks Good. The mllib results are in line with 1.6.1. Deprecation messages. I will convert to ml and test later in the day. Also will try GraphX exercises for our Strata London Tutorial Quick Notes: 1. pyspark env variables need to be changed - IPYTHON and IPYTHON_OPTS are removed

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

2016-05-18 Thread Reynold Xin
Michael, You can comment on the JIRA ticket and tag some of the more active contributors to Mesos/SparkR. That said, committers are focusing on bug fixes and stability fixes at the moment for 2.0, and it's unlikely at this point for new features to get in. It can of course target the next release.

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

2016-05-18 Thread Reynold Xin
You can find that by changing the filter to target version = 2.0.0. Cheers. On Wed, May 18, 2016 at 9:00 AM, Ovidiu-Cristian MARCU < ovidiu-cristian.ma...@inria.fr> wrote: > +1 Great, I see the list of resolved issues, do you have a list of known > issue you plan to stay with this release? > > wi

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

2016-05-18 Thread Ovidiu-Cristian MARCU
+1 Great, I see the list of resolved issues, do you have a list of known issue you plan to stay with this release? with build/mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.7.1 -Phive -Phive-thriftserver -DskipTests clean package mvn -version Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c0747832

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

2016-05-18 Thread Sean Owen
I think it's a good idea. Although releases have been preceded before by release candidates for developers, it would be good to get a formal preview/beta release ratified for public consumption ahead of a new major release. Better to have a little more testing in the wild to identify problems befor

Re: CompileException for spark-sql generated code in 2.0.0-SNAPSHOT

2016-05-18 Thread Koert Kuipers
https://issues.apache.org/jira/browse/SPARK-15384 On Tue, May 17, 2016 at 9:06 PM, Michael Armbrust wrote: > Yeah, can you open a JIRA with that reproduction please? You can ping me > on it. > > On Tue, May 17, 2016 at 4:55 PM, Reynold Xin wrote: > >> It seems like the problem here is that we

PR for In-App Scheduling

2016-05-18 Thread Nick White
Hi ­ I raised a PR here: https://github.com/apache/spark/pull/12951 add a mechanism that prevents starvation when scheduling work within a single application. Could a committer take a look? Thanks - Nick smime.p7s Description: S/MIME cryptographic signature

Re: Query parsing error for the join query between different database

2016-05-18 Thread Ted Yu
Which release of Spark / Hive are you using ? Cheers > On May 18, 2016, at 6:12 AM, JaeSung Jun wrote: > > Hi, > > I'm working on custom data source provider, and i'm using fully qualified > table name in FROM clause like following : > > SELECT user. uid, dept.name > FROM userdb.user user, d

Query parsing error for the join query between different database

2016-05-18 Thread JaeSung Jun
Hi, I'm working on custom data source provider, and i'm using fully qualified table name in FROM clause like following : SELECT user. uid, dept.name FROM userdb.user user, deptdb.dept WHERE user.dept_id = dept.id and i've got the following error : MismatchedTokenException(279!=26) at org.antlr.