Re: Spark SQL incorrect result on GROUP BY query

Thanks for verifying! On Thu, Jun 12, 2014 at 12:28 AM, Pei-Lun Lee wrote: > I reran with master and looks like it is fixed. > > > > 2014-06-12 1:26 GMT+08:00 Michael Armbrust : > > I'd try rerunning with master. It is likely you are running into >> SPARK-1994

Re: Spark SQL incorrect result on GROUP BY query

I reran with master and looks like it is fixed. 2014-06-12 1:26 GMT+08:00 Michael Armbrust : > I'd try rerunning with master. It is likely you are running into > SPARK-1994 . > > Michael > > > On Wed, Jun 11, 2014 at 3:01 AM, Pei-Lun Lee wrote

Re: Spark SQL incorrect result on GROUP BY query

I'd try rerunning with master. It is likely you are running into SPARK-1994 . Michael On Wed, Jun 11, 2014 at 3:01 AM, Pei-Lun Lee wrote: > Hi, > > I am using spark 1.0.0 and found in spark sql some queries use GROUP BY > give weird results. >

RE: Spark SQL incorrect result on GROUP BY query

That’s a good catch, but I think it’s suggested to use HiveContext currently. ( https://github.com/apache/spark/tree/master/sql) Catalyst$> sbt/sbt hive/console case class Foo(k: String, v: Int) val rows = List.fill(100)(Foo("a", 1)) ++ List.fill(200)(Foo("b", 2)) ++ List.fill(300)(Foo("c", 3))