Re: Docker image to build Spark/Spark doc

2018-10-10 Thread Robert Kruszewski
Me and my colleagues built one for running spark builds on circleci. The images are at https://hub.docker.com/r/palantirtechnologies/circle-spark-python/ (circle-spark-r if you want to build sparkr). Dockerfiles for those images can be found at https://github.com/palantir/spark/tree/master/dev/dock

Re: [VOTE] Apache Spark 2.1.0 (RC1)

2016-12-01 Thread Robert Kruszewski
-1 since https://issues.apache.org/jira/browse/SPARK-17213 is a correctness regression from 2.0 release. The commit that caused it is 776d183c82b424ef7c3cae30537d8afe9b9eee83. Robert From: Reynold Xin Date: Tuesday, November 29, 2016 at 1:25 AM To: "dev@spark.apache.org" Subject: [VOTE

Re: critical bugs to be fixed in Spark 2.0.1?

2016-08-22 Thread Robert Kruszewski
SPARK-16991 (https://github.com/apache/spark/pull/14661) would be nice Robert From: Reynold Xin Date: Monday, August 22, 2016 at 8:14 PM To: "dev@spark.apache.org" Subject: critical bugs to be fixed in Spark 2.0.1? We should work on a 2.0.1 release soon, since we have found couple cri

[1.6] Coalesce/binary operator on casted named column

2016-01-15 Thread Robert Kruszewski
Hi Spark devs, I have been debugging failing unit test in our application and it led me to believe that the bug is in spark itself. The exception I am getting is org.apache.spark.sql.catalyst.analysis.UnresolvedException: Invalid call to dataType on unresolved object, tree: unresolvedalias(cast(