[GitHub] spark pull request: SPARK-1251 Support for optimizing and executin...

2014-03-14 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/146 SPARK-1251 Support for optimizing and executing structured queries This pull request adds support to Spark for working with structured data using a simple SQL dialect, HiveQL and a Scala Query DSL

[GitHub] spark pull request: Fix serialization of MutablePair. Also provide...

2014-03-14 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/141#issuecomment-37679480 Changed to update. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Don't swallow all kryo errors, only those that...

2014-03-14 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/142 Don't swallow all kryo errors, only those that indicate we are out of data. You can merge this pull request into a Git repository by running: $ git pull https://github.com/marmbrus/

[GitHub] spark pull request: Fix serialization of MutablePair. Also provide...

2014-03-14 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/141 Fix serialization of MutablePair. Also provide an interface for easy updating. You can merge this pull request into a Git repository by running: $ git pull https://github.com/marmbrus/spark

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-03-12 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/126#discussion_r10551528 --- Diff: core/src/main/scala/org/apache/spark/util/TimeStampedWeakValueHashMap.scala --- @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-1103] [WIP] Automatic garbage collectio...

2014-03-11 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/126#issuecomment-37357590 Hey TD, I just glanced at this quickly, but I have two small suggestions with the way you are using finalizers. First, errors in finalizers aren't reported by t