Re: RFC: [SPARK-529] Create constants for known config variables.

2014-06-24 Thread Marcelo Vanzin
Hi Matei, thanks for the comments. On Mon, Jun 23, 2014 at 7:58 PM, Matei Zaharia wrote: > When we did the configuration pull request, we actually avoided having a big > list of defaults in one class file, because this creates a file that all the > components in the project depend on. For examp

Re: RFC: [SPARK-529] Create constants for known config variables.

2014-06-23 Thread Matei Zaharia
Hey Marcelo, When we did the configuration pull request, we actually avoided having a big list of defaults in one class file, because this creates a file that all the components in the project depend on. For example, since we have some settings specific to streaming and the REPL, do we want tho

RFC: [SPARK-529] Create constants for known config variables.

2014-06-23 Thread Marcelo Vanzin
I started with some code to implement an idea I had for SPARK-529, and before going much further (since it's a large and kinda boring change) I'd like to get some feedback from people. Current code it at: https://github.com/vanzin/spark/tree/SPARK-529 There are still some parts I haven't fully fl