Re: On convenience methods

2016-10-18 Thread Holden Karau
I think what Reynold means is that if its easy for a developer to build this convenience function using the current Spark API it probably doesn't need to go into Spark unless its being done to provide a similar API to a system we are attempting to be semi-compatible with (e.g. if a corresponding co

Re: On convenience methods

2016-10-18 Thread roehst
Sorry, by API you mean by use of 3rd party libraries or user code or something else? Thanks -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/On-convenience-methods-tp19460p19496.html Sent from the Apache Spark Developers List mailing list archive at Na

Re: On convenience methods

2016-10-14 Thread Reynold Xin
It is very difficult to give a general answer. We would need to discuss each case. In general things that are trivially doable using existing APIs, it is not a good idea to provide them, unless for compatibility with other frameworks (e.g. Pandas). On Fri, Oct 14, 2016 at 5:38 PM, roehst wrote: