Re: Any interest in 'weighting' VectorTransformer which does component-wise scaling?

2015-02-01 Thread Octavian Geagla
I've added support for sparse vectors and created HadamardTF for the pipeline, please take a look on my branch . Thanks! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Any-interest-in

Re: Any interest in 'weighting' VectorTransformer which does component-wise scaling?

2015-01-29 Thread Octavian Geagla
Thanks for the responses. How would something like HadamardProduct or similar be in order to keep it explicit? Would still be a VectorTransformer so the name and trait would hopefully lead to a somewhat self-documenting class. Xiangrui, do you mean Hadamard product or transform? My initial pr

Any interest in 'weighting' VectorTransformer which does component-wise scaling?

2015-01-24 Thread Octavian Geagla
Hello, I found it useful to implement the Hadamard Product as a VectorTransformer. It can be applied to scale (by a constant) a certain dimension (column) of the data set. Since I've already implemented it and am using i

Re: Re-use scaling means and variances from StandardScalerModel

2015-01-12 Thread Octavian Geagla
Thanks for the suggestions. I've opened this JIRA ticket: https://issues.apache.org/jira/browse/SPARK-5207 Feel free to modify it, assign it to me, kick off a discussion, etc. I'd be more than happy to own this feature and PR. Thanks, -Octavian -- View this message in context: http://apa