def foo(extra_arg):
….
def bar(row):
# your code here
return bar
then pass foo(extra_arg) to spark map function.
--
Best Regards!
On Thursday, August 21, 2014 at 2:33 PM, TJ Klein wrote:
> Hi,
>
> I am using Spark in Python. I wonder if there is a possibility for passing
> extra arguments to the mapping function. In my scenario, after each map I
> update parameters, which I want to use in the folllowning new iteration of
> mapping. Any idea?
>
> Thanks in advance.
>
> -Tassilo
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Mapping-with-extra-arguments-tp12541.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com
> (http://Nabble.com).
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> (mailto:[email protected])
> For additional commands, e-mail: [email protected]
> (mailto:[email protected])
>
>