Hi Sunitha,
Make the class which is having the common function your calling as
serializable.
Thank you,
Naresh
On Wed, Dec 20, 2017 at 9:58 PM Sunitha Chennareddy <
chennareddysuni...@gmail.com> wrote:
> Hi,
>
> Thank You All..
>
> Here is my requirement, I have a dataframe which contains list
Hi,
Thank You All..
Here is my requirement, I have a dataframe which contains list of rows
retrieved from oracle table.
I need to iterate dataframe and fetch each record and call a common
function by passing few parameters.
Issue I am facing is : I am not able to call common function
JavaRDD pe
Hi Sunitha,
In the mapper function, you cannot update outer variables such as
`personLst.add(person)`,
this won't work so that's the reason you got an empty list.
You can use `rdd.collect()` to get a local list of `Person` objects first,
then you can safely iterate on the local list and do any up
Hi Jorn,
In my case I have to call common interface function
by passing the values of each rdd. So I have tried iterating , but I was
not able to trigger common function from call method as commented in the
snippet code in my earlier mail.
Request you please share your views.
Regards
Sunitha
On
This is correct behavior. If you need to call another method simply append
another map, flatmap or whatever you need.
Depending on your use case you may use also reduce and reduce by key.
However you never (!) should use a global variable as in your snippet. This can
to work because you work in
Hi Deepak,
I am able to map row to person class, issue is I want to to call another
method.
I tried converting to list and its not working with out using collect.
Regards
Sunitha
On Tuesday, December 19, 2017, Deepak Sharma wrote:
> I am not sure about java but in scala it would be something li
I am not sure about java but in scala it would be something like
df.rdd.map{ x => MyClass(x.getString(0),.)}
HTH
--Deepak
On Dec 19, 2017 09:25, "Sunitha Chennareddy"
wrote:
Hi All,
I am new to Spark, I want to convert DataFrame to List with out
using collect().
Main requirement is I nee
Hi All,
I am new to Spark, I want to convert DataFrame to List with out
using collect().
Main requirement is I need to iterate through the rows of dataframe and
call another function by passing column value of each row (person.getId())
Here is the snippet I have tried, Kindly help me to resolve
