gt; rdd2.values.count() * x) is invalid because the values
transformation and count action cannot be performed inside of the rdd1.map
transformation. For more information, see SPARK-5063.
any advices on this? Thanks.
--------------------
Thanks&Best regards!
San.Luo
- 原始邮件
compare.sh to compare chr1.txt and samplechr1.txt, get a
result1.txt. And looping it from 1 to 21 so that those 42 file are compared and
I can get 21 files like result1.txt,result2.txt...result21.txt.
Sorry for not adding some comments for my code.
------------------------
Thanks&Best r
some charactors
> not useful.
>
> 4.run shellcompare.sh to compare chr1.txt and samplechr1.txt, get a
> result1.txt. And looping it from 1 to 21 so that those 42 file are compared
> and I can get 21 files like result1.txt,result2.txt...result21.txt.
>
> Sorry for not adding some comme
mplechr1.txt, get a
result1.txt. And looping it from 1 to 21 so that those 42 file are compared and
I can get 21 files like result1.txt,result2.txt...result21.txt.
Sorry for not adding some comments for my code.
------------------------
Thanks&Best regards!
San.Luo
- 原始邮件 -
Can you can tell us what exactly you are trying to achieve?
Thanks
Best Regards
On Mon, May 25, 2015 at 5:00 PM, wrote:
> thanks, madhu and Akhil
>
> I modified my code like below,however I think it is not so distributed.
> Have you guys better idea to run this app more efficiantly and distribu
