回复：Re: Re: Re: How to decrease the time of storing block in memory

i + ".txt 600") pipeModify2.collect() sc.stop() } } -------------------- Thanks&Best regards! San.Luo - 原始邮件 - 发件人：Akhil Das 收件人：罗辉 抄送人：user 主题：Re: Re: How to decrease the time of storing block in memory 日期：2015年06月09日 16点51分 Is it that task taking 1

Re: Re: Re: How to decrease the time of storing block in memory

> /opt/data/shellcompare/data/user" + j + "/pgs/intermediateResult/result" + > i + ".txt 600") > > pipeModify2.collect() > > sc.stop() > } > } > > > > > Thanks&Best regards! > San.Luo

回复：Re: Re: How to decrease the time of storing block in memory

llcompare/data/user" + j + "/pgs/intermediateResult/result" + i + ".txt 600") pipeModify2.collect() sc.stop() } } -------------------- Thanks&Best regards! San.Luo - 原始邮件 - 发件人：Akhil Das 收件人：罗辉 抄送人：user 主题：Re: Re: How to decrease the time of storing block i

Re: Re: How to decrease the time of storing block in memory

Is it that task taking 19s? It won't be simply taking 19s to store 2KB of data into memory there could be other operations happening too (the transformations that you are doing), It would be good if you can paste the code snippet that you are running to have a better understanding. Thanks Best Reg