I did not try the Akka configs. I was doing a shuffle operation, I believe
a sort, but two copies of the operation at the same time. It was a 20M row
dataset of reasonable horizontal size.
On Sat, Aug 23, 2014 at 2:23 PM, Jiayu Zhou wrote:
> I saw your post. What are the operations you did? Are
I saw your post. What are the operations you did? Are you trying to collect
data from driver? Did you try the akka configurations?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/FetchFailed-when-collect-at-YARN-cluster-tp12670p12703.html
Sent from the Apac
I think I emailed about a similar issue, but in standalone mode. I haven't
investigated much so I don't know what's a good fix.
On Fri, Aug 22, 2014 at 12:00 PM, Jiayu Zhou wrote:
> Hi,
>
> I am having this FetchFailed issue when the driver is about to collect
> about
> 2.5M lines of short stri