Re: PySpark worker fails with IOError Broken Pipe

2014-03-20 Thread Nicholas Chammas
I'm using Spark 0.9.0 on EC2, deployed via spark-ec2. The few times it's happened to me so far, the shell will just be idle for a few minutes and then BAM I get that error, but the shell still seems to work. If I find a pattern to the issue I will report it here. On Thu, Mar 20, 2014 at 8:10 AM

Re: PySpark worker fails with IOError Broken Pipe

2014-03-20 Thread Jim Blomo
I think I've encountered the same problem and filed https://spark-project.atlassian.net/plugins/servlet/mobile#issue/SPARK-1284 For me it hung the worker, though. Can you add reproducible steps and what version you're running? On Mar 19, 2014 10:13 PM, "Nicholas Chammas" wrote: > So I have the p