Re: java program Get Stuck at broadcasting

2015-05-21 Thread Allan Jie
Hi, Just check the logs of datanode, it looks like this: 2015-05-20 11:42:14,605 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: / 10.9.0.48:50676, dest: /10.9.0.17:50010, bytes: 134217728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_804680172_54, offset: 0, srvID: 39fb78

Re: java program Get Stuck at broadcasting

2015-05-21 Thread Allan Jie
st>(); for(int i=0;i(new Pair(i,jIndex),Math.sqrt(sum))); } return list; } }); distance.saveAsTextFile("hdfs://HadoopV26Master:9000/user/"+args[0]); } } On 21 May 2015 at 16:44, Akhil Das wrote: > Can you share the code, may be i/someone can help you out > > Thanks >

Re: java program Get Stuck at broadcasting

2015-05-21 Thread Allan Jie
Hey, I think I found out the problem. Turns out that the file I saved is too large. On 21 May 2015 at 16:44, Akhil Das wrote: > Can you share the code, may be i/someone can help you out > > Thanks > Best Regards > > On Thu, May 21, 2015 at 1:45 PM, Allan Jie wrote: > &g