回复:multiple consumer of intermediate data set

2017-03-14 Thread Zhijiang(wangzhijiang999)
Hi  lining,         From JobGraph level, it is logic topology. There will be one IntermediateDataSet between each producer and consumer, like the case A-IntermediateDataSet-B,  A-IntermediateDataSet-D in the left graph.Also the same case for  B-IntermediateDataSet-C,  B-IntermediateDataSet-D, bu

回复:multiple consumer of intermediate data set

2017-03-13 Thread Zhijiang(wangzhijiang999)
Hi ,      I think there is no difference between JobVertex(A) and JobVertex(B). Because the JobVertex(C) is not shown in the right graph, it may mislead you.There should be another intermediate result partition between JobVertex(B) and JobVertex(C) for each parallelism, and that is the same case