[
https://issues.apache.org/jira/browse/PIG-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847092#comment-15847092
]
Rohini Palaniswamy commented on PIG-5118:
-----------------------------------------
Thanks [~szita] for fixing this. It did fail in our internal jenkins as well.
Committed the PIG-5118.fixTest.patch.
bq. Seems like you forgot to regenerate the golden files after started using
FileLocalizer.setR(new Random(1331L))
Actually I did regenerate and it was passing fine in my laptop due to
https://github.com/apache/pig/blob/trunk/src/org/apache/pig/impl/io/FileLocalizer.java#L497-L499.
I should have cleaned up /tmp/temp* files before generating the golden file.
> Script fails with Invalid dag containing 0 vertices
> ---------------------------------------------------
>
> Key: PIG-5118
> URL: https://issues.apache.org/jira/browse/PIG-5118
> Project: Pig
> Issue Type: Bug
> Components: tez
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.17.0, 0.16.1
>
> Attachments: PIG-5118-1.patch, PIG-5118-2.patch, PIG-5118-3.patch,
> PIG-5118.fixTest.patch
>
>
> The current code of splitting DAG does not handle cases where there is
> split and a clean segmentation is not possible. It also does not handle cases
> where there is multiple segments and they are later used together. Both cases
> it ends up with "Invalid dag containing 0 vertices" error as it creates one
> empty DAG and and a new DAG which contains the full original plan as it was
> not able to segment.
> Usually can ask user to get rid of unnecessary store and then load if in same
> script as it is usually a result of bad programming and inefficient. But in
> this case they were part of different large scripts and run as below.
> {code:title=script.pig}
> run -param output=output1 script1.pig --stores to output1
> run -param input=output1 script2.pig -- load from output1
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
