[
https://issues.apache.org/jira/browse/PIG-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Koji Noguchi updated PIG-3072:
------------------------------
Attachment: pig-3072-v03.txt
(Minor changes to previous v02 patch.)
* Added comment in TFileRecordReader. "//TFile.Reader reads into buffer so,
progress is updated in chunks."
* Printing out progress to stderr.
* Changed loop size from 1000 to 25000 so that at least progress changes once
for codec='none'. 66%->99% For 'gz', it immediately jumps to 99% with this
small tfile.
* Added one extra check to make sure value is being read by recordReader.
(curval == LOOP_SIZE)
> Pig job reporting negative progress
> -----------------------------------
>
> Key: PIG-3072
> URL: https://issues.apache.org/jira/browse/PIG-3072
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.10.0
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Priority: Minor
> Fix For: 0.12
>
> Attachments: pig-3072-v01.txt, pig-3072-v02.txt, pig-3072-v03.txt
>
>
> Our users pointed out that their jobs reporting negative progress.
> 2012-11-02 21:43:11,538 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - -795% complete
> ...
> (due to TFileRecordReader)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
