[jira] [Updated] (PIG-626) Statistics (records read by each mapper and reducer)

2014-06-18 Thread Maximus (JIRA)
[ https://issues.apache.org/jira/browse/PIG-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximus updated PIG-626: Description: This uses (lalala) the counters framework that hadoop has. Initially, I am just interested in finding ou

[jira] [Updated] (PIG-626) Statistics (records read by each mapper and reducer)

2014-06-18 Thread Maximus (JIRA)
[ https://issues.apache.org/jira/browse/PIG-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximus updated PIG-626: Description: This uses the counters framework that hadoop has. Initially, I am just interested in finding out the num

[jira] [Created] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
Travis Woodruff created PIG-4018: Summary: Schema validation fails with UNION ONSCHEMA Key: PIG-4018 URL: https://issues.apache.org/jira/browse/PIG-4018 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Affects Version/s: 0.13.0 > Schema validation fails with UNION ONSCHEMA > -

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Attachment: PIG-4018.patch This is an attempt at a patch. It moves UnionOnSchemaSetter above Impli

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Status: Patch Available (was: Open) > Schema validation fails with UNION ONSCHEMA > --

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Description: When relations with differing schemas are unioned (using UNION ONSCHEMA), schema vali

[jira] [Updated] (PIG-4006) Make the interval of DAGStatus report configurable

2014-06-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4006: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you Daniel

[jira] [Created] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4019: --- Summary: Compilation broken after TEZ-1169 Key: PIG-4019 URL: https://issues.apache.org/jira/browse/PIG-4019 Project: Pig Issue Type: Bug Components: tez

[jira] [Updated] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4019: Attachment: PIG-4019-1.patch > Compilation broken after TEZ-1169 > - > >

[jira] [Created] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4020: --- Summary: Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7] Key: PIG-4020 URL: https://issues.apache.org/jira/browse/PIG-4020 Project: Pig Issue Type:

[jira] [Updated] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4020: Attachment: PIG-4020-1.patch > Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7] > --

[jira] [Resolved] (PIG-4015) Provide a way to disable auto-parallism in tez

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4015. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! > Provi

[jira] [Commented] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036154#comment-14036154 ] Alan Gates commented on PIG-4019: - +1 > Compilation broken after TEZ-1169 > ---

[jira] [Resolved] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4019. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Alan for review! > Compila

[jira] [Commented] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036208#comment-14036208 ] Rohini Palaniswamy commented on PIG-4020: - Can you explain the failure root cause an

[jira] [Commented] (PIG-4001) POPartialAgg aggregates too aggressively when multiple values aggregated

2014-06-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036254#comment-14036254 ] Cheolsoo Park commented on PIG-4001: +1. Will commit this later today. > POPartialAgg a

[jira] [Commented] (PIG-4002) Disable combiner when map-side aggregation is used

2014-06-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036302#comment-14036302 ] Cheolsoo Park commented on PIG-4002: Thank you for the patch. I agree with the idea that

[jira] [Commented] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036346#comment-14036346 ] Daniel Dai commented on PIG-4020: - In short, processInput() in MR will not result endOfAllIn

[jira] [Commented] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036348#comment-14036348 ] Rohini Palaniswamy commented on PIG-4020: - +1 > Fix tez e2e tests MapPartialAgg_[2-

[jira] [Resolved] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4020. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! > Fix t

Trevni file format

2014-06-18 Thread Rohini Palaniswamy
Does Trevni as file format has some traction and used by anyone in production? Linkedin possibly? Since Cloudera is now supporting Parquet was wondering what is the state of Trevni. If Trevni is being deprecated in favor of Parquet we should deprecate our TrevniStorage as well sometime. Regards,

[jira] [Created] (PIG-4021) Fix TestHBaseStorage failure after auto local mode change (PIG-3463)

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4021: --- Summary: Fix TestHBaseStorage failure after auto local mode change (PIG-3463) Key: PIG-4021 URL: https://issues.apache.org/jira/browse/PIG-4021 Project: Pig Issue Typ

[jira] [Commented] (PIG-3000) Optimize nested foreach

2014-06-18 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036599#comment-14036599 ] Mona Chitnis commented on PIG-3000: --- thanks for taking a peek Daniel. I will rebase my pat

[jira] [Commented] (PIG-4021) Fix TestHBaseStorage failure after auto local mode change (PIG-3463)

2014-06-18 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036714#comment-14036714 ] Aniket Mokashi commented on PIG-4021: - I do not know why it should not. I may have also

[jira] [Assigned] (PIG-3972) java.lang.IndexOutOfBoundsException when flatten meets an empty row

2014-06-18 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mona Chitnis reassigned PIG-3972: - Assignee: Mona Chitnis > java.lang.IndexOutOfBoundsException when flatten meets an empty row >

[jira] [Updated] (PIG-3972) java.lang.IndexOutOfBoundsException when flatten meets an empty row

2014-06-18 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mona Chitnis updated PIG-3972: -- Affects Version/s: 0.13.0 0.12.0 > java.lang.IndexOutOfBoundsException when flatte

[jira] Subscription: PIG patch available

2014-06-18 Thread jira
Issue Subscription Filter: PIG patch available (16 issues) Subscriber: pigdaily Key Summary PIG-4018Schema validation fails with UNION ONSCHEMA https://issues.apache.org/jira/browse/PIG-4018 PIG-4008Pig code change to enable Tez Local mode https://issues.a

[jira] [Assigned] (PIG-4005) depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when hbaseversion is 95

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-4005: --- Assignee: Daniel Dai > depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when > hbasever

[jira] [Created] (PIG-4022) Fix tez e2e test SkewedJoin_6

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4022: --- Summary: Fix tez e2e test SkewedJoin_6 Key: PIG-4022 URL: https://issues.apache.org/jira/browse/PIG-4022 Project: Pig Issue Type: Bug Components: tez

[jira] [Commented] (PIG-4023) BigDec/Int sort is broken

2014-06-18 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036854#comment-14036854 ] Anup Ahire commented on PIG-4023: - I can provide a patch > BigDec/Int sort is broken >

[jira] [Created] (PIG-4023) BigDec/Int sort is broken

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4023: --- Summary: BigDec/Int sort is broken Key: PIG-4023 URL: https://issues.apache.org/jira/browse/PIG-4023 Project: Pig Issue Type: Bug Affects Versions: 0.12.0

[jira] [Created] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4025: --- Summary: TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK Key: PIG-4025 URL: https://issues.apache.org/jira/browse/PIG

[jira] [Created] (PIG-4024) TestPigStreamingUDF and TestPigStreaming fail on IBM JDK.

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4024: --- Summary: TestPigStreamingUDF and TestPigStreaming fail on IBM JDK. Key: PIG-4024 URL: https://issues.apache.org/jira/browse/PIG-4024 Project: Pig Issue Type: Improveme

[jira] [Updated] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-18 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4025: Description: Method positioning on stack strace in IBM jdk is different which makes these tests fail . we can

[jira] [Updated] (PIG-4005) depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when hbaseversion is 95

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4005: Attachment: PIG-4005-1.patch Attach patch. Also change default hbaseversion to 95 since it has been out for

[jira] [Updated] (PIG-4021) Fix TestHBaseStorage failure after auto local mode change (PIG-3463)

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4021: Attachment: PIG-4021-1.patch The test only fail on Hadoop 1. The test runs with local mode before PIG-3463,