[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2019-03-29 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16804873#comment-16804873 ] t oo commented on HIVE-15546: - Did this ever make release 2.3? I can't see it in [https://gi

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840934#comment-15840934 ] Thejas M Nair commented on HIVE-15546: -- As agreed in the dev mailing list and documen

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-24 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836792#comment-15836792 ] Sahil Takiar commented on HIVE-15546: - Thanks Sergio! > Optimize Utilities.getInputPa

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-24 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836776#comment-15836776 ] Sergio Peña commented on HIVE-15546: Yes. Those tests are not related to this patch.

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-24 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836769#comment-15836769 ] Sahil Takiar commented on HIVE-15546: - [~spena] can this be merged? > Optimize Utilit

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832652#comment-15832652 ] Sergey Shelukhin commented on HIVE-15546: - That makes sense > Optimize Utilities.

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832644#comment-15832644 ] Sahil Takiar commented on HIVE-15546: - [~sershe] yes, when {{Utilities.getInputPaths()

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-19 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830635#comment-15830635 ] Sergey Shelukhin commented on HIVE-15546: - [~stakiar] wrt listStatuss, when NullSc

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830381#comment-15830381 ] Hive QA commented on HIVE-15546: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Thomas Poepping (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829016#comment-15829016 ] Thomas Poepping commented on HIVE-15546: I see how that could make sense -- just h

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829006#comment-15829006 ] Sahil Takiar commented on HIVE-15546: - According to the code, dummy files are added to

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Thomas Poepping (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15828994#comment-15828994 ] Thomas Poepping commented on HIVE-15546: What is the benefit of using dummy files

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15828961#comment-15828961 ] Sergio Peña commented on HIVE-15546: Patch looks good (reviewed on RB). +1 > Optimize

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15828130#comment-15828130 ] Hive QA commented on HIVE-15546: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-17 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827365#comment-15827365 ] Sahil Takiar commented on HIVE-15546: - Thanks [~sershe] I'll take a look into those cl

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths()

2017-01-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15806617#comment-15806617 ] Hive QA commented on HIVE-15546: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths()

2017-01-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15806111#comment-15806111 ] Sergey Shelukhin commented on HIVE-15546: - See NullScanFileSystem, ZeroRowsInputFo

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths()

2017-01-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15805331#comment-15805331 ] Hive QA commented on HIVE-15546: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths()

2017-01-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15802989#comment-15802989 ] Hive QA commented on HIVE-15546: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths()

2017-01-05 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15802738#comment-15802738 ] Sahil Takiar commented on HIVE-15546: - The code states: {quote} If any input path poi