[jira] [Updated] (HIVE-20935) Upload of llap package tarball fails in EC2 causing LLAP service start failure

[ https://issues.apache.org/jira/browse/HIVE-20935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-20935: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-20935) Upload of llap package tarball fails in EC2 causing LLAP service start failure

[ https://issues.apache.org/jira/browse/HIVE-20935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-20935: -- Attachment: HIVE-20935.03.patch > Upload of llap package tarball fails in EC2 causing LLAP serv

[jira] [Commented] (HIVE-20935) Upload of llap package tarball fails in EC2 causing LLAP service start failure

[ https://issues.apache.org/jira/browse/HIVE-20935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692045#comment-16692045 ] Siddharth Seth commented on HIVE-20935: --- [~prasanth_j], [~jdere] - what is required

[jira] [Updated] (HIVE-20763) Add google cloud storage (gs) to the exim uri schema whitelist

[ https://issues.apache.org/jira/browse/HIVE-20763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-20763: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the reviews. Comm

[jira] [Updated] (HIVE-20763) Add google cloud storage (gs) to the exim uri schema whitelist

[ https://issues.apache.org/jira/browse/HIVE-20763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-20763: -- Status: Patch Available (was: Open) > Add google cloud storage (gs) to the exim uri schema whi

[jira] [Updated] (HIVE-20763) Add google cloud storage (gs) to the exim uri schema whitelist

[ https://issues.apache.org/jira/browse/HIVE-20763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-20763: -- Fix Version/s: 4.0.0 > Add google cloud storage (gs) to the exim uri schema whitelist > ---

[jira] [Commented] (HIVE-20763) Add google cloud storage (gs) to the exim uri schema whitelist

[ https://issues.apache.org/jira/browse/HIVE-20763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654083#comment-16654083 ] Siddharth Seth commented on HIVE-20763: --- Uploaded a trivial patch. No explicit test

[jira] [Assigned] (HIVE-20763) Add google cloud storage (gs) to the exim uri schema whitelist

[ https://issues.apache.org/jira/browse/HIVE-20763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-20763: - > Add google cloud storage (gs) to the exim uri schema whitelist > -

[jira] [Updated] (HIVE-20763) Add google cloud storage (gs) to the exim uri schema whitelist

[ https://issues.apache.org/jira/browse/HIVE-20763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-20763: -- Attachment: HIVE-20763.01.patch > Add google cloud storage (gs) to the exim uri schema whitelis

[jira] [Commented] (HIVE-19222) TestNegativeCliDriver tests are failing due to "java.lang.OutOfMemoryError: GC overhead limit exceeded"

[ https://issues.apache.org/jira/browse/HIVE-19222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439824#comment-16439824 ] Siddharth Seth commented on HIVE-19222: --- [~aihuaxu] - the memory decrease would like

[jira] [Commented] (HIVE-19021) WM counters are not properly propagated from LLAP to AM

[ https://issues.apache.org/jira/browse/HIVE-19021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410057#comment-16410057 ] Siddharth Seth commented on HIVE-19021: --- Kind of rusty on some of this. Given Tez c

[jira] [Commented] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317403#comment-16317403 ] Siddharth Seth commented on HIVE-18326: --- On DAG itself - I think this is the only pl

[jira] [Commented] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316919#comment-16316919 ] Siddharth Seth commented on HIVE-18326: --- {code} +DAG dag = (DAG) info; {code} is

[jira] [Commented] (HIVE-17431) change configuration handling in TezSessionState

[ https://issues.apache.org/jira/browse/HIVE-17431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208535#comment-16208535 ] Siddharth Seth commented on HIVE-17431: --- So. new sessions use new configs (and there

[jira] [Commented] (HIVE-16927) LLAP: Slider takes down all daemons when some daemons fail repeatedly

[ https://issues.apache.org/jira/browse/HIVE-16927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16186152#comment-16186152 ] Siddharth Seth commented on HIVE-16927: --- +1. Looks good to me. > LLAP: Slider takes

[jira] [Commented] (HIVE-17431) change configuration handling in TezSessionState

[ https://issues.apache.org/jira/browse/HIVE-17431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156046#comment-16156046 ] Siddharth Seth commented on HIVE-17431: --- {code} refreshLocalResourcesFromConf(conf);

[jira] [Commented] (HIVE-17380) refactor LlapProtocolClientProxy to be usable with other protocols

[ https://issues.apache.org/jira/browse/HIVE-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141017#comment-16141017 ] Siddharth Seth commented on HIVE-17380: --- This mainly makes the one per node a little

[jira] [Commented] (HIVE-17360) Tez session reopen appears to use a wrong conf object

[ https://issues.apache.org/jira/browse/HIVE-17360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136116#comment-16136116 ] Siddharth Seth commented on HIVE-17360: --- +1 > Tez session reopen appears to use a w

[jira] [Commented] (HIVE-17256) add a notion of a guaranteed task to LLAP

[ https://issues.apache.org/jira/browse/HIVE-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128100#comment-16128100 ] Siddharth Seth commented on HIVE-17256: --- I did actually mean TaskExecutorService tes

[jira] [Comment Edited] (HIVE-17294) LLAP: switch task heartbeats to protobuf

[ https://issues.apache.org/jira/browse/HIVE-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123787#comment-16123787 ] Siddharth Seth edited comment on HIVE-17294 at 8/11/17 6:21 PM:

[jira] [Commented] (HIVE-17294) LLAP: switch task heartbeats to protobuf

[ https://issues.apache.org/jira/browse/HIVE-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123787#comment-16123787 ] Siddharth Seth commented on HIVE-17294: --- The endpoint is in the LLAP AM plugin. Howe

[jira] [Commented] (HIVE-17294) LLAP: switch task heartbeats to protobuf

[ https://issues.apache.org/jira/browse/HIVE-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122524#comment-16122524 ] Siddharth Seth commented on HIVE-17294: --- Nope. Half the work is already done in term

[jira] [Commented] (HIVE-17256) add a notion of a guaranteed task to LLAP

[ https://issues.apache.org/jira/browse/HIVE-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122512#comment-16122512 ] Siddharth Seth commented on HIVE-17256: --- Mostly looks good. Would be nice to have a

[jira] [Commented] (HIVE-17160) Adding kerberos Authorization to the Druid hive integration

[ https://issues.apache.org/jira/browse/HIVE-17160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102291#comment-16102291 ] Siddharth Seth commented on HIVE-17160: --- The DagUtils part of the changes look good

[jira] [Commented] (HIVE-17019) Add support to download debugging information as an archive.

[ https://issues.apache.org/jira/browse/HIVE-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16099157#comment-16099157 ] Siddharth Seth commented on HIVE-17019: --- Re-looked at the patch. Mostly looks good.

[jira] [Commented] (HIVE-17091) "Timed out getting readerEvents" error from external LLAP client

[ https://issues.apache.org/jira/browse/HIVE-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16090889#comment-16090889 ] Siddharth Seth commented on HIVE-17091: --- [~jdere] - after the change, the read itsel

[jira] [Commented] (HIVE-16690) Configure Tez cartesian product edge based on LLAP cluster size

[ https://issues.apache.org/jira/browse/HIVE-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16090585#comment-16090585 ] Siddharth Seth commented on HIVE-16690: --- +1 for the addendum. If cross product does

[jira] [Updated] (HIVE-17093) LLAP ssl configs need to be localized to talk to a wire encrypted hdfs

[ https://issues.apache.org/jira/browse/HIVE-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-17093: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-17093) LLAP ssl configs need to be localized to talk to a wire encrypted hdfs

[ https://issues.apache.org/jira/browse/HIVE-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088262#comment-16088262 ] Siddharth Seth commented on HIVE-17093: --- Thanks. Committing. > LLAP ssl configs nee

[jira] [Commented] (HIVE-17019) Add support to download debugging information as an archive.

[ https://issues.apache.org/jira/browse/HIVE-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088180#comment-16088180 ] Siddharth Seth commented on HIVE-17019: --- bq. The llap status is fetched using LlapSt

[jira] [Commented] (HIVE-17093) LLAP ssl configs need to be localized to talk to a wire encrypted hdfs

[ https://issues.apache.org/jira/browse/HIVE-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088096#comment-16088096 ] Siddharth Seth commented on HIVE-17093: --- [~gopalv] - don't think ssl shuffle works a

[jira] [Updated] (HIVE-17093) LLAP ssl configs need to be localized to talk to a wire encrypted hdfs

[ https://issues.apache.org/jira/browse/HIVE-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-17093: -- Status: Patch Available (was: Open) > LLAP ssl configs need to be localized to talk to a wire e

[jira] [Updated] (HIVE-17093) LLAP ssl configs need to be localized to talk to a wire encrypted hdfs

[ https://issues.apache.org/jira/browse/HIVE-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-17093: -- Attachment: HIVE-17093.01.patch The patch localizes ssl-client.xml instead of ssl-server.xml whi

[jira] [Assigned] (HIVE-17093) LLAP ssl configs need to be localized to talk to a wire encrypted hdfs

[ https://issues.apache.org/jira/browse/HIVE-17093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-17093: - > LLAP ssl configs need to be localized to talk to a wire encrypted hdfs > --

[jira] [Commented] (HIVE-16926) LlapTaskUmbilicalExternalClient should not start new umbilical server for every fragment request

[ https://issues.apache.org/jira/browse/HIVE-16926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16086607#comment-16086607 ] Siddharth Seth commented on HIVE-16926: --- +1. Looks good. There's a bunch of unused i

[jira] [Commented] (HIVE-16926) LlapTaskUmbilicalExternalClient should not start new umbilical server for every fragment request

[ https://issues.apache.org/jira/browse/HIVE-16926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16084817#comment-16084817 ] Siddharth Seth commented on HIVE-16926: --- bq. Is there any action needed on this par

[jira] [Commented] (HIVE-17019) Add support to download debugging information as an archive.

[ https://issues.apache.org/jira/browse/HIVE-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083111#comment-16083111 ] Siddharth Seth commented on HIVE-17019: --- Thanks for posting the patch. Will be usefu

[jira] [Commented] (HIVE-16926) LlapTaskUmbilicalExternalClient should not start new umbilical server for every fragment request

[ https://issues.apache.org/jira/browse/HIVE-16926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082995#comment-16082995 ] Siddharth Seth commented on HIVE-16926: --- Functionally, looks good to me. Minor comme

[jira] [Commented] (HIVE-17067) LLAP: Add http endpoint to provide system level configurations

[ https://issues.apache.org/jira/browse/HIVE-17067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081123#comment-16081123 ] Siddharth Seth commented on HIVE-17067: --- +1. Looks good. Does anything specific need

[jira] [Commented] (HIVE-16927) LLAP: Slider takes down all daemons when some daemons fail repeatedly

[ https://issues.apache.org/jira/browse/HIVE-16927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056802#comment-16056802 ] Siddharth Seth commented on HIVE-16927: --- [~prasanth_j] - I don't think we make a per

[jira] [Commented] (HIVE-16847) LLAP queue order issue

[ https://issues.apache.org/jira/browse/HIVE-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054645#comment-16054645 ] Siddharth Seth commented on HIVE-16847: --- +1 > LLAP queue order issue >

[jira] [Commented] (HIVE-16847) LLAP queue order issue

[ https://issues.apache.org/jira/browse/HIVE-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054562#comment-16054562 ] Siddharth Seth commented on HIVE-16847: --- Mostly looks good. Couple of small changes

[jira] [Commented] (HIVE-16820) TezTask may not shut down correctly before submit

[ https://issues.apache.org/jira/browse/HIVE-16820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047007#comment-16047007 ] Siddharth Seth commented on HIVE-16820: --- +1. I'd still change the isShutdown to a vo

[jira] [Commented] (HIVE-16820) TezTask may not shut down correctly before submit

[ https://issues.apache.org/jira/browse/HIVE-16820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16044822#comment-16044822 ] Siddharth Seth commented on HIVE-16820: --- Sorry for the delay. - Should isShutdown b

[jira] [Commented] (HIVE-16460) In the console output, show vertex list in topological order instead of an alphabetical sort

[ https://issues.apache.org/jira/browse/HIVE-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035451#comment-16035451 ] Siddharth Seth commented on HIVE-16460: --- +1 > In the console output, show vertex li

[jira] [Commented] (HIVE-16460) In the console output, show vertex list in topological order instead of an alphabetical sort

[ https://issues.apache.org/jira/browse/HIVE-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035224#comment-16035224 ] Siddharth Seth commented on HIVE-16460: --- bq. So I would assume so Missed the javadoc

[jira] [Commented] (HIVE-16460) In the console output, show vertex list in topological order instead of an alphabetical sort

[ https://issues.apache.org/jira/browse/HIVE-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033732#comment-16033732 ] Siddharth Seth commented on HIVE-16460: --- Is baseWork topo sorted? Does each BaseWork

[jira] [Commented] (HIVE-10848) LLAP: Better handling of hostnames when sending heartbeats to the AM

[ https://issues.apache.org/jira/browse/HIVE-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033375#comment-16033375 ] Siddharth Seth commented on HIVE-10848: --- [~sershe] - you'll need to translate that.

[jira] [Updated] (HIVE-16777) LLAP: Use separate tokens and UGI instances when an external client is used

[ https://issues.apache.org/jira/browse/HIVE-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16777: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16777) LLAP: Use separate tokens and UGI instances when an external client is used

[ https://issues.apache.org/jira/browse/HIVE-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027510#comment-16027510 ] Siddharth Seth commented on HIVE-16777: --- Test failures are not related. Committing.

[jira] [Commented] (HIVE-16777) LLAP: Use separate tokens and UGI instances when an external client is used

[ https://issues.apache.org/jira/browse/HIVE-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027062#comment-16027062 ] Siddharth Seth commented on HIVE-16777: --- True. Multiple across hosts would need to b

[jira] [Updated] (HIVE-16777) LLAP: Use separate tokens and UGI instances when an external client is used

[ https://issues.apache.org/jira/browse/HIVE-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16777: -- Target Version/s: 3.0.0 Status: Patch Available (was: Open) > LLAP: Use separate

[jira] [Updated] (HIVE-16777) LLAP: Use separate tokens and UGI instances when an external client is used

[ https://issues.apache.org/jira/browse/HIVE-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16777: -- Attachment: HIVE-16777.01.patch cc [~sershe] for review. > LLAP: Use separate tokens and UGI in

[jira] [Assigned] (HIVE-16777) LLAP: Use separate tokens and UGI instances when an external client is used

[ https://issues.apache.org/jira/browse/HIVE-16777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-16777: - > LLAP: Use separate tokens and UGI instances when an external client is used > -

[jira] [Commented] (HIVE-16754) LLAP: Print hive version info on llap daemon startup

[ https://issues.apache.org/jira/browse/HIVE-16754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023708#comment-16023708 ] Siddharth Seth commented on HIVE-16754: --- +1 > LLAP: Print hive version info on llap

[jira] [Updated] (HIVE-14052) Cleanup structures when external clients use LLAP

[ https://issues.apache.org/jira/browse/HIVE-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14052: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-14052) Cleanup structures when external clients use LLAP

[ https://issues.apache.org/jira/browse/HIVE-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14052: -- Summary: Cleanup structures when external clients use LLAP (was: Cleanup of structures required

[jira] [Commented] (HIVE-14052) Cleanup of structures required when LLAP access from external clients completes

[ https://issues.apache.org/jira/browse/HIVE-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016319#comment-16016319 ] Siddharth Seth commented on HIVE-14052: --- Thanks. Committing. > Cleanup of structure

[jira] [Commented] (HIVE-16703) Hive may add the same file to the session and vertex in Tez

[ https://issues.apache.org/jira/browse/HIVE-16703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016281#comment-16016281 ] Siddharth Seth commented on HIVE-16703: --- +1 > Hive may add the same file to the ses

[jira] [Updated] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16692: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed the addendum patch.

[jira] [Commented] (HIVE-14052) Cleanup of structures required when LLAP access from external clients completes

[ https://issues.apache.org/jira/browse/HIVE-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016270#comment-16016270 ] Siddharth Seth commented on HIVE-14052: --- An AppId needs to be created (required for

[jira] [Commented] (HIVE-13673) LLAP: handle case where no service instance is found on the host specified in the input split

[ https://issues.apache.org/jira/browse/HIVE-13673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016175#comment-16016175 ] Siddharth Seth commented on HIVE-13673: --- +1 Looks good. Minor: Probably better to cr

[jira] [Updated] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16692: -- Status: Patch Available (was: Reopened) > LLAP: Keep alive connection in shuffle handler should

[jira] [Updated] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16692: -- Attachment: HIVE-16692.02.patch > LLAP: Keep alive connection in shuffle handler should not be c

[jira] [Reopened] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reopened HIVE-16692: --- Re-opening, and re-uploading patch with a different name for jenkins. > LLAP: Keep alive connecti

[jira] [Updated] (HIVE-14052) Cleanup of structures required when LLAP access from external clients completes

[ https://issues.apache.org/jira/browse/HIVE-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14052: -- Attachment: HIVE-14052.04.patch Updated patch. > Cleanup of structures required when LLAP acces

[jira] [Updated] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16692: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16692) LLAP: Keep alive connection in shuffle handler should not be closed until entire data is flushed out

[ https://issues.apache.org/jira/browse/HIVE-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16014517#comment-16014517 ] Siddharth Seth commented on HIVE-16692: --- +1. Thanks [~rajesh.balamohan]. Test failur

[jira] [Commented] (HIVE-14052) Cleanup of structures required when LLAP access from external clients completes

[ https://issues.apache.org/jira/browse/HIVE-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013308#comment-16013308 ] Siddharth Seth commented on HIVE-14052: --- bq. Also just wondering, why does external

[jira] [Assigned] (HIVE-14052) Cleanup of structures required when LLAP access from external clients completes

[ https://issues.apache.org/jira/browse/HIVE-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-14052: - Assignee: Siddharth Seth (was: Jason Dere) > Cleanup of structures required when LLAP ac

[jira] [Updated] (HIVE-14052) Cleanup of structures required when LLAP access from external clients completes

[ https://issues.apache.org/jira/browse/HIVE-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14052: -- Status: Patch Available (was: Open) > Cleanup of structures required when LLAP access from exte

[jira] [Updated] (HIVE-14052) Cleanup of structures required when LLAP access from external clients completes

[ https://issues.apache.org/jira/browse/HIVE-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14052: -- Attachment: HIVE-14052.02.patch Attaching an updated patch which does the following. - Avoids l

[jira] [Updated] (HIVE-16655) LLAP: Avoid preempting fragments before they enter the running state

[ https://issues.apache.org/jira/browse/HIVE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16655: -- Status: Patch Available (was: Open) > LLAP: Avoid preempting fragments before they enter the ru

[jira] [Updated] (HIVE-16655) LLAP: Avoid preempting fragments before they enter the running state

[ https://issues.apache.org/jira/browse/HIVE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16655: -- Attachment: HIVE-16655.02.patch Updated patch with the tez dependency changed to run ptests. Ha

[jira] [Updated] (HIVE-16639) LLAP: Derive shuffle thread counts and keep-alive connections from instance count

[ https://issues.apache.org/jira/browse/HIVE-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16639: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16639) LLAP: Derive shuffle thread counts and keep-alive connections from instance count

[ https://issues.apache.org/jira/browse/HIVE-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008855#comment-16008855 ] Siddharth Seth commented on HIVE-16639: --- Test failures are not related. Verified loc

[jira] [Updated] (HIVE-16639) LLAP: Derive shuffle thread counts and keep-alive connections from instance count

[ https://issues.apache.org/jira/browse/HIVE-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16639: -- Attachment: HIVE-16639.02.patch Updated patch. > LLAP: Derive shuffle thread counts and keep-al

[jira] [Updated] (HIVE-16634) LLAP Use a pool of connections to a single AM from a daemon

[ https://issues.apache.org/jira/browse/HIVE-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16634: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16634) LLAP Use a pool of connections to a single AM from a daemon

[ https://issues.apache.org/jira/browse/HIVE-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008715#comment-16008715 ] Siddharth Seth commented on HIVE-16634: --- Committing the .1 patch. I don't think the

[jira] [Commented] (HIVE-16652) LlapInputFormat: Seeing "output error" WARN message

[ https://issues.apache.org/jira/browse/HIVE-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008711#comment-16008711 ] Siddharth Seth commented on HIVE-16652: --- +1. Looks good. > LlapInputFormat: Seeing

[jira] [Commented] (HIVE-16651) LlapProtocolClientProxy stack trace when using llap input format

[ https://issues.apache.org/jira/browse/HIVE-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008700#comment-16008700 ] Siddharth Seth commented on HIVE-16651: --- +1 > LlapProtocolClientProxy stack trace w

[jira] [Updated] (HIVE-16655) LLAP: Avoid preempting fragments before they enter the running state

[ https://issues.apache.org/jira/browse/HIVE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16655: -- Attachment: HIVE-16655.01.patch The patch. Relies on the start notifications from Tez, to detemi

[jira] [Assigned] (HIVE-16655) LLAP: Avoid preempting fragments before they enter the running state

[ https://issues.apache.org/jira/browse/HIVE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-16655: - > LLAP: Avoid preempting fragments before they enter the running state >

[jira] [Updated] (HIVE-16639) LLAP: Derive shuffle thread counts and keep-alive connections from instance count

[ https://issues.apache.org/jira/browse/HIVE-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16639: -- Status: Patch Available (was: Open) > LLAP: Derive shuffle thread counts and keep-alive connect

[jira] [Updated] (HIVE-16639) LLAP: Derive shuffle thread counts and keep-alive connections from instance count

[ https://issues.apache.org/jira/browse/HIVE-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16639: -- Attachment: HIVE-16639.01.patch Enables keep-alive by default. Thread count to 3x cpu count. -Dh

[jira] [Assigned] (HIVE-16639) LLAP: Derive shuffle thread counts and keep-alive connections from instance count

[ https://issues.apache.org/jira/browse/HIVE-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-16639: - Assignee: Siddharth Seth > LLAP: Derive shuffle thread counts and keep-alive connections

[jira] [Updated] (HIVE-16634) LLAP Use a pool of connections to a single AM from a daemon

[ https://issues.apache.org/jira/browse/HIVE-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16634: -- Attachment: HIVE-16634.02.patch Updated to add a cap. One downside is that it will always create

[jira] [Updated] (HIVE-16634) LLAP Use a pool of connections to a single AM from a daemon

[ https://issues.apache.org/jira/browse/HIVE-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16634: -- Reporter: Rajesh Balamohan (was: Siddharth Seth) > LLAP Use a pool of connections to a single A

[jira] [Commented] (HIVE-16635) Progressbar: Use a step-function for CHECK_INTERVAL timeouts

[ https://issues.apache.org/jira/browse/HIVE-16635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005551#comment-16005551 ] Siddharth Seth commented on HIVE-16635: --- +1. Couple of minor nits. - 2.5s is pretty

[jira] [Updated] (HIVE-16634) LLAP Use a pool of connections to a single AM from a daemon

[ https://issues.apache.org/jira/browse/HIVE-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16634: -- Status: Patch Available (was: Open) > LLAP Use a pool of connections to a single AM from a daem

[jira] [Updated] (HIVE-16634) LLAP Use a pool of connections to a single AM from a daemon

[ https://issues.apache.org/jira/browse/HIVE-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16634: -- Attachment: HIVE-16634.01.patch Patch to fix this. cc [~sershe] for review. > LLAP Use a pool

[jira] [Assigned] (HIVE-16634) LLAP Use a pool of connections to a single AM from a daemon

[ https://issues.apache.org/jira/browse/HIVE-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-16634: - > LLAP Use a pool of connections to a single AM from a daemon > -

[jira] [Commented] (HIVE-16343) LLAP: Publish YARN's ProcFs based memory usage to metrics for monitoring

[ https://issues.apache.org/jira/browse/HIVE-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001923#comment-16001923 ] Siddharth Seth commented on HIVE-16343: --- +1. I'd still test the smap approach for pe

[jira] [Commented] (HIVE-16343) LLAP: Publish YARN's ProcFs based memory usage to metrics for monitoring

[ https://issues.apache.org/jira/browse/HIVE-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981707#comment-15981707 ] Siddharth Seth commented on HIVE-16343: --- This look up can be quite expensive. e.g. t

[jira] [Commented] (HIVE-16343) LLAP: Publish YARN's ProcFs based memory usage to metrics for monitoring

[ https://issues.apache.org/jira/browse/HIVE-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981608#comment-15981608 ] Siddharth Seth commented on HIVE-16343: --- Getting access to the PID. Is there an easi

[jira] [Updated] (HIVE-15786) Provide additional information from the llapstatus command

[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-15786: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command

[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977797#comment-15977797 ] Siddharth Seth commented on HIVE-15786: --- Thanks for the review. Committed. [~owen.o

[jira] [Commented] (HIVE-15786) Provide additional information from the llapstatus command

[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975578#comment-15975578 ] Siddharth Seth commented on HIVE-15786: --- [~prasanth_j] - could you take another look

[jira] [Commented] (HIVE-16461) DagUtils checks local resource size on the remote fs

[ https://issues.apache.org/jira/browse/HIVE-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974210#comment-15974210 ] Siddharth Seth commented on HIVE-16461: --- +1 for the patch. There's sections of that

[jira] [Updated] (HIVE-15786) Provide additional information from the llapstatus command

[ https://issues.apache.org/jira/browse/HIVE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-15786: -- Attachment: HIVE-15786.05.patch Updated patch to use the released version of slider. > Provide

  1   2   3   4   5   6   7   8   9   10   >