[jira] [Commented] (HIVE-14557) Nullpointer When both SkewJoin and Mapjoin Enabled

2016-12-09 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734771#comment-15734771 ] wangwenli commented on HIVE-14557: -- this issue is related to [hive-9927|https://issues.a

[jira] [Comment Edited] (HIVE-9927) MR doesn't produce correct result for runtime_skewjoin_mapjoin_spark

2016-12-09 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734627#comment-15734627 ] wangwenli edited comment on HIVE-9927 at 12/9/16 8:10 AM: -- after c

[jira] [Comment Edited] (HIVE-9927) MR doesn't produce correct result for runtime_skewjoin_mapjoin_spark

2016-12-09 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734627#comment-15734627 ] wangwenli edited comment on HIVE-9927 at 12/9/16 8:00 AM: -- after c

[jira] [Commented] (HIVE-9927) MR doesn't produce correct result for runtime_skewjoin_mapjoin_spark

2016-12-08 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734627#comment-15734627 ] wangwenli commented on HIVE-9927: - after change the optimizer order,i test the runtime_skew

[jira] [Commented] (HIVE-9927) MR doesn't produce correct result for runtime_skewjoin_mapjoin_spark

2016-12-08 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734608#comment-15734608 ] wangwenli commented on HIVE-9927: - the reason is because SkewJoinResolver will generate map

[jira] [Commented] (HIVE-15239) hive on spark combine equivalentwork get wrong result because of tablescan operation compare

2016-11-18 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15676230#comment-15676230 ] wangwenli commented on HIVE-15239: -- [~xuefu.w...@kodak.com] different problem? what is

[jira] [Updated] (HIVE-15239) hive on spark combine equivalentwork get wrong result because of tablescan operation compare

2016-11-17 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-15239: - Summary: hive on spark combine equivalentwork get wrong result because of tablescan operation compare (w

[jira] [Commented] (HIVE-15239) hive on spark combine equivalentwork get wrong result because of tablescan operaton compare

2016-11-17 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675709#comment-15675709 ] wangwenli commented on HIVE-15239: -- explain this sql, we can see that Reducer 2 <- Map

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2016-11-01 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15627812#comment-15627812 ] wangwenli commented on HIVE-15104: -- try select count(distinct col1), count (distinct col2

[jira] [Updated] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2016-11-01 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-15104: - Priority: Major (was: Critical) > Hive on Spark generate more shuffle data than hive on mr >

[jira] [Commented] (HIVE-13947) HoS print wrong number for hash table size in map join scenario

2016-11-01 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15625833#comment-15625833 ] wangwenli commented on HIVE-13947: -- thanks for you interest on this hos issue. long time

[jira] [Commented] (HIVE-9039) Support Union Distinct

2016-07-13 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376108#comment-15376108 ] wangwenli commented on HIVE-9039: - [~pxiong], yes, you are correct, i am not means that , i

[jira] [Commented] (HIVE-9039) Support Union Distinct

2016-07-13 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374832#comment-15374832 ] wangwenli commented on HIVE-9039: - this issue will cause backward compatibility problem,

[jira] [Comment Edited] (HIVE-9044) Union input to a join operator poses problem when converting to map join [Spark Branch]

2016-07-06 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364220#comment-15364220 ] wangwenli edited comment on HIVE-9044 at 7/6/16 12:10 PM: -- just do

[jira] [Commented] (HIVE-9044) Union input to a join operator poses problem when converting to map join [Spark Branch]

2016-07-06 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364220#comment-15364220 ] wangwenli commented on HIVE-9044: - just do basic test local, will add unit test later.n

[jira] [Updated] (HIVE-9044) Union input to a join operator poses problem when converting to map join [Spark Branch]

2016-07-06 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-9044: Attachment: hive-9044.1.patch > Union input to a join operator poses problem when converting to map join > [

[jira] [Assigned] (HIVE-9044) Union input to a join operator poses problem when converting to map join [Spark Branch]

2016-07-06 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli reassigned HIVE-9044: --- Assignee: wangwenli > Union input to a join operator poses problem when converting to map join > [Spa

[jira] [Commented] (HIVE-13308) HiveOnSpark sumbit query very slow when hundred of beeline exectue at same time

2016-05-11 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281186#comment-15281186 ] wangwenli commented on HIVE-13308: -- [~lirui] generate secret has no cocurrent issue,nothi

[jira] [Commented] (HIVE-13308) HiveOnSpark sumbit query very slow when hundred of beeline exectue at same time

2016-05-11 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281141#comment-15281141 ] wangwenli commented on HIVE-13308: -- [~vanzin] consider the server is initialized one time

[jira] [Commented] (HIVE-13308) HiveOnSpark sumbit query very slow when hundred of beeline exectue at same time

2016-05-10 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279338#comment-15279338 ] wangwenli commented on HIVE-13308: -- [~lirui], could you check on this? > HiveOnSpark su

[jira] [Updated] (HIVE-13308) HiveOnSpark sumbit query very slow when hundred of beeline exectue at same time

2016-03-20 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-13308: - Description: backgroud: hive on spark , yarn cluster mode details: when using hundred of beeline submit q

[jira] [Updated] (HIVE-13308) HiveOnSpark sumbit query very slow when hundred of beeline exectue at same time

2016-03-20 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-13308: - Description: backgroud: hive on spark featuer, yarn cluster mode details: when using hundred of beeline s

[jira] [Updated] (HIVE-13308) HiveOnSpark sumbit query very flow when hundred of beeline exectue at same time

2016-03-19 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-13308: - Description: backgroud: hive on spark featuer, yarn cluster mode details: when using hundred of beeline s

[jira] [Updated] (HIVE-13308) HiveOnSpark sumbit query very flow when hundred of beeline exectue at same time

2016-03-19 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-13308: - Assignee: (was: wangwenli) > HiveOnSpark sumbit query very flow when hundred of beeline exectue at sam

[jira] [Updated] (HIVE-6925) show query progress in Beeline

2016-03-09 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-6925: External issue ID: hive-7615 > show query progress in Beeline > -- > >

[jira] [Commented] (HIVE-12653) The property "serialization.encoding" in the class "org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe" does not work

2015-12-14 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15055804#comment-15055804 ] wangwenli commented on HIVE-12653: -- seems you forgot add super.initialize(conf, tbl) in i

[jira] [Commented] (HIVE-12653) The property "serialization.encoding" in the class "org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe" does not work

2015-12-13 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15055511#comment-15055511 ] wangwenli commented on HIVE-12653: -- MultiDelimitSerDe extend AbstractEncodingAwareSerDe,

[jira] [Commented] (HIVE-12653) The property "serialization.encoding" in the class "org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe" does not work

2015-12-13 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15055351#comment-15055351 ] wangwenli commented on HIVE-12653: -- why not extend AbstractEncodingAwareSerDe? > The pr

[jira] [Commented] (HIVE-11616) DelegationTokenSecretManager reuses the same objectstore, which has concurrency issues

2015-11-11 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001560#comment-15001560 ] wangwenli commented on HIVE-11616: -- [~sershe], yes it should be > DelegationTokenSecretM

[jira] [Commented] (HIVE-11616) DelegationTokenSecretManager reuse the same objectstore ,which has cocurrent issue

2015-10-28 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979585#comment-14979585 ] wangwenli commented on HIVE-11616: -- thanks your warmly joining to update the patch [~sers

[jira] [Updated] (HIVE-11616) DelegationTokenSecretManager reuse the same objectstore ,which has cocurrent issue

2015-10-28 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-11616: - Assignee: Sergey Shelukhin (was: Cody Fu) > DelegationTokenSecretManager reuse the same objectstore ,whic

[jira] [Commented] (HIVE-3969) Session state for hive server should be cleaned-up

2015-09-09 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737928#comment-14737928 ] wangwenli commented on HIVE-3969: - [~navis]Could you help look at this issue HIVE-11681? th

[jira] [Updated] (HIVE-3969) Session state for hive server should be cleaned-up

2015-09-09 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-3969: Assignee: Navis (was: wangwenli) > Session state for hive server should be cleaned-up >

[jira] [Assigned] (HIVE-3969) Session state for hive server should be cleaned-up

2015-09-09 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli reassigned HIVE-3969: --- Assignee: wangwenli (was: Navis) > Session state for hive server should be cleaned-up > -

[jira] [Commented] (HIVE-11681) sometimes when query mr job progress, stream closed exception will happen

2015-09-09 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14736752#comment-14736752 ] wangwenli commented on HIVE-11681: -- below is the stacktrace that stream be cached in the