[ https://issues.apache.org/jira/browse/HIVE-22931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047187#comment-17047187 ]
Hive QA commented on HIVE-22931: -------------------------------- Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12994776/HIVE-22931.1.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 18074 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[timestamptz_2] (batchId=92) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/20861/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/20861/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-20861/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12994776 - PreCommit-HIVE-Build > HoS dynamic partitioning fails with blobstore optimizations off > --------------------------------------------------------------- > > Key: HIVE-22931 > URL: https://issues.apache.org/jira/browse/HIVE-22931 > Project: Hive > Issue Type: Bug > Reporter: Ádám Szita > Assignee: Ádám Szita > Priority: Major > Attachments: HIVE-22931.0.patch, HIVE-22931.1.patch > > > Reproduction steps: > - Create s3a backed table and normal table. > {code:java} > CREATE TABLE source ( > a string, > b int, > c int); > > CREATE TABLE target ( > a string) > PARTITIONED BY ( > b int, > c int) > STORED AS parquet > LOCATION > 's3a://somepath'; > {code} > - Insert values into normal table. > {code:java} > INSERT INTO TABLE source VALUES ("a", "1", "1"); > {code} > - Do an insert overwrite with dynamic partitions: > {code:java} > set hive.exec.dynamic.partition.mode=nonstrict; > set hive.blobstore.optimizations.enabled=false; > set hive.execution.engine=spark; > INSERT OVERWRITE TABLE target partition (b,c) > SELECT * > FROM source;{code} > This fails only with Spark execution engine + blobstorage optimizations being > turned off with: > {code} > 2020-01-16 15:24:56,064 ERROR hive.ql.metadata.Hive: > [load-dynamic-partitions-5]: Exception when loading partition with parameters > > partPath=hdfs://nameservice1/tmp/hive/hive/6bcee075-b637-429e-9bf0-a2658355415e/hive_2020-01-16_15-24-01_156_4299941251929377815-4/-mr-10000/.hive-staging_hive_2020-01-16_15-24-01_156_4299941251929377815-4/-ext-10002, > table=email_click_base, partSpec={b=null, c=null}, replace=true, > listBucketingEnabled=false, isAcid=false, > hasFollowingStatsTask=trueorg.apache.hadoop.hive.ql.metadata.HiveException: > MetaException(message:Partition spec is incorrect. {companyid=null, > eventmonth=null}) > at > org.apache.hadoop.hive.ql.metadata.Hive.loadPartitionInternal(Hive.java:1666) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)