[ https://issues.apache.org/jira/browse/HIVE-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14175390#comment-14175390 ]
Xiaobing Zhou commented on HIVE-8497: ------------------------------------- Thanks [~prashuj]! > StatsNoJobTask doesn't close RecordReader, FSDataInputStream of which keeps > open to prevent stale data clean > ------------------------------------------------------------------------------------------------------------ > > Key: HIVE-8497 > URL: https://issues.apache.org/jira/browse/HIVE-8497 > Project: Hive > Issue Type: Bug > Affects Versions: 0.14.0 > Environment: Windows > Reporter: Xiaobing Zhou > Assignee: Xiaobing Zhou > Priority: Critical > Attachments: HIVE-8497.1.patch > > > run the test > {noformat} > mvn -Phadoop-2 test -Dtest=TestCliDriver -Dqfile=alter_merge_stats_orc.q > {noformat} > to reproduce it. Simply, this query does three data loads which generates > three base orc files. > ANALYZE TABLE...COMPUTE STATISTICS NOSCAN will execute StatsNoJobTask to get > stats, where file handle is held so as not able to clean base file. As a > result, after running ALTER TABLE..CONCATENATE, follow-up queries go to stale > base file and merged file. -- This message was sent by Atlassian JIRA (v6.3.4#6332)