vineetgarg02 commented on a change in pull request #552: Hive 21279
URL: https://github.com/apache/hive/pull/552#discussion_r260895578
##########
File path: ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java
##########
@@ -204,6 +219,16 @@ public void compile(final ParseContext pCtx,
fetch.setIsUsingThriftJDBCBinarySerDe(false);
}
+ Collection<Operator<? extends OperatorDesc>> tableScanOps =
+ Lists.<Operator<?>>newArrayList(pCtx.getTopOps().values());
+ Set<FileSinkOperator> fsOps = OperatorUtils.findOperators(tableScanOps,
FileSinkOperator.class);
+ if(fsOps != null && fsOps.size() == 1) {
+ FileSinkOperator op = fsOps.iterator().next();
+ Set<Path> filesToFetch = new HashSet<>();
+ op.getConf().setFilesToFetch(filesToFetch);
Review comment:
filesToFetch is populated on client(HS2) side not task side (during job
close op) that is why having reference works.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
