> On March 22, 2016, 5:09 a.m., Gopal V wrote: > > llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/OrcEncodedDataReader.java, > > line 844 > > <https://reviews.apache.org/r/45062/diff/1/?file=1307057#file1307057line844> > > > > is Data ever non-null here? > > Sergey Shelukhin wrote: > Yes, in EncodedReaderImpl > // 2.5. Remember the bad estimates for future reference. > if (badEstimates != null && !badEstimates.isEmpty()) { > // Relies on the fact that cache does not actually store these. > DiskRange[] cacheKeys = badEstimates.toArray(new > DiskRange[badEstimates.size()]); > long[] result = cacheWrapper.putFileData(fileKey, cacheKeys, null, > baseOffset); > assert result == null; // We don't expect conflicts from bad > estimates. > }
and for non-null: // 6. Finally, put uncompressed data to cache. if (fileKey != null) { long[] collisionMask = cacheWrapper.putFileData(fileKey, cacheKeys, targetBuffers, baseOffset); processCacheCollisions(collisionMask, toDecompress, targetBuffers, csd.getCacheBuffers()); } - Sergey ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/45062/#review124732 ----------------------------------------------------------- On March 18, 2016, 11:18 p.m., Sergey Shelukhin wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/45062/ > ----------------------------------------------------------- > > (Updated March 18, 2016, 11:18 p.m.) > > > Review request for hive, Gopal V and Prasanth_J. > > > Repository: hive-git > > > Description > ------- > > see jira > > > Diffs > ----- > > common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 98c6372 > > llap-server/src/java/org/apache/hadoop/hive/llap/cache/EvictionDispatcher.java > bae571e > > llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapOptionsProcessor.java > c292b37 > > llap-server/src/java/org/apache/hadoop/hive/llap/io/api/impl/LlapIoImpl.java > dbee823 > > llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/OrcEncodedDataReader.java > eb251a8 > > llap-server/src/java/org/apache/hadoop/hive/llap/io/metadata/OrcFileEstimateErrors.java > PRE-CREATION > > llap-server/src/java/org/apache/hadoop/hive/llap/io/metadata/OrcMetadataCache.java > e970137 > > llap-server/src/test/org/apache/hadoop/hive/llap/cache/TestOrcMetadataCache.java > 901e58a > ql/src/java/org/apache/hadoop/hive/ql/io/orc/encoded/EncodedReaderImpl.java > 29b51ec > > storage-api/src/java/org/apache/hadoop/hive/common/io/encoded/EncodedColumnBatch.java > ddba889 > > Diff: https://reviews.apache.org/r/45062/diff/ > > > Testing > ------- > > > Thanks, > > Sergey Shelukhin > >