hit-lacus opened a new pull request #549: KYLIN-3905 Enable shrunken dictionary 
default
URL: https://github.com/apache/kylin/pull/549
 
 
   In dev mail list's discussion, I suggest to enable shrunken dictionary by 
default, and received some dev's aggrement. 
   When using bitmap measure on a large cardinality column(require global 
dictionaty), build base cuboid step need frequent cache swap so it cannot 
finished within a reasonable period.
   When shrunken dictionary enabled, a new step will be added to build 
separated dictionary for each `InputSplit`, Mapper of *BuildBaseCuboid* step 
only has to fetch a smaller dictionary for itself, instead of a larger global 
dictionary. It will reduce cache swap and make *BuildBaseCuboid* step run as 
quicker as possible.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to