[
https://issues.apache.org/jira/browse/HIVE-14574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15427319#comment-15427319
]
Sergey Shelukhin commented on HIVE-14574:
-----------------------------------------
We can easily achieve unique IDs by taking ZK node name (which is unique and
sequential). However, as the new node is re-added to the tail on every restart,
it throws everything off.
What we want conceptually is that restarted nodes go into the same position in
the order as the nodes they replaced, but that is difficult to achieve (or
impossible, I am not sure we have such a concept with Slider). We can just have
sequential numbers in ZK to take, with every registering node fighting for the
lowest number. I wonder if there's already a primitive for that in curator ;)
We can also assume we usually restart in the same place and order by the first
time there was LLAP on that particular node for that cluster, then by name.
> use consistent hashing for LLAP consistent splits to alleviate impact from
> cluster changes
> ------------------------------------------------------------------------------------------
>
> Key: HIVE-14574
> URL: https://issues.apache.org/jira/browse/HIVE-14574
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-14574.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
