wolfboys commented on issue #3905: URL: https://github.com/apache/incubator-streampark/issues/3905#issuecomment-2258492177
> 3.Why do we need to introduce the Job Distribution or Consistent Hash? To distribute tasks to different servers, consider the scenario where three servers are active and 100 tasks need to be managed. Ideally, server A would handle tasks 1-33, server B would handle tasks 34-66, and server C would handle tasks 67-100. However, this is hard to achieve in reality. Consistent hashing is used to solve this problem. We only need to place three points representing server A, server B, and server C on a hash ring, and then distribute the 100 tasks onto the hash ring. Based on the distances between these tasks and the three server nodes, we can determine which server should manage each task. If a server fails, there will be one less node on the hash ring, reducing it to two. The distribution will be recalculated  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
