ymiuraaa commented on issue #2940:
URL: https://github.com/apache/kvrocks/issues/2940#issuecomment-3165100711
Hmm true. I agree the main challenge isn’t just key encoding or hashing, but
partitioning SSTs according to slot-to-node mapping so each SST can be ingested
correctly by a Kvrocks cluster.
So then in that case I should probably abstract out the key encoding and
slot hashing into reusable functions so they can be shared between kvrocks and
this tool we'll be making. First, we'll start with generating a single SST and
log warnings if keys span multiple slots. We can make this tool support a
--slot-map option (e.g. JSON input like { "0-5000": "shard1", ... , "0-5n":
"shard n"}) that outputs one SST per slot range, so that it's ready for
ingestion by the correct kvrocks instance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
