dmvk commented on PR #24079: URL: https://github.com/apache/flink/pull/24079#issuecomment-1892836002
hmm, so the issue is related to repartitioning in case there are multiple states; imagine we have two states with 6 elements and we rescale from 1 to 3; this means that every split gets 2 elements; 1) we read 2 elements from first state 2) now we want to read 2 elements from 2nd state, but we're resuming read from where we left off (before seeking to offset) and surprise, headers are not there 🙈 It seems that we should not really have snappy headers per-state, but we should write them just once at the begining ... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
