Re: Transactional Consistency beyond KIP-98 (transactional consumer)

2017-07-05 Thread Guozhang Wang
Hello Werner, 1) Regarding the long transaction, we did discuss about this in the design doc ( https://docs.google.com/document/d/11Jqy_GjUGtdXJK94XGsEIK7CP1SnQGdp2eF0wSw9ra8/edit#bookmark=id.z9b0a6k2a3zm), and as stated the main reason we chose to go with the current design is to preserve offset

Transactional Consistency beyond KIP-98 (transactional consumer)

2017-07-05 Thread Daehn, Werner
While the new transactional consistency feature is definitely a move into the right direction, I find the current design limitations quite severe. Understandable but severe. First is the offset being the add-time, not the commit time. The consequence of that is, if one transactional producer ad