Re: Kafka 0.11.0 problem with transactions.

2017-08-04 Thread Bienek, Marcin
Hi, Many thanks for the explanation. I just wanted to do some tests and look around, I think the perf tool will be OK for me. Indeed, it’s a bit tricky with the console producer. To do a commit after every new line (enter) sounds not right. Something like begin; message, message… commit;

Re: Kafka 0.11.0 problem with transactions.

2017-08-03 Thread Apurva Mehta
Ismael raises good questions about what transactions would mean for the console producer. However, the kafka-producer-perf-test script has transactions enabled. It enables you to generate transactions of a certain duration (like 50ms, 100ms). It produces messages of specified size and commits them

Re: Kafka 0.11.0 problem with transactions.

2017-08-03 Thread Ismael Juma
Hi Marcin, The console producer hasn't been updated to invoke the appropriate methods if transactions are enabled. It also requires a bit of thinking on how it should work. Would there be a way to start and commit the transaction via the console or would the console producer do it periodically? Wh