Re: Strange behavior when turn the system clock back

2016-08-16 Thread Gabriel Ibarra
Hi, Thanks for answering Ismael. I'm sorry I was absent the last days. Here is the link to the issue: https://issues.apache.org/jira/browse/KAFKA-4051 On Thu, Aug 11, 2016 at 5:11 PM, Ismael Juma wrote: > It's probably worth filing a ticket in JIRA. Please also include a bit of > context why i

Re: Strange behavior when turn the system clock back

2016-08-11 Thread Ismael Juma
It's probably worth filing a ticket in JIRA. Please also include a bit of context why it's important for the consumers to tolerate system clock changes. Ismael On Thu, Aug 11, 2016 at 7:54 PM, Gabriel Ibarra < gabriel.iba...@tallertechnologies.com> wrote: > Thanks Ismael, > I agree with you, It

Re: Strange behavior when turn the system clock back

2016-08-11 Thread Gabriel Ibarra
Thanks Ismael, I agree with you, It seems to be a problem related with absolute timers. So, How we continue?, do you agree with report this as a bug? In our system this issue has a great impact. And maybe this particular issue could be fixed without a serious decreasing of performance. On Thu, A

Re: Strange behavior when turn the system clock back

2016-08-11 Thread Ismael Juma
Kafka code uses System.currentTimeMillis in a number of places, so it would not surprise me if it misbehaves when the clock is turned back by an hour. System.nanoTime is meant to handle this issue, but there are questions about the performance impact of using that ( https://github.com/apache/kafka/

Re: Strange behavior when turn the system clock back

2016-08-11 Thread Gabriel Ibarra
Thanks for answering, all help is welcome. Yes, I tested without changing the clock and It works well. Actually both consumer are running in different process, so I think it is not the case that you mention. I even tested this using two different Kafka clients, using the java client and using lib

Re: Strange behavior when turn the system clock back

2016-08-10 Thread Gwen Shapira
I know it sounds silly, but did you check that your test setup works when you don't change the clock? This pattern can happen when two consumers somehow block each other (for example, one thread with two consumers) - so one waits for the other to join, but the other is blocked, so the first is tim

Strange behavior when turn the system clock back

2016-08-10 Thread Gabriel Ibarra
Hello guys, I am dealing with an issue when turn the system clock back (either due to NTP or administrator action). I'm using kafka_2.11-0.10.0.0 I follow the next steps. - Start a consumer for TOPIC_NAME with group id GROUP_NAME. It will be owner of all the partitions. - Turn the system clock bac