Hi Jon,
When you "copied a new build up to one machine" did you mean that you swipe
in the new jar, and then bounce the instance?
Kafka Streams should naturally support online upgrading by simply rolling
bounce your instances, so I would not expect the scenarios you described to
happen. However,
Update: the app ran well for several hours.. until I tried to update it. I
copied a new build up to one machine (of five) and then we went back to
near-endless-rebalance. After about an hour I ended up killing the other
four instances and watching the first (new one). It took 90 minutes before
it s
In a turn of events - this morning I was about to throw in the proverbial
towel on Kafka. In a last ditch effort I killed all but one instance of my
app, put it back to a single thread (why offer the option if it's not
advised?) and deleted every last topic that had any relation to this app.
I res
We do recommend one thread per instance of the app. However, it should also
work with multiple threads.
I can't debug the problem any further without the logs from the other apps.
We'd need to try and see if another instance still has task 1_3 open ( i
suspect it does )
Thanks,
Damian
On Wed, 14
What should I do about this? One thread per app?
On Wed, Dec 14, 2016 at 4:11 AM, Damian Guy wrote:
> That is correct
>
> On Wed, 14 Dec 2016 at 12:09 Jon Yeargers
> wrote:
>
> > I have the app running on 5 machines. Is that what you mean?
> >
> > On Wed, Dec 14, 2016 at 1:38 AM, Damian Guy
>
That is correct
On Wed, 14 Dec 2016 at 12:09 Jon Yeargers wrote:
> I have the app running on 5 machines. Is that what you mean?
>
> On Wed, Dec 14, 2016 at 1:38 AM, Damian Guy wrote:
>
> > Hi Jon,
> >
> > Do you have more than one instance of the app running? The reason i ask
> is
> > because t
I have the app running on 5 machines. Is that what you mean?
On Wed, Dec 14, 2016 at 1:38 AM, Damian Guy wrote:
> Hi Jon,
>
> Do you have more than one instance of the app running? The reason i ask is
> because the task (task 1_3) that fails with the
> "java.lang.IllegalStateException" in this l
Hi Jon,
Do you have more than one instance of the app running? The reason i ask is
because the task (task 1_3) that fails with the
"java.lang.IllegalStateException" in this log is previously running as a
Standby Task. This would mean the active task for this store would have
been running elsewhere
As near as I can see it's rebalancing constantly.
I'll up that value and see what happens.
On Tue, Dec 13, 2016 at 9:04 AM, Damian Guy wrote:
> Hi Jon,
>
> I haven't had much of a chance to look at the logs in detail too much yet,
> but i have noticed that your app seems to be rebalancing frequ
Hi Jon,
I haven't had much of a chance to look at the logs in detail too much yet,
but i have noticed that your app seems to be rebalancing frequently. It
seems that it is usually around the 300 second mark, which usually would
mean that poll hasn't been called for at least that long. You might w
n/m - I understand the logging issue now. Am generating a new one. Will
send shortly.
On Tue, Dec 13, 2016 at 4:55 AM, Jon Yeargers
wrote:
> Yes - saw that one. There were plenty of smaller records available though.
>
> I sent another log this morning with the level set to DEBUG. Hopefully you
>
Yes - saw that one. There were plenty of smaller records available though.
I sent another log this morning with the level set to DEBUG. Hopefully you
rec'd it.
On Tue, Dec 13, 2016 at 3:58 AM, Damian Guy wrote:
> HI Jon,
>
> It looks like you have the logging level for KafkaStreams set to at le
HI Jon,
It looks like you have the logging level for KafkaStreams set to at least
WARN. I can only see ERROR level logs being produced from Streams.
However, i did notice an issue in the logs (not related to your specific
error but you will need to fix anyway):
There are lots of messages like:
t
(am attaching a debug log - note that app terminated with no further
messages)
topology: kStream -> groupByKey.aggregate(minute) -> foreach
\-> groupByKey.aggregate(hour) -> foreach
config:
Properties config = new Properties();
config.put(StreamsConf
Jon,
To help investigating this issue, could you let me know 1) your topology
sketch and 2) your app configs? For example did you enable caching in your
apps with the cache.max.bytes.buffering config?
Guozhang
On Sun, Dec 11, 2016 at 3:44 PM, Jon Yeargers
wrote:
> I get this one quite a bit.
I get this one quite a bit. It kills my app after a short time of running.
Driving me nuts.
On Sun, Dec 11, 2016 at 2:17 PM, Matthias J. Sax
wrote:
> Not sure about this one.
>
> Can you describe what you do exactly? Can you reproduce the issue? We
> definitely want to investigate this.
>
> -Mat
Not sure about this one.
Can you describe what you do exactly? Can you reproduce the issue? We
definitely want to investigate this.
-Matthias
On 12/10/16 4:17 PM, Jon Yeargers wrote:
> (Am reporting these as have moved to 0.10.1.0-cp2)
>
> ERROR o.a.k.c.c.i.ConsumerCoordinator - User provided
(Am reporting these as have moved to 0.10.1.0-cp2)
ERROR o.a.k.c.c.i.ConsumerCoordinator - User provided listener
org.apache.kafka.streams.processor.internals.StreamThread$1 for group
MinuteAgg failed on partition assignment
java.lang.IllegalStateException: task [1_9] Log end offset should not
c
18 matches
Mail list logo
