Consumer blocks forever during initialization if the brokers are not
reachable. 'request.timeout.ms' does not seem to be effective. How are
users expected to detect this and handle?
e.g:
$ ./kafka-console-consumer.sh --bootstrap-server google.com:9092 --topic
queries
This blocks forever since goo
Hi Debasish,
You can just implement the QueryableStoreType interface. You can take a
look here:
https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/state/QueryableStoreTypes.java#L77
for
an example.
Then you just pass your implementation to `kafkaStreams.stor
Yeah, can confirm there is only 1 vCPU.
Okay, will try that configuration and get back to you guys.
Thanks so far !
On Fri, Jun 30, 2017 at 7:35 PM, Damian Guy wrote:
> I'm wondering if it is related to this:
> http://docs.confluent.io/current/streams/faq.html#
> rocksdb-behavior-in-1-core-env
I'm wondering if it is related to this:
http://docs.confluent.io/current/streams/faq.html#rocksdb-behavior-in-1-core-environments
It seems like the same issue.
Thanks,
Damian
On Fri, 30 Jun 2017 at 17:16 Dmitriy Vsekhvalnov
wrote:
> Yes, StreamThread-1 #93 daemon is still at at org.rocksdb.Rock
Yes, StreamThread-1 #93 daemon is still at at org.rocksdb.RocksDB.put.
No, AWS machine.
kafka-streams v0.10.2.1
May be some option for RockDB that can unlock it? Also i can try to run app
locally against same env to see if it make difference (though it will be
different OS).
On Fri, Jun 30, 201
Hi Ian,
Can you check if the file exists and it is indeed a file rather then a
directory?
Thanks,
Damian
On Fri, 30 Jun 2017 at 16:45 Damian Guy wrote:
> Hi Ian,
>
> We had another report of what looks like the same issue. Will look into it.
>
> Thanks,
> Damian
>
> On Fri, 30 Jun 2017 at 16:3
Hi Ian,
We had another report of what looks like the same issue. Will look into it.
Thanks,
Damian
On Fri, 30 Jun 2017 at 16:38 Ian Duffy wrote:
> Hi All,
>
> I was wondering if any of those who know stream internals should shed any
> light on the following exception:
>
> org.apache.kafka.stre
Hi All,
I was wondering if any of those who know stream internals should shed any
light on the following exception:
org.apache.kafka.streams.errors.ProcessorStateException: Error while
closing the state manager at
org.apache.kafka.streams.processor.internals.AbstractTask.closeStateManager(Abstrac
Yep, if you take another thread dump is it in the same spot?
Which version of streams are you running? Are you using docker?
Thanks,
Damian
On Fri, 30 Jun 2017 at 16:22 Dmitriy Vsekhvalnov
wrote:
> Is this one looking suspicious?
>
>
> https://gist.github.com/dvsekhvalnov/146ba41c8e783169410989
Is this one looking suspicious?
https://gist.github.com/dvsekhvalnov/146ba41c8e78316941098997c9d2f18a#file-thread-dump
On Fri, Jun 30, 2017 at 6:10 PM, Damian Guy wrote:
> It looks like Task [4_2] is stuck restoring state, though it doesn't look
> like there is much state to restore.
> It might
It looks like Task [4_2] is stuck restoring state, though it doesn't look
like there is much state to restore.
It might be helpful if you take some thread dumps to see where it is
blocked.
Thanks,
Damian
On Fri, 30 Jun 2017 at 16:04 Dmitriy Vsekhvalnov
wrote:
> Set org.apache.kafka.streams to
Set org.apache.kafka.streams to DEBUG.
Here is gist:
https://gist.github.com/dvsekhvalnov/b84b72349837f6c6394f1adfe18cdb61#file-debug-logs
On Fri, Jun 30, 2017 at 12:37 PM, Dmitriy Vsekhvalnov <
dvsekhval...@gmail.com> wrote:
> Sure, how to enable debug logs? Just adjust logback logger?
>
>
> O
Hi,
Does anyone know if this will get addressed anytime soon? Any workarounds?
The functionality has been broken for a while.
KR,
Hi,
I've got problem with running example mentioned in Step7: Use Kafka Connect
to import/export data (Windows10)
pure (step by step from tutorial) execution of
c:\kafka_2.11-0.11.0.0>bin\windows\connect-standalone.bat
config\connect-standalone.properties config\connect-file-source.properties
co
Hi hans,
Thanks for your response. We are already looked this KIP-124 - Request rate
quotas in Kafka 0.11.0, But it will help us to throttle based on request
processing time taken by the user/client or broker CPU utilization of request
thread.
We are looking for some mechanism, like which wil
Hi -
I have a custom state store in my Kafka Streams application. I have
developed the whole Topology and the Processor abstractions. I have the
custom state store implemented as well and have the following builder for
hooking up the processors and the store .. Here's the Scala snippet ..
builder
Sure, how to enable debug logs? Just adjust logback logger?
On Fri, Jun 30, 2017 at 11:24 Eno Thereska wrote:
> It’s hard to tell, the logs do not contain much, I agree. It could be a
> number of things.
>
> If it’s happening as you say on restart as well (so it’s reproducible),
> any chance yo
It’s hard to tell, the logs do not contain much, I agree. It could be a number
of things.
If it’s happening as you say on restart as well (so it’s reproducible), any
chance you could start streaming with DEBUG logs on and collect those logs? I’m
hoping something shows up there.
Thanks,
Eno
>
Thanks Matthias
On Fri, 30 Jun 2017 at 08:05 Matthias J. Sax wrote:
> I am just catching up on this thread, so sorry for the long email in
> advance... Also, it's to some extend a dump of thoughts and not always a
> clear proposal. Still need to think about this in more detail. But maybe
> it he
19 matches
Mail list logo
