on requested by
Guozhang (code and configs) and we can try to reproduce the error?
Thanks,
Bill
On Tue, Mar 5, 2019 at 10:14 AM Adrian McCague
wrote:
> Drilling down further:
>
> bash-4.2# pwd
> /data/fooapp/0_7
> bash-4.2# for dir in $(f
an
On 01/03/2019, 23:05, "Adrian McCague" wrote:
Hi Guozhang, thanks for your response.
I have done some further investigations.
The difference I see between the two versions is the following, in 1.1 this
is the stat of the rocksdb MANIFEST files of one of t
27;m not aware of any regressions
on rocksDB disk usage from 1.1 to 2.1.
Could you file a JIRA ticket with more details like state dir snapshots,
your code snippet and configs etc so we can find a way to reproduce it?
Guozhang
On Fri, Mar 1, 2019 at 5:54 AM
Hi,
We are in the process of attempting to upgrade from Kafka Streams 1.1.0 to
2.1.0(-cp1) however we get some wildly different behaviour with regards to disk
usage between these two versions.
An update that uses existing state data exhibits the same behaviour as starting
with a completely cle
code with
.transform(() -> new PhaseTransformer<>(..))
Guozhang
On Fri, Jun 16, 2017 at 2:29 AM, Adrian McCague
wrote:
> Hi Guozhang
>
> It's just occurred to me that the transformer is added to the topology
> like this:
>
> PhaseTransformer transformer = new
.
May be worth adding more documentation around the purpose of the supplier as I
couldn't initially find much on the topic.
Thank you for your insights and taking the time to look at our issue.
Thanks
Adrian
-Original Message-
From: Adrian McCague [mailto:adrian.mcca...@zopa.com]
Sent
on.
Also from your stack trace there is no direct clues available.
Would you mind creating a JIRA and attach the link to your JSON and your "
PhaseTransformer" implementation sketch, since what you observed may be a real
issue?
Guozhang
On Thu, Jun 15, 2017 at 1:42 AM, Adrian McCagu
put(final K key, final V value) {
put(key, value, context.timestamp()); }
--
The question is when were you calling `put()` in the Transformer, did you ever
call it in `init()` function?
Guozhang
On Wed, Jun 14, 2017 at 11:08 AM, Adrian McCague
wrote:
> Hi
Hi All
We have a transformer implementation in our Kafka Streams application that
raises this exception, sometimes, when starting.
"java.lang.IllegalStateException: This should not happen as timestamp() should
only be called while a record is processed"
This happens when 'put' is called on a s
Hi Matthias
We have been thinking about this problem recently and thought, wouldn't it be
nice if a join could be configured to be '1 time', within the retention period
of the join window. So if a join has occurred already on a particular key,
further ones will be ignored for the remainder of t
ably it is fixed in later
> version of kafka.
>
> On Fri, Apr 7, 2017 at 2:14 PM, Adrian McCague
>
> wrote:
>
> > Hi Akhilesh,
> >
> > Why would this approach need to be taken over the kafka-topics tool,
> > out of interest?
> >
> > Thanks
&g
...@gmail.com]
Sent: 07 April 2017 09:57
To: users@kafka.apache.org
Subject: Re: Topic deletion
I am not sure but kafka delete command does not delete the topic actually, it
only marks it for deletion. Probably it is fixed in later version of kafka.
On Fri, Apr 7, 2017 at 2:14 PM, Adrian McCague
,
You will have to delete the broker directory from zookeeper. This can be done
from zookeeper cli. Connect to zookeeper cli using below command:
zookeeper-client -server
Then run below command :
rmr /brokers/topics/
Thanks,
AKhilesh
On Thu, Apr 6, 2017 at 11:03 PM, Adrian McCague
wrote
kafka 0.10.1.0
You may be hitting this issue… https://issues.apache.org/jira/browse/KAFKA-2231
<https://issues.apache.org/jira/browse/KAFKA-2231>
Thanks
Zakee
> On Apr 6, 2017, at 11:20 AM, Adrian McCague wrote:
>
> Hi Sachin,
>
> I am told with confidence that the
users@kafka.apache.org
Subject: Re: Topic deletion
Do you have delete.topic.enable=true uncommented or present in server.properties
On Thu, Apr 6, 2017 at 11:03 PM, Adrian McCague
wrote:
> Hi all,
>
> I am trying to understand topic deletion in kafka, there appears to be
> very little documen
Hi all,
I am trying to understand topic deletion in kafka, there appears to be very
little documentation or answers on how this works. Typically they just say to
turn on the feature on the broker (in my case it is).
I executed:
Kafka-topics.bat -delete -zookeeper keeperhere -topic mytopic
Runn
ially use something like this, but on line 57 prefix the topic
name with the applicationId (if it doesn't already have it).
Would you mind raising a JIRA for this? It seems like an issue other people are
yet to encounter.
Thanks,
Damian
On Wed, 15 Mar 2017 at 13:05 Adrian McCague wrote:
Hi all,
We are getting collisions with subject names in our schema registry due to
state stores that are holding Avro events:
"KSTREAM-JOINOTHER-07-store-value",
"KSTREAM-JOINOTHER-06-store-value",
"KSTREAM-JOINOTHER-05-store-value",
"KSTREAM-OUTEROTHER-05-s
ld be committed, so in case of a crash the same offsets are not processed
again.
Thanks
Eno
> On 9 Feb 2017, at 16:06, Adrian McCague wrote:
>
> Hi all,
>
> In processor and transformer implementations, what are the use cases for
> calling `context.commit()`? Examples im
Hi all,
In processor and transformer implementations, what are the use cases for
calling `context.commit()`? Examples imply it should be called when state store
modifications are complete, Streams DSL implementations do not fall in line
with the examples, ie KStreamAggregate.
Thanks
Adrian
20 matches
Mail list logo
