Re: Kafka streams regex match

2017-08-08 Thread Shekar Tippur
I am running this on a mac laptop. I am using defaults. Sent from my iPhone > On Aug 8, 2017, at 03:11, Damian Guy wrote: > > Hi Shekar, that warning is expected during rebalances and should generally > resolve itself. > How many threads/app instances are you running? > It is impossible to tell

Re: Kafka streams regex match

2017-08-08 Thread Damian Guy
Hi Shekar, that warning is expected during rebalances and should generally resolve itself. How many threads/app instances are you running? It is impossible to tell what is happening with the full logs. Thanks, Damian On Mon, 7 Aug 2017 at 22:46 Shekar Tippur wrote: > Damien, > > Thanks for poin

Re: Kafka streams regex match

2017-08-07 Thread Shekar Tippur
Damien, Thanks for pointing out the error. I had tried a different version of initializing the store. Now that I am able to compile, I started to get the below error. I looked up other suggestions for the same error and followed up to upgrade Kafka to 0.11.0.0 version. I still get this error :/

Re: Kafka streams regex match

2017-08-04 Thread Shekar Tippur
Damian, I am getting a syntax error. I have responded on gist. Appreciate any inputs. - Shekar On Sat, Jul 29, 2017 at 1:57 AM, Damian Guy wrote: > Hi, > > I left a comment on your gist. > > Thanks, > Damian > > On Fri, 28 Jul 2017 at 21:50 Shekar Tippur wrote: > > > Damien, > > > > Here is a

Re: Kafka streams regex match

2017-07-29 Thread Damian Guy
Hi, I left a comment on your gist. Thanks, Damian On Fri, 28 Jul 2017 at 21:50 Shekar Tippur wrote: > Damien, > > Here is a public gist: > https://gist.github.com/ctippur/9f0900b1719793d0c67f5bb143d16ec8 > > - Shekar > > On Fri, Jul 28, 2017 at 11:45 AM, Damian Guy wrote: > > > It might be ea

Re: Kafka streams regex match

2017-07-28 Thread Shekar Tippur
Damien, Here is a public gist: https://gist.github.com/ctippur/9f0900b1719793d0c67f5bb143d16ec8 - Shekar On Fri, Jul 28, 2017 at 11:45 AM, Damian Guy wrote: > It might be easier if you make a github gist with your code. It is quite > difficult to see what is happening in an email. > > Cheers,

Re: Kafka streams regex match

2017-07-28 Thread Damian Guy
It might be easier if you make a github gist with your code. It is quite difficult to see what is happening in an email. Cheers, Damian On Fri, 28 Jul 2017 at 19:22, Shekar Tippur wrote: > Thanks a lot Damien. > I am able to get to see if the join worked (using foreach). I tried to add > the log

Re: Kafka streams regex match

2017-07-28 Thread Shekar Tippur
Thanks a lot Damien. I am able to get to see if the join worked (using foreach). I tried to add the logic to query the store after starting the streams: Looks like the code is not getting there. Here is the modified code: KafkaStreams streams = new KafkaStreams(builder, props); streams.start();

Re: Kafka streams regex match

2017-07-28 Thread Damian Guy
Hi, The store won't be queryable until after you have called streams.start(). No stores have been created until the application is up and running and they are dependent on the underlying partitions. To check that a stateful operation has produced a result you would normally add another operation a

Re: Kafka streams regex match

2017-07-27 Thread Shekar Tippur
One more thing.. How do we check if the stateful join operation resulted in a kstream of some value in it (size of kstream)? How do we check the content of a kstream? - S On Thu, Jul 27, 2017 at 2:06 PM, Shekar Tippur wrote: > Damien, > > Thanks a lot for pointing out. > > I got a little furthe

Re: Kafka streams regex match

2017-07-27 Thread Shekar Tippur
Damien, Thanks a lot for pointing out. I got a little further. I am kind of stuck with the sequencing. Couple of issues: 1. I cannot initialise KafkaStreams before the parser.to(). 2. Do I need to create a new KafkaStreams object when I create a KeyValueStore? 3. How do I initialize KeyValueItera

Re: Kafka streams regex match

2017-07-27 Thread Damian Guy
It is part of the ReadOnlyKeyValueStore interface: https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/state/ReadOnlyKeyValueStore.java On Thu, 27 Jul 2017 at 17:17 Shekar Tippur wrote: > That's cool. This feature is a part of rocksdb object and not ktable?

Re: Kafka streams regex match

2017-07-27 Thread Shekar Tippur
That's cool. This feature is a part of rocksdb object and not ktable? Sent from my iPhone > On Jul 27, 2017, at 07:57, Damian Guy wrote: > > Yes they can be strings, > > so you could do something like: > store.range("test_host", "test_hosu"); > > This would return an iterator containing all o

Re: Kafka streams regex match

2017-07-27 Thread Damian Guy
Yes they can be strings, so you could do something like: store.range("test_host", "test_hosu"); This would return an iterator containing all of the values (inclusive) from "test_host" -> "test_hosu". On Thu, 27 Jul 2017 at 14:48 Shekar Tippur wrote: > Can you please point me to an example? Can

Re: Kafka streams regex match

2017-07-27 Thread Shekar Tippur
Can you please point me to an example? Can from and to be a string? Sent from my iPhone > On Jul 27, 2017, at 04:04, Damian Guy wrote: > > Hi, > > You can't use a regex, but you could use a range query. > i.e, keyValueStore.range(from, to) > > Thanks, > Damian > >> On Wed, 26 Jul 2017 at 22:

Re: Kafka streams regex match

2017-07-27 Thread Damian Guy
Hi, You can't use a regex, but you could use a range query. i.e, keyValueStore.range(from, to) Thanks, Damian On Wed, 26 Jul 2017 at 22:34 Shekar Tippur wrote: > Hello, > > I am able to get the kstream to ktable join work. I have some use cases > where the key is not always a exact match. > I