Kafka streams Issue

2016-07-29 Thread Hamza HACHANI
> Good morning, > > I'm an ICT student in TELECOM BRRETAGNE (a french school). > I did follow your presentation in Youtube and i found them really > intresting. > I'm trying to do some stuffs with Kafka. And now it has been about 3 days > that I'm blocked. > I'm trying to control the time in which

RE: Kafka streams Issue

2016-07-29 Thread Hamza HACHANI
scripts.com Connect with us: Twitter I LinkedIn I Facebook I YouTube -Original Message- From: Hamza HACHANI [mailto:hamza.hach...@supcom.tn] Sent: Friday, July 29, 2016 9:36 AM To: users@kafka.apache.org Subject: Kafka streams Issue > Good morning, > > I'm an ICT student in TE

RE: Kafka streams Issue

2016-07-29 Thread Hamza HACHANI
scripts O: 651.855.3042 | www.surescripts.com<http://www.surescripts.com> | dave.tauz...@surescripts.com Connect with us: Twitter I LinkedIn I Facebook I YouTube -Original Message- From: Hamza HACHANI [mailto:hamza.hach...@supcom.tn] Sent: Friday, July 29, 2016 9:53 AM To: users@kafka.apache.o

A specific use case

2016-08-01 Thread Hamza HACHANI
Good morning, I'm working on a specific use case. In fact i'm receiving messages from an operator network and trying to do statistics on their number per minute,perhour,per day ... I would like to create a broker that receives the messages and generates a message every minute. These producted

Re : A specific use case

2016-08-03 Thread Hamza HACHANI
ing "broker" I think you are actually referring to a Kafka Streams instance? Guozhang On Mon, Aug 1, 2016 at 1:01 AM, Hamza HACHANI wrote: > Good morning, > > I'm working on a specific use case. In fact i'm receiving messages from an > operator network and trying t

RE: Re : A specific use case

2016-08-05 Thread Hamza HACHANI
outputs that would resolve your issue. Remember that punctuate() function itself is event-time driven so if you do not have any data coming in then it may not be triggered. Details: https://github.com/apache/kafka/pull/1689 Guozhang On Wed, Aug 3, 2016 at 8:53 PM, Hamza HACHANI wrote: > Hi, >

Error kafka-stream method punctuate in context.forward()

2016-09-16 Thread Hamza HACHANI
Good morning, I have a problem with a kafka-stream application. In fact I 've created already two kafka stream applications : StatsByMinute : entry topic : uplinks, out topic : statsM. StatsByHour : entrey topic : statsM, out topic : statsH. StatsByDay : entry topic : statsH, out topic : stats

RE: Error kafka-stream method punctuate in context.forward()

2016-09-20 Thread Hamza HACHANI
= objectMapper.writeValueAsString(stat); return s; } catch (IOException e) { System.out.println(e.getMessage()); return "{'operatorId':'fake','networkPartnerId':'fake','baseStationId':'fake'

RE: Error kafka-stream method punctuate in context.forward()

2016-09-20 Thread Hamza HACHANI
I'm using the version 10.0 De : Hamza HACHANI Envoyé : lundi 19 septembre 2016 19:20:23 À : users@kafka.apache.org Objet : RE: Error kafka-stream method punctuate in context.forward() Hi Guozhang, Here is the code for the two concerned classes If thi

intilisation of the contexte

2016-09-27 Thread Hamza HACHANI
Hi, i would like to know how in kafka streams the context is initilised. Because I 've a problem with one kafka-stream apllication. every time i call it i notice that the context is initilaised more than once or is created more than once which is abnormal and this cause a bug in the system.

difficulty to delete a topic because of its syntax

2016-10-05 Thread Hamza HACHANI
Hi, I created a topic called device-connection-invert-key-value-the metric-changelog. I insit that there is a space in it. Now that i want to delete it because my cluster can no longer work correctly i can't do it as it only reads the first part of it : ( device-connection-invert-key-valu

RE: difficulty to delete a topic because of its syntax

2016-10-05 Thread Hamza HACHANI
It's between "the" and "metric" De : Ali Akhtar Envoyé : mercredi 5 octobre 2016 02:16:33 À : users@kafka.apache.org Objet : Re: difficulty to delete a topic because of its syntax I don't see a space in that topic name On Wed,

RE: difficulty to delete a topic because of its syntax

2016-10-05 Thread Hamza HACHANI
Try putting "" or '' around the string when running the command. On Wed, Oct 5, 2016 at 3:29 PM, Hamza HACHANI wrote: > It's between "the" and "metric" > > > De : Ali Akhtar > Envoyé : mercredi 5 oct

RE: difficulty to delete a topic because of its syntax

2016-10-06 Thread Hamza HACHANI
space in topic name. > > On Wed, Oct 5, 2016 at 8:19 PM, Hamza HACHANI > > wrote: > > > Well ackwardly when i list the topics i find it but when i do delete it > it > > says that this topic does not exist. > > > > > >

RE: difficulty to delete a topic because of its syntax

2016-10-06 Thread Hamza HACHANI
__ De : Hamza HACHANI Envoyé : mercredi 5 octobre 2016 19:23:00 À : users@kafka.apache.org Objet : RE: difficulty to delete a topic because of its syntax Hi, Attached the files showing what i'm talking about. Hamza De : Todd S Envoyé : mercredi 5 octobre

RE: difficulty to delete a topic because of its syntax

2016-10-06 Thread Hamza HACHANI
tore. > > > 2016-10-06 18:40 GMT+09:00 Rajini Sivaram : > > Hamza, > > > > Can you raise a JIRA with details on how the topic was created by Kafka > > with an invalid name? Sounds like there might be a missing validation > > somewhere. > > >

Problem with ke-value in the KvStorre

2016-10-13 Thread Hamza HACHANI
Hi, I've designed two processors with a different topology. The issue is that in the firs topology in one node i was able to associate diffrent messages (key,value) where the key could be the same and so i was able to do something like countbyKey. In the second example when i liked to do the

RE: Problem with ke-value in the KvStorre

2016-10-13 Thread Hamza HACHANI
Sorry i was saying anything. Please consider as if i didn't say anything. Kafka does ensure the unicity of the key. De : Hamza HACHANI Envoyé : jeudi 13 octobre 2016 01:38:42 À : users@kafka.apache.org Objet : Problem with ke-value in the KvStorre Hi,

customised event time

2016-10-21 Thread Hamza HACHANI
Hi, I would like to process data based on a customised event time.(a timestamp that I implement as part of the message). The data is processed in periodic windows of x time that are parametered via the method punctuate. What I need is a retention time for the window to be able to treat the la

RE: customised event time

2016-10-24 Thread Hamza HACHANI
, that you will eventually get the latest/final result sent downstream. - -Matthias On 10/21/16 7:42 AM, Hamza HACHANI wrote: > Hi, > > > I would like to process data based on a customised event time.(a > timestamp that I implement as part of the message). > > The data is pro

RE: customised event time

2016-10-24 Thread Hamza HACHANI
To be more specific. What id do really need is the property of the retention time dor the window in the processor API. Because for the window i think that i can manage to do this. Hamza De : Hamza HACHANI Envoyé : dimanche 23 octobre 2016 20:30:13 À : users

RE: customised event time

2016-10-24 Thread Hamza HACHANI
And the start time and end time of the window. In other words i need the notion of windows in the proecessor API. Is this possible ? De : Hamza HACHANI Envoyé : dimanche 23 octobre 2016 20:43:05 À : users@kafka.apache.org Objet : RE: customised event time To

RE: customised event time

2016-10-25 Thread Hamza HACHANI
: org.apache.kafka.streams.state.Stores More specifically, you you do sth. like: Stores.create().withKeys().withValues().persistent().windowed(/* you can specify window size, retention period etc here */) Which returns the RocksDBWindowStoreSupplier. Guozhang On Mon, Oct 24, 2016 at 2:23 AM, Hamza HACHANI

windowing with the processor api

2016-11-02 Thread Hamza HACHANI
Hi, I would like to know if somebody has an idea how to define the size of the window in the processor api. I've been blocked for 6 days looking for a solution. using : Stores.create(...).withStringKeys().withStringValues().persistent().windowed(...).build() I was able to define the retention

RE: windowing with the processor api

2016-11-02 Thread Hamza HACHANI
windowed(10, 10, 2, false).build(), "the-processor") Thanks Eno > On 2 Nov 2016, at 08:19, Hamza HACHANI wrote: > > Hi, > > I would like to know if somebody has an idea how to define the size of the > window in the processor api. > > I've bee

Re : windowing with the processor api

2016-11-02 Thread Hamza HACHANI
lain > key-value store and is not aware of any windowing stuff. > > I would highly recommend to use DSL to use windows operations. This > should not be a limitation as you can mix-and-match DSL and Processor > API. All you can do with plain processor API you can also do within > D

Control results coming from windows

2016-11-04 Thread Hamza HACHANI
Hi, I implemented window using Stream DSL.But results does get out from the window anytime a new data come. Is there anyway to make result get out from the window just at the end of the size of the window not like this way. In other words, I do need to control the flow of data getting out of

RE: Control results coming from windows

2016-11-04 Thread Hamza HACHANI
xpect multiple results for a window. Thanks, Damian On Fri, 4 Nov 2016 at 08:42 Hamza HACHANI wrote: > Hi, > > > I implemented window using Stream DSL.But results does get out from the > window anytime a new data come. Is there anyway to make result get out > from the window just at

RE: Control results coming from windows

2016-11-04 Thread Hamza HACHANI
//cwiki.apache.org/confluence/display/KAFKA/KIP-63%3A+Unify+store+and+downstream+caching+in+streams Thanks, Damian On Fri, 4 Nov 2016 at 09:44 Hamza HACHANI wrote: > Hi Damian, > > > If i would pass tp the 0.10.1. Is this possible without impacting the > applications that i'v

Abnormal working in the method punctuate and error linked to seesion.timeout.ms

2016-11-28 Thread Hamza HACHANI
Hi, I've some troubles with the method puctuate.In fact when i would like to print a string in the method punctuate. this string would be printed in an indefinitly way as if I printed (while (true){print(string)}. I can't understand what happened.Does any body has an explenation ?. Besides I

RE: Abnormal working in the method punctuate and error linked to seesion.timeout.ms

2016-11-28 Thread Hamza HACHANI
n the method punctuate and error linked to seesion.timeout.ms Hi Hamza, If you have an infinite while loop, that would mean the app would spend all the time in that loop and poll() would never be called. Eno > On 28 Nov 2016, at 10:49, Hamza HACHANI wrote: > > Hi, > > I'

RE: Abnormal working in the method punctuate and error linked to seesion.timeout.ms

2016-11-28 Thread Hamza HACHANI
can have a look? Thanks Eno > On 28 Nov 2016, at 12:58, Hamza HACHANI wrote: > > Hi Eno. > > The problem is that there is no infinite while loop that i write. > > So I can't understand why the application is doing so. > > > Hamza > > _

RE: Abnormal working in the method punctuate and error linked to seesion.timeout.ms

2016-11-28 Thread Hamza HACHANI
the print is in line 40 of the class Base... De : Hamza HACHANI Envoyé : lundi 28 novembre 2016 01:25:08 À : users@kafka.apache.org Objet : RE: Abnormal working in the method punctuate and error linked to seesion.timeout.ms Hi Eno, Here is the code for the