Re: Problem in running a same PE in multiple nodes

2013-02-25 Thread Gowtham S
HI matthieu, thank you very much for your suggestions and ideas.. it has helped me a lot.. but whether we still lose some events in s4 0.6 also.. since u mentioned something like load shedding mechanism.. thanks. Gowtham On Mon, Feb 25, 2013 at 7:38 PM, Matthieu Morel wrote: > Thanks for the

Re: Problem in running a same PE in multiple nodes

2013-02-25 Thread Matthieu Morel
Thanks for the clarification. That's an interesting approach. Reusing the same prototype could make sense here, as it introduces the dynamicity that you need. However from what I could reproduce one of the nodes simply runs into a deadlock situation: PE cannot place local event into local "pr

Re: Problem in running a same PE in multiple nodes

2013-02-24 Thread Gowtham S
Hi matthieu, that was a sample design of the system. but i m trying to build a dynamic design of system during the time of execution.. for eg if i give the initial number of ProcessingPE as 10 means it has to map dynamically from 10 -> 8 , 8 ->4 , 4 ->2 , 2 ->1. what ever may be the initial number

Re: Problem in running a same PE in multiple nodes

2013-02-24 Thread Matthieu Morel
Hi, I had a quick look and I wonder why you are not using different PE prototypes for the different layers in your system? That looks like a more adequate design, since I don't think you need to keep the state from layer 1 in layer 2 or layer 3 because instead you send aggregated info through m

Re: Problem in running a same PE in multiple nodes

2013-02-22 Thread Matthieu Morel
Thanks for the info, with the cluster status that you show - which look ok - is there any problem with the app? Also, I would again recommend to check whether all data is processed as expected, regardless of the location. Can you check that? Thanks, Matthieu On Feb 22, 2013, at 14:02 , Gowt

Re: Problem in running a same PE in multiple nodes

2013-02-20 Thread Matthieu Morel
Hi Jihyoun, PE graphs with cycles can certainly get a bit tricky sometimes, but mainly because they can lead to deadlocks. I don't see how you'd lose events in the case you present if you don't lose or reconfigure nodes. In the very specific case of sending an event from PE instance a1 to the

Re: Problem in running a same PE in multiple nodes

2013-02-19 Thread JiHyoun Park
Dear Matthieu I also experienced the same problem with Gowtham. Unlike him, I created a downstream to itself with only one key. (It was like a flag to be turned on/off.) I tested it and found sometimes one PE instance does not receive the event. I remember that it didn't depend on a specific node.

Re: Problem in running a same PE in multiple nodes

2013-02-19 Thread Matthieu Morel
Hi, Can you provide more detail about a node not running correctly? what does that mean to you, that it does not receive messages? Maybe that's normal because of the distribution of keys. Or maybe you only have 3 active nodes in the cluster. (you can check that with the s4 status tool) The dis

Re: Problem in running a same PE in multiple nodes

2013-02-19 Thread Gowtham S
Hi S4 community, I have been working with s4 piper for 3 months. now i am just trying to make a downstream from a PE to the same PE with different Key Id. i just have a scenario in which i would have an unique PE whose downstream is also to that PE but each time the Key Id of the targeted PE may

Problem in running a same PE in multiple nodes

2013-02-19 Thread Gowtham S
Hi S4 community,