Re: Dealing with Multiple sinks in Flink

2016-12-05 Thread Robert Metzger
ode&node=10445&i=1> >> To unsubscribe from Apache Flink User Mailing List archive., click here. >> NAML >> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNa

Re: Dealing with Multiple sinks in Flink

2016-12-05 Thread vinay patil
Yes I had configured it as given in the documentation. I can see this line in Job Manager Logs : Started JMX server on port 9020 (but this was on EMR ) How to do this locally ? can we check these metrics while running the pipeline from IDE ? If yes what is teh default JMX port to connect ? or do w

Re: Dealing with Multiple sinks in Flink

2016-12-05 Thread Robert Metzger
Hi Vinay, the JMX port depends on the port you've configured for the JMX metrics reporter. Did you configure it? Regards, Robert On Fri, Dec 2, 2016 at 11:14 AM, vinay patil wrote: > Hi Robert, > > I had resolved this issue earlier as I had not set the Kafka source > parallelism to number of

Re: Dealing with Multiple sinks in Flink

2016-12-02 Thread vinay patil
Hi Robert, I had resolved this issue earlier as I had not set the Kafka source parallelism to number of partitions, so I was getting the issue of window not getting triggered. Now I am facing the same issue, I tried to check the watermark value by using visualVM locally but I am not seeing that v

Re: Dealing with Multiple sinks in Flink

2016-08-25 Thread Robert Metzger
>> > at Nabble.com. >>>> >>>> >>>> -- >>>> >>> If you reply to this email, your message will be added to the discussion >> below: >> http://apache-flink-user-mailing-list-archive.2336050.n4.nab >&g

Re: Dealing with Multiple sinks in Flink

2016-08-25 Thread vinay patil
>> >>> >> >>> >> If you reply to this email, your message will be added to the >>> discussion >>> >> below: >>> >> >>> >> http://apache-flink-user-mailing-list-archive.2336050.n4.

Re: Dealing with Multiple sinks in Flink

2016-08-25 Thread Robert Metzger
> discussion >> >> below: >> >> >> >> http://apache-flink-user-mailing-list-archive.2336050.n4. >> nabble.com/Dealing-with-Multiple-sinks-in-Flink-tp8643p8664.html >> >> To start a new topic under Apache Flink User Mailing List archive., >> emai

Re: Dealing with Multiple sinks in Flink

2016-08-25 Thread vinay patil
t a new topic under Apache Flink User Mailing List archive., > email > >> [hidden email] > >> To unsubscribe from Apache Flink User Mailing List archive., click > here. > >> NAML > > > > > > > > > > View th

Re: Dealing with Multiple sinks in Flink

2016-08-25 Thread Maximilian Michels
pache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Dealing-with-Multiple-sinks-in-Flink-tp8643p8664.html >> To start a new topic under Apache Flink User Mailing List archive., email >> [hidden email] >> To unsubscribe from Apache Flink User Mailing List archive., click here.

Re: Dealing with Multiple sinks in Flink

2016-08-24 Thread vinay patil
Hi, Just an update, the window is not getting triggered when I change the parallelism to more than 1. Can you please explain why this is happening ? Regards, Vinay Patil On Wed, Aug 24, 2016 at 9:55 AM, vinay patil [via Apache Flink User Mailing List archive.] wrote: > Hi Max, > > I tried wri

Re: Dealing with Multiple sinks in Flink

2016-08-24 Thread vinay patil
Hi Max, I tried writing to local file as well, its giving me the same issue, I have attached the logs and dummy pipeline code. logs.txt dummy_pipeline.txt

Re: Dealing with Multiple sinks in Flink

2016-08-24 Thread Maximilian Michels
Hi Vinay, Does this only happen with the S3 file system or also with your local file system? Could you share some example code or log output of your running job? Best, Max On Wed, Aug 24, 2016 at 4:20 AM, Vinay Patil wrote: > Hi, > > In our flink pipeline we are currently writing the data to mu