Re: TaskManager information during runtime

2016-06-22 Thread omaralvarez
Thanks, this is exactly what I was looking for. Cheers, Omar. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/TaskManager-information-during-runtime-tp7655p7665.html Sent from the Apache Flink User Mailing List archive. mailing list archive

TaskManager information during runtime

2016-06-21 Thread omaralvarez
Hi, I have a program that creates one StreamingSource for each port in which I want to receive data. I'm trying to know the hostname of all the created sources, so I can send data to them from external processes. Is there any other way during runtime other than using the REST API for obtaining

Re: Data ingestion using a Flink TCP Server

2016-05-25 Thread omaralvarez
Thanks to everybody, all my doubts are solved. I gotta give it to you guys, the answers were really fast! Cheers, Omar. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-ingestion-using-a-Flink-TCP-Server-tp7134p7169.html Sent from the A

Re: Data ingestion using a Flink TCP Server

2016-05-25 Thread omaralvarez
Thanks for your answers, this makes the implementation way easier, I don't have to worry about queues. I will take a look at the kafka connector. So my only remaining question is how serial stream sources are handled. If I have four independent streams, will the sources be handled by different

Re: Data ingestion using a Flink TCP Server

2016-05-25 Thread omaralvarez
Hi, Thank you very much for your answer. There is one more doubt in my mind. How are not parallelized source funtions processed? For instance, lets say I have four streams that implement SourceFunction, will they be placed on different parallel instances or will they be processed sequentially by t

Data ingestion using a Flink TCP Server

2016-05-24 Thread omaralvarez
I have been trying to send data from several processes to my Flink application. I want to use a single port that will receive data from multiple clients. I have implemented my own SourceFunction, but I have two doubts. My TCP server has multiple threads receiving data from multiple clients, is ca