Flink with YARN: Error while calling YARN Node Manager to stop container

2018-11-25 Thread Marke Builder
Hi, I get the follow WARN and Exception in the Job Manager Logs (the job continues). Why do I get this exception and what do I have to consider? I have a flink streaming job which write the data via OutputFormat to Hbase. 2018-11-25 12:08:34,721 WARN org.apache.hadoop.util.NativeCodeLoader

Flink with Yarn and AbstractDeserializationSchema: ClassCastException

2018-11-17 Thread Marke Builder
Hi, I'm using the AbstractDeserializationSchema for my RabbitMQ source[1] and try to deserialize the xml message with JAXB. The flink job are running with YARN. After the job was started I get follow exception: javax.xml.bind.JAXBException: ClassCastException: attempting to cast jar:file:/usr/jav

Re: Netty issues while deploying Flink with Yarn on MapR

2017-03-23 Thread Robert Metzger
lve this problem so that future MapR and Flink >> users do not face these issues. Should I create a JIRA for it? Let me know >> how I can be of help. >> >> >> >> -- >> View this message in context: http://apache-flink-user-maili >> ng-list-archive.2336

Re: Netty issues while deploying Flink with Yarn on MapR

2017-02-07 Thread Robert Metzger
problem so that future MapR and Flink > users do not face these issues. Should I create a JIRA for it? Let me know > how I can be of help. > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Netty-issues- > w

Re: Netty issues while deploying Flink with Yarn on MapR

2017-02-07 Thread ani.desh1512
-issues-while-deploying-Flink-with-Yarn-on-MapR-tp11411p11497.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Netty issues while deploying Flink with Yarn on MapR

2017-02-07 Thread Robert Metzger
gt; > -- > > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Netty-issues- > while-deploying-Flink-with-Yarn-on-MapR-tp11411p11486.html > > Sent from the Apache Flink User Mailing List archive. mailing list > archive at Nabble.com. > > > >

Re: Netty issues while deploying Flink with Yarn on MapR

2017-02-07 Thread Ufuk Celebi
ue with help from the MapR community. > > > > -- > View this message in context: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Netty-issues-while-deploying-Flink-with-Yarn-on-MapR-tp11411p11486.html > > Sent from the Apache Flink User Mailing L

Re: Netty issues while deploying Flink with Yarn on MapR

2017-02-07 Thread ani.desh1512
In case anyone is having similar issues with Flink on Yarn on MapR, I managed to solve <https://community.mapr.com/message/55664-re-netty-issues-while-deploying-flink-with-yarn-on-mapr> this issue with help from the MapR community. -- View this message in context: http://apache-flin

Netty issues while deploying Flink with Yarn on MapR

2017-02-02 Thread ani.desh1512
I am trying to run Flink using Yarn on MapR. My previous issue <http://http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Flink-with-Yarn-on-MapR-tt15448.html> got resolved and I have updated the original post accordingly so. Accordingly, I modified pom.xml to chan

Re: Flink with Yarn on MapR

2017-01-25 Thread Robert Metzger
Hi, I think this is a re-post of a question I've already "answered": http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Flink-with-Yarn-on-MapR-td15448.html On Wed, Jan 25, 2017 at 12:12 AM, ani.desh1512 wrote: > Hi, > I am trying to setup flink with Yarn on

Flink with Yarn on MapR

2017-01-24 Thread ani.desh1512
Hi, I am trying to setup flink with Yarn on Mapr cluster. I built flink (flink-1.3-SNAPSHOT) as follows: mvn clean install -DskipTests -Pvendor-repos -Dhadoop.version=2.7.0-mapr-1607 The build is successful. Then I try to run ./bin/yarn-session.sh -n 4 (without changing any config or

Re: Flink with Yarn

2016-01-11 Thread Sourav Mazumder
ransmitted through the JobManager. Only then does the driver program > need to stay connected. Note that this connection still does not need to > have any connections with the workers (Flink TaskManagers), only the > JobManager. > > Cheers, > Gordon > > > > -- > View t

Re: Flink with Yarn

2016-01-11 Thread Tzu-Li (Gordon) Tai
Note that this connection still does not need to have any connections with the workers (Flink TaskManagers), only the JobManager. Cheers, Gordon -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-with-Yarn-tp4224p4227.html Sent from th

Re: Flink with Yarn

2016-01-11 Thread Sourav Mazumder
e > able to connect to the workers. The only requirement for firewalled > clusters is to have two ports from the master node reachable by the client. > > Greetings, > Stephan > > > On Mon, Jan 11, 2016 at 5:18 PM, Sourav Mazumder < > sourav.mazumde...@gmail.com> wr

Re: Flink with Yarn

2016-01-11 Thread Stephan Ewen
g through the documentation of integrating Flink with YARN. > > However not sure whether Flink can be run on YARN in two modes (like > Spark). In one mode the driver/client program of Flink is also managed by > YARN. In the second mode where the client program is outside the control of &

Flink with Yarn

2016-01-11 Thread Sourav Mazumder
I am going through the documentation of integrating Flink with YARN. However not sure whether Flink can be run on YARN in two modes (like Spark). In one mode the driver/client program of Flink is also managed by YARN. In the second mode where the client program is outside the control of YARN. Is