Re: [EXTERNAL] Re: Flink REST API

2018-02-11 Thread Gary Yao
Hi Raja, How does the HTTP request fail? Can you post the output of: curl -v http://host:port/jobs There are a couple of other ways to find out the port number. For example, when the YARN session is initially deployed, the url of the web ui is logged to stdout: https://github.com/apache/f

Re: Share Spring Application context among operators

2018-02-11 Thread Swapnil Dharane
Hello Gordon, Thanks for the reply. I do have an alternative to share BasicDataSource(from apache commons dbcp library) Object. I thought that it might be best if we leave db connection pooling outside of the actual business flow so I confiured it as a spring bean. With this way , only one class

Re: Share Spring Application context among operators

2018-02-11 Thread Gordon Weakliem
The WHOLE Spring ApplicationContext? This sounds like a bad idea. Most of that stuff isn't applicable outside a Spring application. Can't you cut it down to a smaller subset that your Flink app actually needs? On Fri, Feb 9, 2018 at 9:15 PM, Swapnil Dharane wrote: > Hello, > > Is there any way w

Deep Copy in FLINK, Kryo Copy is used in the different operator

2018-02-11 Thread chen
Actually our team have our own Stream Engine, we tested our engine and flink, find out when we aggregate the stream data, the throughput is decreasing very fast. So we catch the stack and find out a deep copy in flink. In different operator, there will be org.apache.flink.api.java.typeutils.runti