Re: Enable custom REST APIs in Flink

I had some back and forth last year about this, I'll forward the discussion email chain to you privately (it was in this mailing list). Basically, the idea was to make *DispatcherRestEndpoint* and/or *WebMonitorExtension* more accessible so we can extend them. It didn't look too much work on Flink

Re: Enable custom REST APIs in Flink

I know some users do the same thing in spark. Usually the service run spark driver side. But flink is different from spark. Spark driver is equal to flink client + flink job manager. I don't think currently we allow to run any user code in job manager. So allow running user defined service in job m

Re: Enable custom REST APIs in Flink

definitely, this is for me about making Flink an "application framework" rather than solely a "dataflow framework". -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com On Tue, Apr 21, 2020 at 11:07 AM Flavio Pompermaier

Re: Enable custom REST APIs in Flink

In my mind the user API could run everywhere but the simplest thing is to make them available in the Job Manager (where the other REST API lives). They could become a very simple but powerful way to add valuable services to Flink without adding useless complexity to the overall architecture for jus

Re: Enable custom REST APIs in Flink

Hi Flavio, I am curious know where service run, Do you create this service in UDF and run it in TM ? Flavio Pompermaier 于2020年4月21日周二 下午8:30写道： > Hi to all, > many times it happens that we use Flink as a broker towards the data layer > but we need to be able to get some specific info from the

Re: Enable custom REST APIs in Flink

I would LOVE this. We had to hack our way a lot to achieve something similar. @Flavio, we basically added a new entrypoint to the same codebase and ran that separately in its own container. -- [image: MotaWord] Oytun Tez M O T A W O R D | CTO & Co-Founder oy...@motaword.com

Enable custom REST APIs in Flink

Hi to all, many times it happens that we use Flink as a broker towards the data layer but we need to be able to get some specific info from the data sources we use (i.e. get triggers and relationships from jdbc). The quick and dirty way of achieving this is to run a Flink job that calls another ser