BucketAssigner - Confusion

I have had an issue understanding the documentation, in regard to BucketAssigner.BucketID getBucketId(IN element, BucketAssigner.Context  context)SimpleVersionedSerializer getSerializer()First of all, I don't understand what type of "BucketID" means. I assume that's the retur

Re: Does flink configuration support configed by environment variables?

Thanks, maybe overwrite configuration in 'conf/flink-conf.yaml' by docker-entrypoint.sh is a common way to do it, thanks for your advice. Stephen Connolly 于2019年4月1日周一 下午10:33写道： > I don't think it does. I ended up writing a small CLI tool to enabling > templating the file from environment vari

Re: kafka corrupt record exception

Hi, Thanks for reply. But is there a way one could skip this corrupt record from Flink consumer? Flink job goes in a loop, it restarts and then fails again at same record. On Mon, 1 Apr 2019, 07:34 Congxian Qiu, wrote: > Hi > As you said, consume from ubuntu terminal has the same error, maybe y

Re: Do we have an example of setting up Queryable state ( proxies, client etc ) on k8s ?

Konstantin, I revert my reservations. My initial reservation was having 2 services ( one for TMs and one for the native Queryable Client proxy ). Having established this setup though it makes sense. Having the native Queryable Client proxy as a side car kind of deeply

Re: Does flink configuration support configed by environment variables?

I don't think it does. I ended up writing a small CLI tool to enabling templating the file from environment variables. There are loads of such tools, but mine is https://github.com/stephenc/envsub I have the dockerfile like so: ARG FLINK_VERSION=1.7.2-alpine FROM flink:${FLINK_VERSION} ARG ENVSUB

Re: Flink: How to use zookeeper when deployed in k8s?

You can set jobmanager.rpc.address: jmServiceName high-availability.jobmanager.port: 6123 in flink-conf.yaml and expose the port in the JobManager service. – Ufuk On Mon, Apr 1, 2019 at 9:29 AM sora wrote: > > Hello, > I encountered a problem when deploying flink to k8s. > When high-availabili

How can I get the right TaskExecutor in ProcessFunction

Hi all  I want to get the right TaskExecutor where the  ProcessFunction run at. Is there any way to get it from getRuntimeContext() . Or any other solution?? Best wishes,  

subscribe

subscribe

Flink: How to use zookeeper when deployed in k8s?

Hello, I encountered a problem when deploying flink to k8s. When high-availability: zookeeper in flink-conf.yaml is set, a random port will be used instead of the config port. But this port is not exposed in k8s, and all taskmanager can not connect to jobmanager. How can I solve this? One solut

Re: Reading csv file

Thank you . I have chosen the second option and i think it run correctly now . -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/