Re: program args size for running jobs

2018-05-23 Thread Fabian Hueske
Hi Esteban, If you need the parameters to configure specific operators (instead of the over all flow), you could pass the parameters as a file using the distributed cache [1]. Note, the docs point to the DataSet (batch) API, but the feature works the same way for DataStream programs as well. Best

program args size for running jobs

2018-05-22 Thread Esteban Serrano
Hi Flink users Looking for some ideas on alternatives/workaround for running a job which requires a large number of parameters (one of them being a long JSON string). When all params are taken together, the resulting REST API URL puts the size of the URL over the current 4096 bytes limit. Ideally,