Re: Programmatic configuration

2017-10-06 Thread Tzu-Li (Gordon) Tai
Hi Dustin, Are you using S3 for a Flink source / sink / streaming state backend? Or is it simply used in one of your operators? I’m assuming the latter since you mentioned “doing a search on an S3 system”. For this, I think it would make sense to simply pass the job-specific S3 endpoint / cred

Programmatic configuration

2017-09-27 Thread Dustin Jenkins
Hello, I’m running a single Flink Job Manager with a Task Manager in Docker containers with Java 8. They are remotely located (flink.example.com ). I’m submitting a job from my desktop and passing the job to the Job Manager with -m flink.example.com:6123

Programmatic configuration with remote JobManager

2017-09-26 Thread Dustin Jenkins
Hello, I’m running a single Flink Job Manager with a Task Manager in Docker containers with Java 8. They are remotely located (flink.example.com ). I’m submitting a job from my desktop and passing the job to the Job Manager with -m flink.example.com:6123