Flink best configurations for Production

2019-07-06 Thread Cam Mach
ources is not a constraints (since we're running Flink on AWS's Kubernetes) Appreciate if you can help or give us some pointers. Thanks, Cam Mach

Best configurations for bounded and unbounded streams pipelines

2019-07-09 Thread Cam Mach
Hello Flink experts, I believe the question below has been already asked, but since I couldn't find my answer from internet, I'd love to reach out the community for help. We basically want to find out the best configurations for Flink that running on Kubernetes to achieve the best performance

Fwd: How watermark work

2020-01-09 Thread Cam Mach
Hello Flink dev and user, We have a pipeline that read both bounded and unbounded sources and our understanding is that when the bounded sources complete they should get a watermark of +inf and then we should be able to take a savepoint and safely restart the pipeline. However, we have source that

Understanding watermark

2020-01-13 Thread Cam Mach
never get watermarks and we are confused as to what we are seeing and what we should expect Cam Mach Software Engineer E-mail: cammac...@gmail.com Tel: 206 972 2768

Re: Understanding watermark

2020-01-14 Thread Cam Mach
USLY. But these things are hard to > tell without a better understanding of your job. > > Cheers, > Till > > On Mon, Jan 13, 2020 at 8:35 PM Cam Mach wrote: > >> Hello Flink expert, >> >> We have a pipeline that read both bounded and unbounded sources and

Re: Understanding watermark

2020-01-14 Thread Cam Mach
source only > outputs the watermark so the web shows you that there is "No Watermark". > Actually Flink has "output" watermark metrics. I think Flink should also > show this information on the web. Would you mind open a Jira to track this? > > > Best, >