Hey, I would like to double check this with Jark and/or Timo. As far as DataStream is concerned the javadoc is correct. Moreover the pipeline.auto-watermak-interval and setAutoWatermarkInterval are effectively the same setting/option. However I am not sure if Table API interprets it in the same way as DataStream APi. The documentation you linked, Aeden, describes the SQL API.
@Jark @Timo Could you verify if the SQL documentation is correct? Best, Dawid On 23/03/2021 15:20, Matthias Pohl wrote: > Hi Aeden, > sorry for the late reply. I looked through the code and verified that > the JavaDoc is correct. Setting pipeline.auto-watermark-interval to 0 > will disable the automatic watermark generation. I created FLINK-21931 > [1] to cover this. > > Thanks, > Matthias > > [1] https://issues.apache.org/jira/browse/FLINK-21931 > <https://issues.apache.org/jira/browse/FLINK-21931> > > On Thu, Mar 4, 2021 at 9:53 PM Aeden Jameson <aeden.jame...@gmail.com > <mailto:aeden.jame...@gmail.com>> wrote: > > Correction: The first link was supposed to be, > > 1. pipeline.auto-watermark-interval > > https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/config.html#pipeline-auto-watermark-interval > > <https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/config.html#pipeline-auto-watermark-interval> > > On Wed, Mar 3, 2021 at 7:46 PM Aeden Jameson > <aeden.jame...@gmail.com <mailto:aeden.jame...@gmail.com>> wrote: > > > > I'm hoping to have my confusion clarified regarding the settings, > > > > 1. pipeline.auto-watermark-interval > > > > https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/api/common/ExecutionConfig.html#setAutoWatermarkInterval-long- > > <https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/api/common/ExecutionConfig.html#setAutoWatermarkInterval-long-> > > > > 2. setAutoWatermarkInterval > > > > https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/api/common/ExecutionConfig.html#setAutoWatermarkInterval-long- > > <https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/api/common/ExecutionConfig.html#setAutoWatermarkInterval-long-> > > > > I noticed the default value of pipeline.auto-watermark-interval is 0 > > and according to these docs, > > > > https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/sql/create.html#watermark > > <https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/sql/create.html#watermark>, > > it states, "If watermark interval is 0ms, the generated watermarks > > will be emitted per-record if it is not null and greater than > the last > > emitted one." However in the documentation for > > setAutoWatermarkInterval the value 0 disables watermark emission. > > > > * Are they intended to be the same setting? If not how are they > > different? Is one for FlinkSql and the other DataStream API? > > > > -- > > Thank you, > > Aeden >
OpenPGP_signature
Description: OpenPGP digital signature
