flink版本:1.11

1.首先第一个问题是在1.11的官方文档connectors的jdbc页面上有这样一句话
Notice that scan.partition.lower-bound and scan.partition.upper-bound are just 
used to decide the partition stride, not for filtering the rows in table.
这与我观看的源码的结果是不一致的,scan.partition.lower-bound and scan.partition.upper-bound 
这两个参数会导致数据被过滤掉,今天我看了一下1.13的文档,这句话更改成了Notice that scan.partition.lower-bound and 
scan.partition.upper-bound are used to decide the partition stride and filter 
the rows in table. 这个是不是说明之前1.11文档的这句话是错的?


2。我在看inputFormat接口时,注释有这么一句话
IMPORTANT NOTE: Input formats must be written such that an instance can be 
opened again after it was closed. That
* is due to the fact that the input format is used for potentially multiple 
splits. After a split is done, the
* format's close function is invoked and, if another split is available, the 
open function is invoked afterwards for
* the next split.
这里有一个问题是,我设置
scan.partition.num: The number of partitions.
这个参数 
10。然后我的并行度设置为2,也就是每个slot里面会有一个Inputformat用于读取数据,当一个partition读完之后,会调用close方法,然后又会再次调用open方法,然后读取下一个分区。不知道这样理解是否正确?

然后假设我的分区是10,并行度是3,这个分区是怎么分配到slot的inputformat的呢?

回复