Re: DefaultInputSplitAssigner question

2023-04-20 Thread Zhu Zhu
Sure I will take a look. Thanks, Zhu Péter Váry 于2023年4月20日周四 22:58写道: > > Created a PR for the change: https://github.com/apache/flink/pull/22437 > Could you please review Zhu? > > Thanks, > Peter > > Péter Váry ezt írta (időpont: 2023. ápr. 20., > Cs, 13:54): > > > Thanks Zhu for the quick re

Re: DefaultInputSplitAssigner question

2023-04-20 Thread Péter Váry
Created a PR for the change: https://github.com/apache/flink/pull/22437 Could you please review Zhu? Thanks, Peter Péter Váry ezt írta (időpont: 2023. ápr. 20., Cs, 13:54): > Thanks Zhu for the quick response! > > In the Iceberg Flink Source (old version, there is a FLIP-27 version as > well) t

Re: DefaultInputSplitAssigner question

2023-04-20 Thread Péter Váry
Thanks Zhu for the quick response! In the Iceberg Flink Source (old version, there is a FLIP-27 version as well) the class is used [1], that is how I found it. Created a jira to update the doc [2]. Peter [1] https://github.com/apache/iceberg/blob/fe6f3b2325bce0acba4c75f4a9e9edec6021a3b0/flink/v

Re: DefaultInputSplitAssigner question

2023-04-19 Thread Zhu Zhu
Hi Peter, Maybe you can try Flink new source[1]? It allows you to customize your own `SplitEnumerator` which can control how to assign splits. DefaultInputSplitAssigner is not a public interface. And currently there is no requirement of the order of splits by Flink itself. Therefore, it looks to

DefaultInputSplitAssigner question

2023-04-19 Thread Péter Váry
Hi Team, Recently I ran into the DefaultInputSplitAssigner [1]. The javadoc documentation states: /** * This is the default implementation of the {@link InputSplitAssigner} interface. The default input * split assigner simply returns all input splits of an input vertex *in the order they wer