Hi admin, Thanks for bringing up this discussion. IMHO, it's a valuable feature. We also added this feature for our internal SQL engine. And our way is very similar to your proposal.
Regarding the implementation, there is one shorthand that we should modify each connector to support this property. We can wait for others' opinion whether this is a valid proposal. If yes, then we can discuss the implementation detailedly. admin <17626017...@163.com> 于2020年9月10日周四 上午1:19写道： > Hi devs: > Currently,Flink sql does not support source/sink parallelism config.So,it > will result in wasting or lacking resources in some cases. > I think it is necessary to introduce configuration of source/sink > parallelism in sql. > From my side,i have the solution for this feature.Add parallelism config > in ‘with’ properties of DDL. > > Before 1.11,we can get parallelism and then set it to > StreamTableSink#consumeDataStream or StreamTableSource#getDataStream > After 1.11,we can get parallelism from catalogTable and then set it to > transformation in CommonPhysicalTableSourceScan or CommonPhysicalSink. > > What do you think? > > > > > -- Best, Benchao Li
