[ https://issues.apache.org/jira/browse/FLINK-37649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weijie Guo updated FLINK-37649: ------------------------------- Description: I use the following DDL to generate collection type data: {code:java} CREATE TABLE Orders ( f0 Array<INT>, f1 Map<INT, STRING>, f2 MULTISET<INT> ) WITH ( 'connector' = 'datagen', 'fields.f0.length' = '10', 'fields.f1.length' = '10', 'fields.f2.length' = '10' ); {code} But got: {code:java} Unsupported options: fields.f0.length fields.f1.length fields.f2.length {code} This should be valid options per our documentation: ``` Size or length of the collection for generating varchar/varbinary/string/bytes/array/map/multiset types. Please notice that for variable-length fields (varchar/varbinary), the default length is defined by the schema and cannot be set to a length greater than it. for super-long fields (string/bytes), the default length is 100 and can be set to a length less than 2^31. for constructed fields (array/map/multiset), the default number of elements is 3 and can be customized. ``` was: I use the following DDL to generate collection type data: {code:java} CREATE TABLE Orders ( f0 Array<INT>, f1 Map<INT, STRING>, f2 MULTISET<INT> ) WITH ( 'connector' = 'datagen', 'fields.f0.length' = '10', 'fields.f1.length' = '10', 'fields.f2.length' = '10' ); {code} But got: {code:java} Unsupported options: fields.f0.length fields.f1.length fields.f2.length {code} > Datagen connector cannot set length for collection type > ------------------------------------------------------- > > Key: FLINK-37649 > URL: https://issues.apache.org/jira/browse/FLINK-37649 > Project: Flink > Issue Type: Bug > Components: Connectors / Common > Affects Versions: 2.0.0 > Reporter: Weijie Guo > Assignee: Weijie Guo > Priority: Major > > I use the following DDL to generate collection type data: > {code:java} > CREATE TABLE Orders ( > f0 Array<INT>, > f1 Map<INT, STRING>, > f2 MULTISET<INT> > ) WITH ( > 'connector' = 'datagen', > 'fields.f0.length' = '10', > 'fields.f1.length' = '10', > 'fields.f2.length' = '10' > ); > {code} > But got: > {code:java} > Unsupported options: > fields.f0.length > fields.f1.length > fields.f2.length > {code} > This should be valid options per our documentation: > ``` > Size or length of the collection for generating > varchar/varbinary/string/bytes/array/map/multiset types. Please notice that > for variable-length fields (varchar/varbinary), the default length is defined > by the schema and cannot be set to a length greater than it. for super-long > fields (string/bytes), the default length is 100 and can be set to a length > less than 2^31. for constructed fields (array/map/multiset), the default > number of elements is 3 and can be customized. > ``` -- This message was sent by Atlassian Jira (v8.20.10#820010)