Re: Flink 1.11 test Parquet sink

2020-07-15 Thread Flavio Pompermaier
I've just opened a ticket on JIRA: https://issues.apache.org/jira/browse/FLINK-18608 On Wed, Jul 15, 2020 at 10:10 AM Dawid Wysakowicz wrote: > Hi, > > Unfortunately this is a bug. > > The problem is in CustomizedConvertRule#convertCast as it drops the > requested nullability. It was fixed in ma

Re: Flink 1.11 test Parquet sink

2020-07-15 Thread Dawid Wysakowicz
Hi, Unfortunately this is a bug. The problem is in CustomizedConvertRule#convertCast as it drops the requested nullability. It was fixed in master as part of FLINK-13784[1]. Therefore the example works on master. Could you create a jira issue for 1.11 version? We could backport the corresponding

Re: Flink 1.11 test Parquet sink

2020-07-15 Thread Flavio Pompermaier
If I use tableEnv.fromValues(Row.of(1L, "Hello"),...) things works if I change also the query to "INSERT INTO `out` SELECT CAST(f0 AS STRING) ,f1 FROM ParquetDataset". If there is still a bug fill a proper JIRA ticket with the exact description of the problem.. Just to conclude this thread there a

Re: Flink 1.11 test Parquet sink

2020-07-14 Thread Jark Wu
I think this might be a bug in `tableEnv.fromValues`. Could you try to remove the DataType parameter, and let the framework derive the types? final Table inputTable = tableEnv.fromValues( Row.of(1L, "Hello"), // Row.of(2L, "Hello"), // Row.of(3L, ""), // Row.of(4L,

Re: Flink 1.11 test Parquet sink

2020-07-14 Thread Leonard Xu
Hi, Flavio I reproduced your issue, and I think it should be a bug. But I’m not sure it comes from Calcite or Flink shaded Calcite, Flink Table Planner module shaded calcite. Maybe Danny can help explain more. CC: Danny Best Leonard Xu > 在 2020年7月14日,23:06,Flavio Pompermaier 写道: > > If I

Re: Flink 1.11 test Parquet sink

2020-07-14 Thread Flavio Pompermaier
If I use final Table inputTable = tableEnv.fromValues( DataTypes.ROW( DataTypes.FIELD("col1", DataTypes.STRING().notNull()), DataTypes.FIELD("col2", DataTypes.STRING().notNull()) ), .. tableEnv.executeSql(// "CREATE TABLE `out` (" + "co

Re: Flink 1.11 test Parquet sink

2020-07-14 Thread Flavio Pompermaier
Sorry, obviously " 'format' = 'parquet'" + is without comment :D On Tue, Jul 14, 2020 at 4:48 PM Flavio Pompermaier wrote: > Hi to all, > I'm trying to test write to parquet using the following code but I have an > error: > > final TableEnvironment tableEnv = > DatalinksExecutionEnvironment.ge

Flink 1.11 test Parquet sink

2020-07-14 Thread Flavio Pompermaier
Hi to all, I'm trying to test write to parquet using the following code but I have an error: final TableEnvironment tableEnv = DatalinksExecutionEnvironment.getBatchTableEnv(); final Table inputTable = tableEnv.fromValues(// DataTypes.ROW(// DataTypes.FIELD("col1", DataTyp