Re: no suitable table factory for file sources

2020-02-02 Thread Jingsong Li
Hi Günter, Now File system connector only has OldCsv format [1]. But your yaml has new csv properties like "format.allow-comments". You can check Old csv supported properties. [1] https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connect.html#file-system-connector [2] https://ci.

Re: Read data from Oracle using Flink SQL API

2020-02-02 Thread Jingsong Li
Yes, And I think we should add OracleDialect,SqlServerDialect,DB2Dialect support too. Best, Jingsong Lee On Sun, Feb 2, 2020 at 5:53 PM Flavio Pompermaier wrote: > Ok thanks for this info! Maybe this could be added to the > documentation..what do you think? > > Il Dom 2 Feb 2020, 08:37 Jingsong

no suitable table factory for file sources

2020-02-02 Thread Günter Hipler
Hi, I can't read from a file source using the sql-client tool. I just set up a simple test scenario with the configuration file in [1] I'm getting the error in [2] starting the environment with bin/sql-client.sh embedded -d gh/sql-client-conf.yaml -l lib in the standard Flink 1.9.1 download env

[ANNOUNCE] Weekly Community Update 2020/05

2020-02-02 Thread Konstantin Knauf
Dear community, comparably quiet times on the dev@ mailing list, so I will keep it brief and mostly share release related updates today. Flink Development == * [releases] Apache Flink 1.9.2 was released on Thursday. Check out the release blog post [1] for details. [2] * [releases] G

Re: Reinterpreting a pre-partitioned data stream as keyed stream

2020-02-02 Thread Guowei Ma
Hi, 1. Is the key that is used by the keyBy after point 1 precisely the same as the key used by the 4a and 4b? If yes, I think you could use the reinterpretAsKeyedStream to avoid the shuffle. 2. You could use SingleOutputStreamOperator::setChainingStrategy to disable the chain or use rebalance/shu

time column used by timer

2020-02-02 Thread lec ssmi
In KeyedProcessFunction, we can register a timer based on EventTime, but in the register method, we don't need to specify the time column. So if the elements of this KeyedStream are not the classes that originally specified timestamp and watermark, can this timer run normally?

Re: Read data from Oracle using Flink SQL API

2020-02-02 Thread Flavio Pompermaier
Ok thanks for this info! Maybe this could be added to the documentation..what do you think? Il Dom 2 Feb 2020, 08:37 Jingsong Li ha scritto: > Hi Flavio, > > You can use `JDBCTableSource`, and register it from > TableEnvionment.registerTableSource, you need provide > a OracleDialect, maybe jus