Re: Possibility of supporting Reactive mode for native Kubernetes application mode

2021-10-29 Thread David Morávek
Hi Fuyao, this is a great question ;) 1) First let's be clear on what the reactive mode actually is. Reactive Mode is related to how the Flink makes use of the newly available resources. It greedily uses all of the resources that are available in your Flink cluster (if new task manager joins in,

退订

2021-10-29 Thread Jensen
退订

How to solve the target:jvm-1.8 error when run start-scala-shell.sh

2021-10-29 Thread Jing Lu
Hi Flink users, I am working on testing my code in start-scala-shell.sh. The flink version is: flink-1.12.0-bin-scala_2.11.tgz. I put the jar file ( https://mvnrepository.com/artifact/software.amazon.awssdk/sts/2.15.65) in the lib folder. Then run the start-scala-shell.sh REPL: scala> import sof

SQL not evaluating correctly

2021-10-29 Thread PACE, JAMES
We are in the process of upgrading from Flink 1.9.3 to 1.13.3. We have noticed that statements with either where UPPER(field) or LOWER(field) in combination with an IN do not always evaluate correctly. The following test case highlights this problem. import org.apache.flink.streaming.api.data

Flink filesystem S3, not finding the plugin

2021-10-29 Thread Gil De Grove
Hello, We are currently developing a RichParallelSourceFunction<> that reads from different FileSystem dynamically based on the configuration provided when starting the job. When running the tests, adding the hadoop-s3-presto library in the classpath, we can run the workload without any issues. H

Re: Question about flink sql

2021-10-29 Thread Jake
Hi You can use like this: ```java val calciteParser = new CalciteParser(SqlUtil.getSqlParserConfig(tableEnv.getConfig)) sqlArr .foreach(item => { println(item) val itemNode = calciteParser.parse(item) itemNode match { case sqlSet: SqlSet => {

Question about flink sql

2021-10-29 Thread wx liao
Hi: I use flink sql,and run a script that has one souce an two sink,I can see 2 jobs runing through webUI,is that normal? Can some way to ensure only run on job that has one source and two sink? Thank you

Re: S3 Source support in Flink

2021-10-29 Thread Martijn Visser
Hi, One more additional link, the overall Sources documentation page also contains useful information. [1] Best regards, Martijn [1] https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/datastream/sources/ On Fri, 29 Oct 2021 at 09:21, Martijn Visser wrote: > Hi, > > When usin

Re: S3 Source support in Flink

2021-10-29 Thread Martijn Visser
Hi, When using the DataStream API, the new File Source already supports continuous stream, but it isn't documented yet [1] There is an e2e test for it, so you could look at that to understand how it works. It's not yet supported for the Table API/SQL [2] Best regards, Martijn [1] https://issues

退订

2021-10-29 Thread sh_0...@126.com
sh_0...@126.com