Re: Unsubscribe

2020-05-17 Thread Eliza
please send an empty email to user-unsubscr...@flink.apache.org to unsubscribe yourself. Thanks. highfei2011 wrote: Unsubscribe

Unsubscribe

2020-05-17 Thread highfei2011
Unsubscribe

Re: [ANNOUNCE] Apache Flink 1.10.1 released

2020-05-17 Thread Yangze Guo
Thanks Yu for the great job. Congrats everyone who made this release possible. Best, Yangze Guo On Mon, May 18, 2020 at 10:57 AM Leonard Xu wrote: > > > Thanks Yu for being the release manager, and everyone else who made this > possible. > > Best, > Leonard Xu > > 在 2020年5月18日,10:43,Zhu Zhu 写道:

Re: flink setup errors

2020-05-17 Thread Chesnay Schepler
This looks like a connectivity issue to maven central. If you follow the http address you also get a 501 HTTPS required error, so maybe adjust the URL in your settings.xml to use https. On 18/05/2020 07:12, Prasanna kumar wrote: I tried to setup flink locally as mentioned in the link https://

Re: Flink operator throttle

2020-05-17 Thread Chen Qin
Hi Ray, In a bit abstract point of view, you can always throttle source and get proper sink throughput control. One approach might be just override base KafkaFetcher and use shaded guava rate limtier. https://github.com/apache/flink/blob/59714b9d6addb1dbf2171cab937a0e3fec52f2b1/flink-connectors/f

Re: Process available data and stop with savepoint

2020-05-17 Thread Congxian Qiu
Hi Sergii If I understand correctly, you want to process all the files in some directory, and do not want to process them multiple times. I'm not sure if using `FileProcessingMode#PROCESS_CONTINUOUSLY` instead of `FileProcessingMode#PROCESS_ONCE`[1] can satisfy your needs, and keep the job running

flink setup errors

2020-05-17 Thread Prasanna kumar
I tried to setup flink locally as mentioned in the link https://ci.apache.org/projects/flink/flink-docs-stable/dev/projectsetup/java_api_quickstart.html . I ended getting the following error [INFO] Generating project in Interactive mode [WARNING] No archetype found in remote catalog. Defaulting

Re: Help with table-factory for SQL

2020-05-17 Thread Martin Frank Hansen
Hi Jark Wu, Thanks for your answer, Here is what I have so far import java.util.Properties import org.apache.flink.table.descriptors.Json import org.apache.flink.table.descriptors.{Kafka, Schema} import org.apache.flink.streaming.connectors.kafka.{FlinkKafkaConsumer, FlinkKafkaConsumerBase, Flin

Re: [ANNOUNCE] Apache Flink 1.10.1 released

2020-05-17 Thread Leonard Xu
Thanks Yu for being the release manager, and everyone else who made this possible. Best, Leonard Xu > 在 2020年5月18日,10:43,Zhu Zhu 写道: > > Thanks Yu for being the release manager. Thanks everyone who made this > release possible! > > Thanks, > Zhu Zhu > > Benchao Li mailto:libenc...@gmail.co

Re: [ANNOUNCE] Apache Flink 1.10.1 released

2020-05-17 Thread Zhu Zhu
Thanks Yu for being the release manager. Thanks everyone who made this release possible! Thanks, Zhu Zhu Benchao Li 于2020年5月15日周五 下午7:51写道: > Thanks Yu for the great work, and everyone else who made this possible. > > Dian Fu 于2020年5月15日周五 下午6:55写道: > >> Thanks Yu for managing this release and

run flink on edge vs hub

2020-05-17 Thread Eleanore Jin
Hi Community, Currently we are running flink in 'hub' data centers where data is ingested into the platform via kafka, and flink job will read from kafka, do the transformations, and publish to another kafka topic. I would also like to see if the same logic (read input message -> do transformatio

Process available data and stop with savepoint

2020-05-17 Thread Sergii Mikhtoniuk
Hello, I'm migrating my Spark-based stream processing application to Flink (Calcite SQL and temporal tables look too attractive to resist). My Spark app works as follows: - application is started periodically - it reads a directory of Parquet files as a stream - SQL transformations are applied -

Re: the savepoint problem of upgrading job from blink-1.5 to flink-1.10

2020-05-17 Thread Congxian Qiu
This email wants to correct my previous mail, Yun's answer is correct. I mistook "blink-1.5" for "flink-1.5" when replying to the previous email. and the savepoint V3 is not in flink-1.10(will be in 1.11) Best, Congxian Yun Tang 于2020年5月15日周五 下午6:01写道: > Hi Roc > > Blink-1.5 should never mak

Re: Flink operator throttle

2020-05-17 Thread 王雷
I see. I appreciate your help, thank you so much! Benchao Li 于2020年5月17日周日 下午2:48写道: > Hi, > > > If I want to use the rate limiter in other connectors, such as Kafka > sink, ES sink, I need to do some more work on these connectors. > Yes, you can do this by changing Kafka/ES sink, actually, this