Re: Unsubscribe

Unsubscribe On Tue, Jul 4, 2023 at 1:33 PM Bauddhik Anand wrote: > Unsubscribe >

Re: Using HybridSource

Was it a conscious decision that HybridSource only accept Sources, and does not allow mapping functions applied to them before combining them? On Tue, Jul 4, 2023, 23:53 Ken Krugler wrote: > Hi Oscar, > > Couldn’t you have both the Kafka and File sources return an Either from CSV File, Protobuf

Re: Difference between different values for starting offset

Hi, Oscar. Yes, your are right. If starting from a checkpoint or savepoint, kafka connector will always use the offset stored in the states. If starting without a checkpoint or savepoint, kafka connector will use the specific startup mode. Best, Hang Oscar Perez via user 于2023年7月4日周二 20:54写道：

Re: Part files generated in reactive mode

Hi, Wang Mengxi, You should use the file compaction feature[1] to compact the small files. Best, Hang [1] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/filesystem/#compaction Wang, Mengxi X via user 于2023年7月4日周二 22:44写道： > Hi, > > > > We want to process

Re: Unsubscribe

Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink

Re: Unsubscribe

Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink

Re: Unsubscribe

Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink

Re: Unsubscribe

Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink

Re: Unsubscribe

Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1] https://flink

Unsubscribe

Unsubscribe 

Unsubscribe

Re: Using HybridSource

Hi Oscar, Couldn’t you have both the Kafka and File sources return an Either, and then (after the HybridSource) use a MapFunction to convert to the unified/correct type? — Ken > On Jul 4, 2023, at 12:13 PM, Oscar Perez via user > wrote: > > Hei, > 1) We populate state based on this CSV data

Re: Using HybridSource

Hei, 1) We populate state based on this CSV data and do business logic based on this state and events coming from other unrelated streams. 2) We are using low level process function in order to process this future hybrid source Regardless of the aforementioned points, please note that the main cha

Re: Using HybridSource

@Oscar 1. How do you plan to use that CSV data? Is it needed for lookup from the "main" stream? 2. Which API are you using? DataStream/SQL/Table or low level ProcessFunction? Best, Alex On Tue, 4 Jul 2023 at 11:14, Oscar Perez via user wrote: > ok, but is it? As I said, both sources have diffe

Part files generated in reactive mode

Hi, We want to process one 2GB file and the output should also be a single 2GB file, but after we enabled reactive mode it generated several hundred small output files instead of one 2GB file. Can anybody help please? Best wishes, Mengxi Wang This message is confidential and subject to terms

Unsubscribe

Re: Difference between different values for starting offset

Hei, Ok, thanks. so if I understand this correctly the difference between OffsetInitializer.earliest and commitedOffset(OffsetResetStrategy.EARLIEST) will be in the case that there is no flink state. In this case, earliest will not check kafka committed offset and start from earliest while in the l

Unsubscribe

Unsubscribe -- Thanks & Regards, Ajinkya Pathrudkar

Re: Changing vertex parallelism

On 03/07/2023 19:13, Nikolaos Paraskakis wrote: Is there any way changing job vertex parallelism during runtime (downtime included)? For example, via REST API? At this time, no. 1.18.0 will ship with FLIP-291

Re: Using HybridSource

ok, but is it? As I said, both sources have different data types. In the example here: https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/hybridsource/ We are using both sources as returning string but in our case, one source would return a protobuf event while the ot

Re: Using HybridSource

Hi Oscar, You could use connected streams and put your file into a special Kafka topic before starting such a job: https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/datastream/operators/overview/#connect But this may require more work and the event ordering (which is shuffled) in

Re: SQL-gateway Failed to Run

Hi Xiaolong, I think you may need to check the error log in the flink cluster to find out the root cause. Best, Shammon FY On Tue, Jul 4, 2023 at 3:38 PM Xiaolong Wang wrote: > The flink web ui is fine until I run the Hive query. After that the flink > deployment is down and the web UI is not

Unsubscribe

Unsubscribe

Unsubscribe

Unsubscribe 获取 Outlook for iOS

Re: Average on sliding window

Hi Eugenio, I think it is due to window completion which will be complete once your watermarked field on the event advances 15 days interval since the first received event time. Please also check this default trigger behavior here: https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/de