flink-ml algorithms

Hi, I am running OnlineKmeans from flink-ml repo on a small dataset. I've noticed that I don't get consistent results, assignments to clusters, across different runs. I have set both parallelism and globalBatchSize to 1. I am doing simple fit and transform on each data point ingested. Is the order

Unable to connect to Flink

Greetings all, I’m a member of IBM’s IT support and we have found that IBM cannot access Flink’s URL on the domain: nightlies.apache.org After investigation, we believe that we may have been mistakenly placed on a deny list, and we need to reques that IBM’s addresses be placed on an allow list

Re: [ANNOUNCE] Welcome to join the Apache Flink community on Slack

Thanks everyone for your effort! Best regards, Jing On Thu, Jun 2, 2022 at 4:17 PM Martijn Visser wrote: > Thanks everyone for joining! It's good to see so many have joined in such > a short time already. I've just refreshed the link which you can always > find on the project website [1] > > Be

Re: Flink task stuck - MapPartition WAITING on java.util.concurrent.CompletableFuture$Signaller

-user@flink as this looks like purely beam issue Could you please elaborate more about what "stuck" means? Does the watermark stop progressing? Does that happen at any specific instant (e.g. end of window or end of window + allowed lateness)? On 6/1/22 15:43, Gorjan Todorovski wrote: Hi Jan

Re: [ANNOUNCE] Welcome to join the Apache Flink community on Slack

Thanks everyone for joining! It's good to see so many have joined in such a short time already. I've just refreshed the link which you can always find on the project website [1] Best regards, Martijn [1] https://flink.apache.org/community.html#slack Op do 2 jun. 2022 om 11:42 schreef Jingsong Li

Issue Facing While Using EmbeddedRocksDbCheckpointing FlinkVersion(1.15.0)

Dear Team, I am new to pyflink and request for your support in issue I am facing with Pyflink. I am using Pyflink version 1.15.0 & using reference code from pyflink reference code. The errors I am getting Traceback (most recent call last): File "E:\pythonProject16\lib\site-packages\apache_

Re: Cannot cast GoogleHadoopFileSystem to hadoop.fs.FileSystem to list file in Flink 1.15

I believe the change between Flink 1.14 and Flink 1.15 has been the addition of a RecoverableWriter for GCS [1] Perhaps this is the reason for this failure? Best regards, Martijn [1] https://issues.apache.org/jira/browse/FLINK-11838 Op do 2 jun. 2022 om 12:24 schreef Qingsheng Ren : > Thanks f

Re:Not able to see std output in console/.out files with table API

Could you find that the input amount of the node `sink` is being accumulated in Flink UI? Is it possible that there are no data actually after join. If you have checked the above and everything seems ok, you can try again with a connector named `print` as the sink table and check whether the o

Re: Cannot cast GoogleHadoopFileSystem to hadoop.fs.FileSystem to list file in Flink 1.15

Thanks for the input ChangZhuo. Could you check if the configuration "classloader.resolve-order” is set to “parent-first” in your Flink 1.14 cluster? I didn’t notice any changes related to the user code classloader in Flink 1.15. If my assumption is correct, you package the gcs-connector into your

Not able to see std output in console/.out files with table API

Hi, We are using table apis to integrate and transform data sources and converting them to datastream. We want to see the data formatting and adding a .print() sink to the datastream but the .out files do not show any output. We do see records coming in from the metrics in flink UI though. Suggesti

Slow tests on Flink 1.15

Hi. Just tried to upgrade from 1.14.2 to 1.15.0. It went well and our jobs runs as expected. We have a number of test, testing the entire job so we mock input and output and start our job with mocked data. After upgrading a simple test now takes minutes where it before was less than a minute

Re: [ANNOUNCE] Welcome to join the Apache Flink community on Slack

Thanks Xingtong, Jark, Martijn and Robert for making this possible! Best, Jingsong On Thu, Jun 2, 2022 at 5:32 PM Jark Wu wrote: > Thank Xingtong for making this possible! > > Cheers, > Jark Wu > > On Thu, 2 Jun 2022 at 15:31, Xintong Song wrote: > > > Hi everyone, > > > > I'm very happy to a

Re: [ANNOUNCE] Welcome to join the Apache Flink community on Slack

Thank Xingtong for making this possible! Cheers, Jark Wu On Thu, 2 Jun 2022 at 15:31, Xintong Song wrote: > Hi everyone, > > I'm very happy to announce that the Apache Flink community has created a > dedicated Slack workspace [1]. Welcome to join us on Slack. > > ## Join the Slack workspace > >

Re: Is there an HA solution to run flink job with multiple source

Hi, our use is that the data sources are independent, we are using flink to ingest data from kafka sources, do a bit of filtering and then write it to S3. Since we ingest from multiple kafka sources, and they are independent, we consider them all optional. Even if 1 just kafka is up and running, we

[ANNOUNCE] Welcome to join the Apache Flink community on Slack

Hi everyone, I'm very happy to announce that the Apache Flink community has created a dedicated Slack workspace [1]. Welcome to join us on Slack. ## Join the Slack workspace You can join the Slack workspace by either of the following two ways: 1. Click the invitation link posted on the project w

Allow KafkaBuilder to set arbitrary subscribers

FYI, I have already created the following issue: - https://issues.apache.org/jira/browse/FLINK-27872 >From the issue description directly: Currently, KafkaBuilder