Re: [EXTERNAL] TaskManagers Crushing

Were you ever able to find a workaround for this? I also have transient failures due to org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException. From: Kenan Kılıçtepe Sent: Saturday, August 19, 2023 5:50 PM To: user@flink.apache.org Subject:

RE: MSI Auth to Azure Storage Account with Flink Apache Operator not working

I will provide more details as to how I was able to use AKV with CSI. Also, I looked in the Flink source at the ADLS FileSystem factory and I think despite what it says in the docs configuration options prefixed with flink.hadoop won’t get forwarded. You can expose the key vault as Kubernetes s

RE: MSI Auth to Azure Storage Account with Flink Apache Operator not working

When you create your cluster you probably need to ensure the following settings are set. I briefly looked into MSI but ended up using Azure Key Vault with CSI-storage driver for initial prototype (https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/aks/csi-secrets-store-driver.md#upgr

Failed docker-entrypoint.sh in Flink-Operator Logs

I’ve noticed that all jobs I start with `flink-operator` have the following message at the top of their logs for both jobmanager and taskmanager pods: ``` sed: couldn't open temporary file /opt/flink/conf/sedRTwsr1: Read-only file system sed: couldn't open temporary file /opt/flink/conf/sedcDS3

RE: [EXTERNAL] Re: Unable to Use spec.flinkVersion v1_17 with Flink Operator

starting. I will follow-up if I find any new problems. Thanks for the help! Best, Ivan From: Gyula Fóra<mailto:gyula.f...@gmail.com> Sent: Tuesday, March 28, 2023 10:25 PM To: Ivan Webber<mailto:ivan.web...@microsoft.com> Cc: Ivan Webber via user<mailto:user@flink.apache.org>

Unable to Use spec.flinkVersion v1_17 with Flink Operator

Hello Flink Users: I'm trying to upgrade to use Flink 1.17.0 with my pipeline in order to have support for writing to Azure Data Lake Storage. However when I change the `spec.flinkVersion` to v1_17 I get an error message: ```bash The FlinkDeployment "test-replay-streaming-run" is invalid: spec.

RE: [EXTERNAL] Re: Secure Azure Credential Configuration

mail from sarda.espin...@gmail.com<mailto:sarda.espin...@gmail.com>. Learn why this is important<https://aka.ms/LearnAboutSenderIdentification> Hi Ivan, Mercy is always free. Are you using WASB or ABFS? I presume it's the latter, since that's the one that can't us

Re: [EXTERNAL] Re: Secure Azure Credential Configuration

ee. Are you using WASB or ABFS? I presume it's the latter, since that's the one that can't use EnvironmentVariableKeyProvider, but just to be sure. Regards, Alexis. On Thu, 2 Mar 2023, 23:07 Ivan Webber via user, mailto:user@flink.apache.org>> wrote: TLDR: I will buy your coffee if you can h

Secure Azure Credential Configuration

TLDR: I will buy your coffee if you can help me understand to securely configure Azure credentials (doc page for reference). I am a junior developer tasked with being the first person to learn the Apache F