Flink write ADLS show error: No FileSystem for scheme "file"

2024-06-25 Thread Xiao Xu
Hi, all I try to use Flink to write Azure Blob Storage which called ADLS, I put the flink-azure-fs-hadoop jar in plugins directory and when I start my write job it shows: Caused by: org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "file" at org.apache.hadoop.f

Re: [External] Re:Re: Backpressure issue with Flink Sql Job

2024-06-25 Thread Ashish Khatkar via user
Hi Xuyang, The input records are balanced across subtasks, with debloating buffers enabled, the records this subtask receives is less as compared to other subtasks. If the differences among all subtasks are not significant, we might be > encountering an IO bottleneck. In this case, we could try i

?????? flink kubernetes flink autoscale behavior

2024-06-25 Thread Enric Ott
Thanks,Rion.I roughly understand.And I still want to know whether the deployment of Adaptive Scheduler relies on Kubernetes?  Are there any cases of deploying Flink Adaptive Scheduler on bare metal machine? Appreciated again. --  -- ??: