Hi Arvid,

Yes, I did the same way. But it’s not working.

Can you suggest anything, which I can try?

Mit freundlichen Grüßen / Best regards

Simarpreet Singh

AA ESIRTS, Leo, OES ESI-Updates (RBEI/EAA2)
Robert Bosch GmbH | Postfach 10 60 50 | 70049 Stuttgart | GERMANY | 
www.bosch.com
simarpreet.si...@bosch.com<mailto:simarpreet.si...@bosch.com>

Registered Office: Stuttgart, Registration Court: Amtsgericht Stuttgart, HRB 
14000;
Chairman of the Supervisory Board: Franz Fehrenbach; Managing Directors: Dr. 
Volkmar Denner,
Prof. Dr. Stefan Asenkerschbaumer, Filiz Albrecht, Dr. Christian Fischer, Dr. 
Stefan Hartung,
Dr. Markus Heyn, Harald Kröger, Rolf Najork
​
From: Arvid Heise <ar...@apache.org>
Sent: Wednesday, July 7, 2021 1:44 PM
To: Singh Simarpreet (SX/EAA2) <simarpreet.si...@bosch.com>
Cc: user@flink.apache.org
Subject: Re: Flink Issues facing while connecting to Azure Blob Storage

Hi Simar,

just to be sure, did you create a subfolder in the plugins folder where you put 
the jar as described here [1]?

[1] 
https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/filesystems/plugins/<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fci.apache.org%2Fprojects%2Fflink%2Fflink-docs-release-1.13%2Fdocs%2Fdeployment%2Ffilesystems%2Fplugins%2F&data=04%7C01%7CSimarpreet.Singh%40bosch.com%7C2fcbf20dd6b64decf00408d9411f3cf0%7C0ae51e1907c84e4bbb6d648ee58410f4%7C0%7C0%7C637612426440673025%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=8a9e4s8V4ZBOlV3%2FdiB8LMTCd%2BI1z1MrrUiiSWMsfSE%3D&reserved=0>

On Sun, Jul 4, 2021 at 8:10 PM Singh Simarpreet (SX/EAA2) 
<simarpreet.si...@bosch.com<mailto:simarpreet.si...@bosch.com>> wrote:
Hi,

I am facing the below exception while running the job from Flink Dashboard and 
from AKS Cluster :
Caused by: org.apache.flink.core.fs.UnsupportedFileSystemSchemeException: Could 
not find a file system implementation for scheme 'wasb'. The scheme is directly 
supported by Flink through the following plugin: flink-fs-azure-hadoop.

In order to connect to the Blob storage we have done the below setup:

1.     Put the  flink-azure-fs-hadoop.jar in plugins folder in AKS cluster.

2.     In the yaml file we have put this

fs.azure.account.key.pjmsimt1pfdbsbsa.blob.core.windows.net<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.azure.account.key.pjmsimt1pfdbsbsa.blob.core.windows.net%2F&data=04%7C01%7CSimarpreet.Singh%40bosch.com%7C2fcbf20dd6b64decf00408d9411f3cf0%7C0ae51e1907c84e4bbb6d648ee58410f4%7C0%7C0%7C637612426440683024%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ECN8FFJwzSwjFTRKLS5lRyi%2FTMZMgeJOpVjw3fPVbSE%3D&reserved=0>:
    
zSw+bQfhHIZsN0sJHsa8Qz4oJjNhktdwuFWHkfA3tjxgSodnniLfOQ2ZKLmFOHcme8DwWk3s0C8+2r1wzlqNmQ==

3.     We have also tried restarting pods after yaml configurations.

4.     Also, in code, tried writing to blob storage with stream.writeAsText and 
also with StreamingFileSink.forRowFormat but no luck.





I have also attached the code and error for reference. Could you please suggest 
and help to get the connectivity of Flink job with Azure Blob Storage?

Hoping to get your reply soon.



Regards

Simar

Reply via email to