[
https://issues.apache.org/jira/browse/NIFI-14384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hervé Barrault updated NIFI-14384:
----------------------------------
Description:
My s3 provider is a local minio thus providing a *path style access* to bucket.
I'm trying to configure the S3BundlePersistenceProvider.
The configuration is like
<extensionBundlePersistenceProvider>
<class>org.apache.nifi.registry.aws.S3BundlePersistenceProvider</class>
<propertyname="Region">us-east-1</property>
<propertyname="Bucket Name">nifireg</property>
<propertyname="Key Prefix"></property>
<propertyname="Credentials Provider">STATIC</property>
<propertyname="Access Key">MY_LOGIN</property>
<propertyname="Secret Access Key">MY_PASSWORD</property>
<propertyname="Endpoint
URL">[http://s3.minio:9000|http://127.0.0.1:9000/]</property>
</extensionBundlePersistenceProvider>
without success as the client always use the domain style bucket management
(which is the default)
I checked on the code here (on main branch)
[https://github.com/apache/nifi/blob/main/nifi-registry/nifi-registry-extensions/ni[…]a/org/apache/nifi/registry/aws/S3BundlePersistenceProvider.java|https://github.com/apache/nifi/blob/main/nifi-registry/nifi-registry-extensions/nifi-registry-aws/nifi-registry-aws-extensions/src/main/java/org/apache/nifi/registry/aws/S3BundlePersistenceProvider.java]
there is no condition to allow path style usage.
On s3 sdk, the api to call is here :
[https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/s3/S3ClientOptions.Builder.html#setPathStyleAccess-boolean-]
In order to allow such integration a new properties shall be introduced like
"Path Style" which is false by default but configurable and trigger the
pathstyleaccess configuration.
was:
My s3 provider is a local minio thus providing a *path style access* to bucket.
I'm trying to configure the S3BundlePersistenceProvider.
The configuration is like
<extensionBundlePersistenceProvider>
<class>org.apache.nifi.registry.aws.S3BundlePersistenceProvider</class>
<propertyname="Region">us-east-1</property>
<propertyname="Bucket Name">nifireg</property>
<propertyname="Key Prefix"></property>
<propertyname="Credentials Provider">STATIC</property>
<propertyname="Access Key">MY_LOGIN</property>
<propertyname="Secret Access Key">MY_PASSWORD</property>
<propertyname="Endpoint URL">http://127.0.0.1:9000</property>
</extensionBundlePersistenceProvider>
without success as the client always use the domain style bucket management
(which is the default)
I checked on the code here (on main branch)
[https://github.com/apache/nifi/blob/main/nifi-registry/nifi-registry-extensions/ni[…]a/org/apache/nifi/registry/aws/S3BundlePersistenceProvider.java|https://github.com/apache/nifi/blob/main/nifi-registry/nifi-registry-extensions/nifi-registry-aws/nifi-registry-aws-extensions/src/main/java/org/apache/nifi/registry/aws/S3BundlePersistenceProvider.java]
there is no condition to allow path style usage.
On s3 sdk, the api to call is here :
[https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/s3/S3ClientOptions.Builder.html#setPathStyleAccess-boolean-]
In order to allow such integration a new properties shall be introduced like
"Path Style" which is false by default but configurable and trigger the
pathstyleaccess configuration.
Summary: NiFi Registry - S3BundlePersistenceProvider can't connect to a
minIO (was: NiFi Registry - S3BundlePersistenceProvider can't connect to a
local minIO)
> NiFi Registry - S3BundlePersistenceProvider can't connect to a minIO
> --------------------------------------------------------------------
>
> Key: NIFI-14384
> URL: https://issues.apache.org/jira/browse/NIFI-14384
> Project: Apache NiFi
> Issue Type: Bug
> Components: NiFi Registry
> Affects Versions: 2.3.0
> Environment: S3 server implemented using minIO
> Reporter: Hervé Barrault
> Priority: Major
>
> My s3 provider is a local minio thus providing a *path style access* to
> bucket.
> I'm trying to configure the S3BundlePersistenceProvider.
> The configuration is like
> <extensionBundlePersistenceProvider>
> <class>org.apache.nifi.registry.aws.S3BundlePersistenceProvider</class>
> <propertyname="Region">us-east-1</property>
> <propertyname="Bucket Name">nifireg</property>
> <propertyname="Key Prefix"></property>
> <propertyname="Credentials Provider">STATIC</property>
> <propertyname="Access Key">MY_LOGIN</property>
> <propertyname="Secret Access Key">MY_PASSWORD</property>
> <propertyname="Endpoint
> URL">[http://s3.minio:9000|http://127.0.0.1:9000/]</property>
> </extensionBundlePersistenceProvider>
>
> without success as the client always use the domain style bucket management
> (which is the default)
>
> I checked on the code here (on main branch)
> [https://github.com/apache/nifi/blob/main/nifi-registry/nifi-registry-extensions/ni[…]a/org/apache/nifi/registry/aws/S3BundlePersistenceProvider.java|https://github.com/apache/nifi/blob/main/nifi-registry/nifi-registry-extensions/nifi-registry-aws/nifi-registry-aws-extensions/src/main/java/org/apache/nifi/registry/aws/S3BundlePersistenceProvider.java]
> there is no condition to allow path style usage.
> On s3 sdk, the api to call is here :
> [https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/s3/S3ClientOptions.Builder.html#setPathStyleAccess-boolean-]
>
> In order to allow such integration a new properties shall be introduced like
> "Path Style" which is false by default but configurable and trigger the
> pathstyleaccess configuration.
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
