parthchandra opened a new issue, #6298: URL: https://github.com/apache/datafusion-comet/issues/6298
### What is the problem the feature request solves? The SPI returns CometS3Credentials with non-null access/secret keys, so it cannot express "anonymous". When the built-in Hadoop adapter is enabled globally and a bucket's chain resolves to AnonymousAWSCredentialsProvider (common for public datasets), the adapter fails with a clear error and users must opt the bucket out with an empty fs.s3a.bucket.<bucket>.comet.credential.provider.class. Supporting anonymous through the SPI (a sentinel credential or an isAnonymous flag the native reader maps to skip-signature) would let the adapter match Spark for these buckets. See #6023. ### Describe the potential solution _No response_ ### Additional context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
