micahsecrest opened a new issue, #20019:
URL: https://github.com/apache/hudi/issues/20019

   ### Bug Description
   
   I've enabled OCC with StorageBasedLockProvider for GCS with 
hudi-gcp-bundle-1.1.1.jar and gcs-connector-1.9.4-hadoop2-shaded.jar as only 
gcp related dependencies.
   
   This produces the following error when spark attempts to attain the lock:
   Caused by: java.lang.NoClassDefFoundError: 
com/google/cloud/http/BaseHttpServiceException
   
   Docs suggest that the hudi-gcp-bundle should have the necessary 
dependencies, but google-cloud-storage does not seem to be present in the 
hudi-gcp-bundle.
   https://hudi.apache.org/docs/concurrency_control/#storage-based-lock-provider
   https://github.com/apache/hudi/blob/master/packaging/hudi-gcp-bundle/pom.xml
   
   After including full dependency tree for google-cloud-storage, 
StorageBasedLockProvider is working as expected
   https://mvnrepository.com/artifact/com.google.cloud/google-cloud-storage
   
   Please verify whether hudi-gcp-bundle is supposed to include this or if docs 
need to be updated
   
   
   
   ### Environment
   
   **Hudi version:** Hudi 1.1
   **Query engine:** Spark
   **Relevant configs:** 
   
hoodie.write.lock.provider=org.apache.hudi.client.transaction.lock.StorageBasedLockProvider
   hoodie.write.concurrency.mode=optimistic_concurrency_control
   
   
   ### Logs and Stack Trace
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to