thanhnd20 commented on issue #9739:
URL: https://github.com/apache/hudi/issues/9739#issuecomment-1724744834
@ad1happy2go
The mvn command I have used to build Jar bundle packages: `mvn -am -pl
packing/gcp-hudi-bundle clean package DskipTest=true`.
The complete command I have used to run spark-submit:
`spark-submit \
--master yarn \
--packages com.google.cloud:google-cloud-bigquery:2.10.4 \
--class org.apache.hudi.gcp.bigquery.BigQuerySyncTool \
gs://<my_gs_folder>/hudi-gcp-bundle-0.14.0-rc1.jar \
--project-id <my_project_id> \
--dataset-name <my_datasetname> \
--dataset-location asia-southeast1 \
--source-uri gs://<my_gs_folder>/hudi_trips_cow/asia=* \
--source-uri-prefix gs://<my_gs_folder>/hudi_trips_cow/ \
--use-bq-manifest-file true`
If you need me to provide any more information, please let me know.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
