prashanthpdesai commented on issue #1775: URL: https://github.com/apache/hudi/issues/1775#issuecomment-652599980
Sure @bhasudha 1. please find the spark spark-shell --master yarn --queue queue_q1 --jars /home/pdesai/HUDI/incubator-hudi/packaging/hudi-spark-bundle/target/hudi-spark-bundle_2.11-0.6.0-SNAPSHOT.jar --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' --conf spark.sql.hive.convertMetastoreParquet=false --num-executors 16 --executor-cores 4 —executor-memory 32G imported these configs ..: import org.apache.hudi.QuickstartUtils._ import scala.collection.JavaConversions._ import org.apache.spark.sql.SaveMode._ import org.apache.hudi.DataSourceReadOptions._ import org.apache.hudi.DataSourceWriteOptions._ import org.apache.hudi.config.HoodieWriteConfig._ import org.apache.hudi.config.HoodieStorageConfig._ import org.apache.hudi.config.HoodieCompactionConfig._ we did also try with 0.5.2 jar as well , faced the same issue . 2. For Hive query issue , i don't see full stack trace as its not submitting to cluster , i just get the null pointer exception which i have pasted earlier . ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
