Re: How to apply ranger policies on Spark

AFAIK, Ranger secures Hive (JDBC) server only. Unfortunately Spark does not interact with HS2, but directly interacts with Metastore. Hence, the only way to use Ranger policies if you use Hive via JDBC. Another option is HDFS or Storage ACLs, which are coarse grain control over file path etc. You c

Re: How to apply ranger policies on Spark

Thanks Ayan and Dennis, '@Ayan. if I use Ranger to manage HDFS ACLS, as you mentioned it will coarse grain control over file. I might have few fine grained use cases at row/column level I was going through the below JIRAS and thinking if anyone might have used it and any user documentation for the

Re: How to submit a job via REST API?

You should be able to supply the --conf and its values as part of appArgs argument Cheers, Sonal Nube Technologies Join me at Data Con LA Oct 23 | Big Data Conference Europe. Nov 24 | GIDS AI/ML Dec 3 On Tue, Nov 24, 2020 at 11:31 AM Dennis Suhari wrote: > Hi Yang,

Re: How to submit a job via REST API?

Hi Yang, Please find following link https://stackoverflow.com/questions/63677736/spark-application-as-a-rest-service/63678337#63678337 Regards, Vaquar khan On Wed, Nov 25, 2020 at 12:40 AM Sonal Goyal wrote: > You should be able to supply the --conf and its values as part of appArgs > argumen