Yi Tian, Thanks a lot!
It works!
I find the variable set guide in
http://spark.apache.org/docs/latest/sql-programming-guide.html
2014-12-31 17:12 GMT+08:00 田毅 :
> Hi, Xiaoyu!
>
> You can use `spark.sql.thriftserver.scheduler.pool` instead of
> `spark.scheduler.pool` only in spark thrift server.
Hi, Xiaoyu!
You can use `spark.sql.thriftserver.scheduler.pool` instead of
`spark.scheduler.pool` only in spark thrift server.
On Wed, Dec 31, 2014 at 3:55 PM, Xiaoyu Wang wrote:
> Hi all!
>
> I use Spark SQL1.2 start the thrift server on yarn.
>
> I want to use fair scheduler in the thrift s
Hi all!
I use Spark SQL1.2 start the thrift server on yarn.
I want to use fair scheduler in the thrift server.
I set the properties in spark-defaults.conf like this:
spark.scheduler.mode FAIR
spark.scheduler.allocation.file
/opt/spark-1.2.0-bin-2.4.1/conf/fairscheduler.xml
In the thrift server