Hi all,
I am trying to connect and run note via livy
*created interpreter setting:*
livy.spark.driver.cores 1
livy.spark.driver.memory 1g
livy.spark.dynamicAllocation.cachedExecutorIdleTimeout 600
livy.spark.dynamicAllocation.enabled true
livy.spark.dynamicAllocation.initialExecutors 1
livy.spark.
lang.IllegalArgumentException: requirement failed: initial
> executor number 3 must between min executor number 1 and max executor number 2
>
>
>
>
> Иван Шаповалов 于2017年6月26日周一 下午7:53写道：
>
>> Here is the failure from resource manager
>>
&g
threw
exception: java.lang.reflect.InvocationTargetException)
17/06/26 05:55:43 INFO ApplicationMaster: Deleting staging directory
thank you
2017-06-26 14:16 GMT+03:00 Jeff Zhang :
>
> Could you check the yarn app log ?
>
>
>
> Иван Шаповалов 于2017年6月26日周一 下午6:40写道：
>
>>
Solved this. It appears that 'spark.driver.bindAddress' should point to
docker container IP while 'spark.driver.host' to outer host IP
Thanks anyway
2017-06-22 19:16 GMT+03:00 Иван Шаповалов :
> Help needed.
>
> 1. got zeppelin running in a docker container
>
Help needed.
1. got zeppelin running in a docker container
2. got remote spark standalone cluster I want to run paragraphs against
I have:
- created a setting with
-- master - $MASTER_IP/7077
-- 'spark.driver.host' - ip of the docker container 172.18.0.2
-- 'spark.driver.port' - free port num
zeppelin version is 0.7.2
2017-06-22 19:16 GMT+03:00 Иван Шаповалов :
> Help needed.
>
> 1. got zeppelin running in a docker container
> 2. got remote spark standalone cluster I want to run paragraphs against
>
>
> I have:
> - created a setting with
>
All,
Could anyone please point to some mechanisms to remove datasets /
dataframes from the current interpreter context?
Thanks in advance
--
Ivan Shapovalov
Kharkov, Ukraine
