I'm not very clear what you mean. Perhaps, you could help me understand a
bit more.

*>>"But this task very very neey memory the one container to eat 1G
memory!!"*

You can certainly increase the number of containers (assuming you're
running on Yarn). Please look at
samza.apache.org/learn/documentation/0.10/jobs/configuration-table.html .
The properties of interest is yarn.container.count.


*>>this task start three container be going to eat 3G memory, add
am.container 768M! OGM!!! I’m just running six or seven task!*

In a Yarn cluster, there are usually many machines. So, 4G memory is not
much. Samza can scale to hundreds of machines and hundreds of containers.
The memory is *per-container process* and not per-task.

*>>It is my way of opening is wrong or it's just like this?*
I'm not sure how I can help here. 4G memory consumption for the entire job
is definitely expected. There's no free lunch in computer science ;-)



On Thu, Mar 9, 2017 at 2:57 AM, wu shaodong <wooshaod...@outlook.com> wrote:

> Hi everybody
>
>          Here I come again. I’m use samza runtime clean data project. But
> this task very very neey memory the one container to eat 1G memory!!!
>
> this task start three container be going to eat 3G memory, add
> am.container 768M! OGM!!! I’m just running six or seven task!
>
>
>
> It is my way of opening is wrong or it's just like this?
>
>
>
> Thanks very much for your help.
>
>
>
>
>
> 发送自 Windows 10 版邮件<http://go.microsoft.com/fwlink/?LinkId=550986>应用
>



-- 
Jagadish V,
Graduate Student,
Department of Computer Science,
Stanford University

Reply via email to