Re: 回复: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-09 Thread Arvid Heise
- 原始邮件 -- >> *发件人:* "Maciek Próchniak" ; >> *发送时间:* 2021年4月9日(星期五) 凌晨3:24 >> *收件人:* "太平洋"<495635...@qq.com>;"Arvid Heise";"Yangze >> Guo"; >> *抄送:* "user";"guowei.mgw"> >;"renqs

Re: 回复: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-09 Thread Maciek Próchniak
* "太平洋"<495635...@qq.com <mailto:495635...@qq.com>>;"Arvid Heise"mailto:ar...@apache.org>>;"Yangze Guo"mailto:karma...@gmail.com>>; *抄送:* "user"mailto:user@flink.apache.org>>;"guowei.mgw"mailto:guowei@gmail.com&g

Re: 回复: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-09 Thread Arvid Heise
qq.com>;"Arvid Heise";"Yangze > Guo"; > *抄送:* "user";"guowei.mgw" >;"renqschn"; > *主题:* Re: 回复: period batch job lead to OutOfMemoryError: Metaspace problem > > Hi, > > Did you put the clickhouse JDBC drive

?????? ?????? period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-08 Thread ??????
I have tried  to add 'classloader.parent-first-patterns.additional: "ru.yandex.clickhouse" ' to flink-config, but problem still exist. Is there lightweight way to put clickhouse JDBC driver on Flink lib/ folder?   --  -- ??:

Re: 回复: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-08 Thread Maciek Próchniak
?0?2-- *??:* "Arvid Heise" ; *:*?0?22021??4??8??(??) 2:33 *??:*?0?2"Yangze Guo"; *:*?0?2"??"<495635...@qq.com>;"user";"guowei.mgw";"renqschn"; *:*?0?2Re: period batch job lead to OutOfM

Re: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-08 Thread Yangze Guo
= new FlinkKafkaProducer<>(); > exStream.map().addSink(producer); > > env.execute("Prediction Program"); > } catch (Exception e) { > e.printStackTrace(); > } > i++; > Thread.sleep(window * 1000); > } > } > } > > > > -- 原始邮件 ---

?????? period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-08 Thread ??????
My application program looks like this. Does this structure has some problem? public class StreamingJob { public static void main(String[] args) throws Exception { int i = 0; while (i < 100) { try {

Re: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-07 Thread Arvid Heise
> 发件人: "Yangze Guo" ; > > 发送时间: 2021年4月6日(星期二) 晚上6:35 > > 收件人: "太平洋"<495635...@qq.com>; > > 抄送: "user";"guowei.mgw"; > > 主题: Re: period batch job lead to OutOfMemoryError: Metaspace problem > > > > > I have tried

Re: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-07 Thread Yangze Guo
wrote: > > > > I have tried this method, but the problem still exist. > > by heap dump analysis, is 21 instances of > > "org.apache.flink.util.ChildFirstClassLoader" normal? > > > > > > -- 原始邮件 -- > > 发件人: "Y

Re: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-06 Thread Yangze Guo
-- > 发件人: "Yangze Guo" ; > 发送时间: 2021年4月6日(星期二) 下午4:32 > 收件人: "太平洋"<495635...@qq.com>; > 抄送: "user"; > 主题: Re: period batch job lead to OutOfMemoryError: Metaspace problem > > I think you can try to increase the JVM metaspace option for >

回复: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-06 Thread 太平洋
I have tried this method, but the problem still exist. by heap dump analysis, is 21 instances of "org.apache.flink.util.ChildFirstClassLoader" normal? -- 原始邮件 -- 发件人:

Re: period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-06 Thread Yangze Guo
I think you can try to increase the JVM metaspace option for TaskManagers through taskmanager.memory.jvm-metaspace.size. [1] [1] https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/memory/mem_trouble/#outofmemoryerror-metaspace Best, Yangze Guo Best, Yangze Guo On Tue, Apr

period batch job lead to OutOfMemoryError: Metaspace problem

2021-04-06 Thread ??????
batch job?? read data from s3 by sql??then by some operators and write data to clickhouse and kafka. after some times, task-manager quit with OutOfMemoryError: Metaspace. env?? flink version??1.12.2 task-manager slot count: 5 deployment?? standalone kubernetes session dependencies??