You can specify worker JVM options either via storm.yaml (as default) or the configuration you hand to your topology (ie, individual for each topology).
The key is "worker.childopts". To increase memory, you use for example
-Xmx4g (set the memory to 4 GB)
in storm.yaml:
worker.childopts: "-Xmx4g"
in config:
config.put("worker.childopts", "-Xmx4g");
-Matthias
On 04/25/2016 01:54 PM, Sai Dilip Reddy Kiralam wrote:
>
> java.lang.OutOfMemoryError: Java heap space at
> java.util.Arrays.copyOf(Arrays.java:3332) at
> java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:137)
> at
> java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:121)
> at
> java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:421)
> at java.lang.StringBuilder.append(StringBuilder.java:136) at
> ch.qos.logback.core.pattern.FormattingConverter.write(FormattingConverter.java:40)
> at
> ch.qos.logback.core.pattern.PatternLayoutBase.writeLoopOnConverters(PatternLayoutBase.java:119)
> at ch.qos.logback.classic.PatternLayout.doLayout(PatternLayout.java:168)
> at ch.qos.logback.classic.PatternLayout.doLayout(PatternLayout.java:59)
> at
> ch.qos.logback.core.encoder.LayoutWrappingEncoder.doEncode(LayoutWrappingEncoder.java:134)
> at
> ch.qos.logback.core.OutputStreamAppender.writeOut(OutputStreamAppender.java:188)
> at ch.qos.logback.core.FileAppender.writeOut(FileAppender.java:206) at
> ch.qos.logback.core.OutputStreamAppender.subAppend(OutputStreamAppender.java:212)
> at
> ch.qos.logback.core.rolling.RollingFileAppender.subAppend(RollingFileAppender.java:175)
> at
> ch.qos.logback.core.OutputStreamAppender.append(OutputStreamAppender.java:103)
> at
> ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
> at
> ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
> at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
> at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259) at
> ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441) at
> ch.qos.logback.classic.Logger.filterAndLog_0_Or3Plus(Logger.java:395) at
> ch.qos.logback.classic.Logger.info
> <http://ch.qos.logback.classic.Logger.info>(Logger.java:615) at
> clojure.tools.logging$eval1$fn__7.invoke(NO_SOURCE_FILE:0) at
> clojure.tools.logging.impl$fn__14$G__7__25.invoke(impl.clj:16) at
> clojure.tools.logging$log_STAR_.invoke(logging.clj:59) at
> backtype.storm.daemon.task$mk_tasks_fn$fn__6307.invoke(task.clj:152) at
> backtype.storm.daemon.executor$fn__6647$fn__6659$bolt_emit__6686.invoke(executor.clj:663)
> at
> backtype.storm.daemon.executor$fn__6647$fn$reify__6692.emit(executor.clj:698)
> at backtype.storm.task.OutputCollector.emit(OutputCollector.java:203) at
> backtype.storm.task.OutputCollector.emit(OutputCollector.java:49) at
> backtype.storm.topology.BasicOutputCollector.emit(BasicOutputCollector.java:36)
> at
> backtype.storm.topology.BasicOutputCollector.emit(BasicOutputCollector.java:40)
>
>
> WHAT SHOULD I DO ? DO I NEED TO INCREASE THE HEAP SIZE OF WORKER ? if
> yes ! How to do that?
>
>
> *Best regards,*
> */K.Sai Dilip Reddy.
> /*
signature.asc
Description: OpenPGP digital signature
