Hi Yea guava-10.0.1.jar is there When I put Flume guava 11.0.2 I did not get any error but my flume is not starting agent not giving any error too It is hanged I guess
Regards, Chhaya Vishwakarma From: Ashish [mailto:paliwalash...@gmail.com] Sent: Friday, January 10, 2014 4:28 PM To: user@flume.apache.org Subject: Re: Java heap space error while starting flume agent Guava should be already present in Flume lib directory. I downloaded and verified it. You should have guava-10.0.1.jar in Flume lib directory. Can you try with a fresh Flume download? IMHO, it should work, then try to debug the broken env. HTH! ashish On Fri, Jan 10, 2014 at 4:10 PM, Chhaya Vishwakarma <chhaya.vishwaka...@lntinfotech.com<mailto:chhaya.vishwaka...@lntinfotech.com>> wrote: Hi, My flume version is 1.4.0 and I have not put guava jar in classpath -----Original Message----- From: Wolfgang Hoschek [mailto:whosc...@cloudera.com<mailto:whosc...@cloudera.com>] Sent: Friday, January 10, 2014 3:51 PM To: user@flume.apache.org<mailto:user@flume.apache.org> Subject: Re: Java heap space error while starting flume agent Looks like you are running with a guava version that's different than the one that was used to compile. Flume uses guava 11.0.2 per flume/pom.xml. Wolfgang. On Jan 10, 2014, at 7:49 AM, Chhaya Vishwakarma wrote: > Hi > Thank you so much that error is gone now I am getting some different error > > > java.lang.VerifyError: class com.google.common.cache.AbstractLoadingCache > overrides final method apply.(Ljava/lang/Object;)Ljava/lang/Object; > at java.lang.ClassLoader.defineClass1(Native Method) > at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) > at java.lang.ClassLoader.defineClass(ClassLoader.java:615) > at > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) > at java.net.URLClassLoader.access$000(URLClassLoader.java:58) > at java.net.URLClassLoader$1.run(URLClassLoader.java:197) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) > at java.lang.ClassLoader.loadClass(ClassLoader.java:306) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > at java.lang.ClassLoader.loadClass(ClassLoader.java:247) > at > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$ClassInfo.load(ClassPath.java:226) > at > com.cloudera.cdk.morphline.api.MorphlineContext.getTopLevelClasses(MorphlineContext.java:127) > at > com.cloudera.cdk.morphline.api.MorphlineContext.importCommandBuilders(MorphlineContext.java:68) > at com.cloudera.cdk.morphline.stdlib.Pipe.<init>(Pipe.java:41) > at > com.cloudera.cdk.morphline.stdlib.PipeBuilder.build(PipeBuilder.java:39) > at com.cloudera.cdk.morphline.base.Compiler.compile(Compiler.java:125) > at com.cloudera.cdk.morphline.base.Compiler.compile(Compiler.java:54) > at > org.apache.flume.sink.solr.morphline.MorphlineHandlerImpl.configure(MorphlineHandlerImpl.java:101) > > > Regards, > Chhaya Vishwakarma > > > From: Joao Salcedo > [mailto:joao.salc...@gmail.com<mailto:joao.salc...@gmail.com>] > Sent: Friday, January 10, 2014 11:10 AM > To: user@flume.apache.org<mailto:user@flume.apache.org> > Subject: Re: Java heap space error while starting flume agent > > Hi Chhaya, > > Assuming you are at flume home directory, here is the command to start: > > bin/flume-ng agent -n agent -f conf/flume-conf.properties -c conf > > Flume starts and runs with a maximum heap size of 20mb. If you are using > batching, you may run into out of memory error pretty quickly. To increase > the heap size, rename the file flume-env.sh.template to flume-env.sh in > conf directory and uncomment the JAVA_OPTS line and edit the minimum and > maximum heap. Example: JAVA_OPTS="-Xms512m -Xmx1024m" > > If "-c conf" is not specified at the end of the command, your flume-env.sh > file will not be taken into effect. > > > Cheers, > > Joao > > On Fri, Jan 10, 2014 at 4:36 PM, Chhaya Vishwakarma > <chhaya.vishwaka...@lntinfotech.com<mailto:chhaya.vishwaka...@lntinfotech.com>> > wrote: > > > > Hi, > > > > > > > > I am getting java heap error while starting flume agent how can I increase > > JVM memory from flume agent? > > > > > > > > ERROR java.lang.OutOfMemoryError: Java heap space > > > > at java.util.Arrays.copyOf(Arrays.java:2882) > > > > at > > java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100) > > > > at > > java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:572) > > > > at java.lang.StringBuilder.append(StringBuilder.java:203) > > > > at java.io.UnixFileSystem.resolve(UnixFileSystem.java:93) > > > > at java.io.File.<init>(File.java:207) > > > > at java.io.File.listFiles(File.java:1056) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:298) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > at > > com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$Scanner.scanDirectory(ClassPath.java:319) > > > > > > > > > > > > Regards, > > > > Chhaya Vishwakarma > > > > > > > > > > ________________________________ > > The contents of this e-mail and any attachment(s) may contain confidential > > or privileged information for the intended recipient(s). Unintended > > recipients are prohibited from taking action on the basis of information in > > this e-mail and using or disseminating the information, and must notify the > > sender and delete it from their system. L&T Infotech will not accept > > responsibility or liability for the accuracy or completeness of, or the > > presence of any virus or disabling code in this e-mail" -- thanks ashish Blog: http://www.ashishpaliwal.com/blog My Photo Galleries: http://www.pbase.com/ashishpaliwal
