Hi Take a look at the splitter EIP pattern and use the streaming mode.
Also I think gzip is in memory based, you may want some way to unzip to another file directly. On Thu, Aug 1, 2013 at 8:27 AM, Richa <[email protected]> wrote: > Hi, > I have a camel route where I am dealing with huge CSV files which comes in > gzip format. > The route looks as follows: > > from(inputLocation) > .unmarshal().gzip() > .unmarshal().csv() > .process(someProcessor) > .to(outputLocation) > > This route works fine with small files but when I use huge files, it throws > heap space exception. Can you please tell me a way to avoid this? > I cannot chunk my file before unmarshalling as it will affect my processing > in the processor. > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Camel-Unmarshal-throwing-heap-space-exception-tp5736621.html > Sent from the Camel - Users mailing list archive at Nabble.com. -- Claus Ibsen ----------------- Red Hat, Inc. Email: [email protected] Twitter: davsclaus Blog: http://davsclaus.com Author of Camel in Action: http://www.manning.com/ibsen
