Re: Embedded Agent File Channel Performance

2014-07-10 Thread Roshan Naik
AFAIKT, checkpointing function is synchronized so that no other updates can happen. So putting checkpoint & data on separate disk may not buy much. Splitting datadirs into multiple disks would (use comma separated list of dirs i think) should help more. Can you work with mem channel or spillable c

Embedded Agent File Channel Performance

2014-07-07 Thread Adam Higginson
Hi, I'm currently investigating the suitability of using an Embedded Agent with a file based channel which will be used to write to another agent with a file based channel, and then ultimately into a hdfs sequence file. I've done some early testing in a local environment (with a VM acting as a