We have a squid proxy process with very large memory requirements (10
- 20 GB) on a machine with 24GB of RAM.
Unfortunately, we have to rotate the logs of this process once per
day. When we do, it fork()s and exec()s about 16-20 child processes
as helpers. Since it's got this multi-million-entry
On Mon, Nov 23, 2009 at 12:11:02AM -0500, Dylan Cochran wrote:
> On Sat, Nov 21, 2009 at 5:52 AM, Peter Jeremy wrote:
> > I did run into problems initially because my i386 userland wasn't
> > aligned with my amd64 kernel but rebuilding both fixed that (I'm
> > running 8.0-RC1 and a bit).
> >
> > N
Is squid multithreaded? My first guess would be that you have one
thread forking off all of these processes while other threads are
still doing work and writing to different parts of the address space.
I don't know the details of the superpages implementation but I could
definitely see that this c
On Thu, Nov 26, 2009 at 10:34 AM, Ryan Stone wrote:
> Is squid multithreaded?
No, it isn't:
PID USERNAME THR PRI NICE SIZERES STATE C TIME WCPU COMMAND
75086 squid 1 40 12571M 12584M kqread 6 31:31 0.68% squid
Thanks!
___
Linda Messerschmidt writes:
> Unfortunately, we have to rotate the logs of this process once per
> day. When we do, it fork()s and exec()s about 16-20 child processes
> as helpers.
s/fork/vfork/ and you should be fine.
DES
--
Dag-Erling Smørgrav - d...@des.no
__
Dag-Erling Smørgrav writes:
> Linda Messerschmidt writes:
> > Unfortunately, we have to rotate the logs of this process once per
> > day. When we do, it fork()s and exec()s about 16-20 child processes
> > as helpers.
> s/fork/vfork/ and you should be fine.
...and you should look into replacing
Hi Linda,
vfork() should mitigate this -- i suggest replacing.
respectfully,
=jt
On Thu, Nov 26, 2009 at 10:47, Linda Messerschmidt
wrote:
> On Thu, Nov 26, 2009 at 10:34 AM, Ryan Stone wrote:
>> Is squid multithreaded?
>
> No, it isn't:
>
> PID USERNAME THR PRI NICE SIZE RES STATE C
I think I was not clear with my message, I apologize.
I did not mean to suggest that we were asking for help solving a
problem with squid rotation. I provided that information as
background to discuss what we observed as a potential misbehavior in
the new VM superpages feature, in the hope that i
2009/11/26 Linda Messerschmidt
> We have a squid proxy process with very large memory requirements (10
> - 20 GB) on a machine with 24GB of RAM.
>
> Unfortunately, we have to rotate the logs of this process once per
> day. When we do, it fork()s and exec()s about 16-20 child processes
> as helpe
On Fri, 27 Nov 2009, krad wrote:
> Im sure you will get a lot of lovely answers to this but best keep
> things simple. WHy not just syslog it of to another server and
> offload all the compression to that box. You could even back it with
> zfs nad do on the fly gzip compression at the file system l
10 matches
Mail list logo
