Jason J. W. Williams wrote:
Hi Mark,
That does help tremendously. How does ZFS decide which zio cache to
use? I apologize if this has already been addressed somewhere.
The ARC caches data blocks in the zio_buf_xxx() cache that matches
the block size. For example, dnode data is stored on disk
Hi Mark,
That does help tremendously. How does ZFS decide which zio cache to
use? I apologize if this has already been addressed somewhere.
Best Regards,
Jason
On 1/11/07, Mark Maybee <[EMAIL PROTECTED]> wrote:
Al Hopper wrote:
> On Wed, 10 Jan 2007, Mark Maybee wrote:
>
>> Jason J. W. William
On 11 January, 2007 - Mark Maybee sent me these 4,7K bytes:
> >It would seem, from reading between the lines of previous emails,
> >particularly the ones you've (Mark M) written, that there is a rule of
> >thumb that would apply given a standard or modified ncsize tunable??
> >
> >I'm primarily in
Al Hopper wrote:
On Wed, 10 Jan 2007, Mark Maybee wrote:
Jason J. W. Williams wrote:
Hi Robert,
Thank you! Holy mackerel! That's a lot of memory. With that type of a
calculation my 4GB arc_max setting is still in the danger zone on a
Thumper. I wonder if any of the ZFS developers could shed s
Jason,
Jason J. W. Williams wrote:
Hi Robert,
We've got the default ncsize. I didn't see any advantage to increasing
it outside of NFS serving...which this server is not. For speed the
X4500 is showing to be a killer MySQL platform. Between the blazing
fast procs and the sheer number of spindle
Robert,
Comments inline...
Robert Milkowski wrote:
Hello Jason,
Wednesday, January 10, 2007, 9:45:05 PM, you wrote:
JJWW> Sanjeev & Robert,
JJWW> Thanks guys. We put that in place last night and it seems to be doing
JJWW> a lot better job of consuming less RAM. We set it to 4GB and each of
JJ
Hello all,
I second Al's motion. Even a little script a-la the CoolTools for
tuning Solaris for the T2000 would be great.
-J
On 1/10/07, Al Hopper <[EMAIL PROTECTED]> wrote:
On Wed, 10 Jan 2007, Mark Maybee wrote:
> Jason J. W. Williams wrote:
> > Hi Robert,
> >
> > Thank you! Holy mackerel!
On Wed, 10 Jan 2007, Mark Maybee wrote:
> Jason J. W. Williams wrote:
> > Hi Robert,
> >
> > Thank you! Holy mackerel! That's a lot of memory. With that type of a
> > calculation my 4GB arc_max setting is still in the danger zone on a
> > Thumper. I wonder if any of the ZFS developers could shed s
Hi Mark,
Thank you. That makes a lot of sense. In our case we're talking around
10 multi-gigabyte files. The arc_max+3*arc_max+fragmentation was a bit
worrisome. It sounds then that this is mostly an issue on something
like an NFS server which had a ton of small files, where the
minimum_file_node
Hey guys,
Do to lng URL lookups, the DNLC was pushed to variable
sized entries. The hit rate was dropping because of
"name to long" misses. This was done long ago while I
was at Sun under a bug reported by me..
I don't know your usage, but you should at
Jason J. W. Williams wrote:
Hi Robert,
Thank you! Holy mackerel! That's a lot of memory. With that type of a
calculation my 4GB arc_max setting is still in the danger zone on a
Thumper. I wonder if any of the ZFS developers could shed some light
on the calculation?
In a worst-case scenario, Ro
Hello Jason,
Thursday, January 11, 2007, 1:10:10 AM, you wrote:
JJWW> Hi Robert,
JJWW> We've got the default ncsize. I didn't see any advantage to increasing
JJWW> it outside of NFS serving...which this server is not. For speed the
JJWW> X4500 is showing to be a killer MySQL platform. Between th
Hi Robert,
We've got the default ncsize. I didn't see any advantage to increasing
it outside of NFS serving...which this server is not. For speed the
X4500 is showing to be a killer MySQL platform. Between the blazing
fast procs and the sheer number of spindles, its perfromance is
tremendous. If
Hello Jason,
Thursday, January 11, 2007, 12:36:46 AM, you wrote:
JJWW> Hi Robert,
JJWW> Thank you! Holy mackerel! That's a lot of memory. With that type of a
JJWW> calculation my 4GB arc_max setting is still in the danger zone on a
JJWW> Thumper. I wonder if any of the ZFS developers could shed
Robert:
> Better yet would be if memory consumed by ZFS for caching (dnodes,
> vnodes, data, ...) would behave similar to page cache like with UFS so
> applications will be able to get back almost all memory used for ZFS
> caches if needed.
I believe that a better response to memory pressure is a
Hi Robert,
Thank you! Holy mackerel! That's a lot of memory. With that type of a
calculation my 4GB arc_max setting is still in the danger zone on a
Thumper. I wonder if any of the ZFS developers could shed some light
on the calculation?
That kind of memory loss makes ZFS almost unusable for a d
Hello Jason,
Wednesday, January 10, 2007, 9:45:05 PM, you wrote:
JJWW> Sanjeev & Robert,
JJWW> Thanks guys. We put that in place last night and it seems to be doing
JJWW> a lot better job of consuming less RAM. We set it to 4GB and each of
JJWW> our 2 MySQL instances on the box to a max of 4GB.
Hi Guys,
After reading through the discussion on this regarding ZFS memory
fragmentation on snv_53 (and forward) and going through our
::kmastat...looks like ZFS is sucking down about 544 MB of RAM in the
various caches. About 360MB of that is in the zio_buf_65536 cache.
Next most notable is 55MB
Sanjeev & Robert,
Thanks guys. We put that in place last night and it seems to be doing
a lot better job of consuming less RAM. We set it to 4GB and each of
our 2 MySQL instances on the box to a max of 4GB. So hopefully slush
of 4GB on the Thumper is enough. I would be interested in what the
othe
Jason,
Robert is right...
The point is ARC is the caching module of ZFS and majority of the memory
is consumed through ARC.
Hence by limiting the c_max of ARC we are limiting the amount ARC consumes.
However, other modules of ZFS would consume more but that may not be as
significant as ARC.
Hello Jason,
Tuesday, January 9, 2007, 10:28:12 PM, you wrote:
JJWW> Hi Sanjeev,
JJWW> Thank you! I was not able to find anything as useful on the subject as
JJWW> that! We are running build 54 on an X4500, would I be correct in my
JJWW> reading of that article that if I put "set zfs:zfs_arc_ma
Hi Jason,
Depending on which hardware architecture you're working on, you may be
able to get Studio 11 compiled binaries through the CoolStack project:
http://cooltools.sunsource.net/coolstack/index.html
Regardless, optimized compiler flags for MySQL with Studio 11 are in the
source bundle l
Jason,
Apologies.. I missed out this mail yesterday...
I am not too familiar with the options. Someoen else will have to answer
this.
Thanks and regards,
Sanjeev.
Jason J. W. Williams wrote:
Sanjeev,
Could you point me in the right direction as to how to convert the
following GCC compile
Hi Sanjeev,
Thank you! I was not able to find anything as useful on the subject as
that! We are running build 54 on an X4500, would I be correct in my
reading of that article that if I put "set zfs:zfs_arc_max =
0x1 #4GB" in my /etc/system, ZFS will consume no more than
4GB? Thank you in
Jason,
Jason J. W. Williams wrote:
Thank you very much! I'm not very familiar with using mdb. Is there
anything to be aware of besides no active zpools?
you can do the following as root user :
-- snip --
# mdb -kw
> arc::print -a "struct arc" c_max
c009a538 c_max = 0x2f9aa800
> ff
We're not using the Enterprise release, but we are working with them.
It looks like MySQL is crashing due to lack of memory.
-J
On 1/8/07, Toby Thain <[EMAIL PROTECTED]> wrote:
On 8-Jan-07, at 11:54 AM, Jason J. W. Williams wrote:
> ...We're trying to recompile MySQL to give a
> stacktrace an
On 8-Jan-07, at 11:54 AM, Jason J. W. Williams wrote:
...We're trying to recompile MySQL to give a
stacktrace and core file to track down exactly why its
crashing...hopefully it will illuminate if memory truly is the issue.
If you're using the Enterprise release, can't you get MySQL's
assis
Sanjeev,
Could you point me in the right direction as to how to convert the
following GCC compile flags to Studio 11 compile flags? Any help is
greatly appreciated. We're trying to recompile MySQL to give a
stacktrace and core file to track down exactly why its
crashing...hopefully it will illumi
HI Sanjeev,
Thank you very much! I'm not very familiar with using mdb. Is there
anything to be aware of besides no active zpools?
Also, which takes precedence 3/4 of the memory or 1GB? Thank you in
advance! Your help is greatly appreciated.
Best Regards,
Jason
On 1/7/07, Sanjeev Bagewadi <[EMA
Jason,
There is no documented way of limiting the memory consumption.
The ARC section of ZFS tries to adapt to the memory pressure of the system.
However, in your case probably it is not quick enough I guess.
One way of limiting the memory consumption would be limit the arc.c_max
This (arc.c_max
Hello,
Is there a way to set a max memory utilization for ZFS? We're trying
to debug an issue where the ZFS is sucking all the RAM out of the box,
and its crashing MySQL as a result we think. Will ZFS reduce its cache
size if it feels memory pressure? Any help is greatly appreciated.
Best Regard
31 matches
Mail list logo
