Re: [Maria-discuss] Chewing Through Swap - Swappiness = 0

2018-06-15 Thread Michael Caplan
If I'm reading the output correct mysql is currently using 35.8 %MEM, 67GB VSZ, and 23.6GB RSS Not sure how virtual memory size is calculated, but that seems big I'll try dropping my innodb-buffer-pool-size from 50GB to 47GB or more. Thanks, Mike On 2018-06-15 11:38 AM, Guillaume Lefra

Re: [Maria-discuss] Chewing Through Swap - Swappiness = 0

2018-06-15 Thread Guillaume Lefranc
VSZ is in theory the max size your process can reach if fully allocating resources, so usually (if there are no mistakes in the process) you should have more physical memory than your VSZ (at least for MySQL, this isn't the case for other workloads). Regards Le ven. 15 juin 2018 à 16:53, Michael

Re: [Maria-discuss] Chewing Through Swap - Swappiness = 0

2018-06-15 Thread Michael Caplan
Thanks Rhys, Checked out the page.  Will explore this.  What's unclear to me is how to figuring out "what's being pushed into swap" from there. Thanks, Mike On 2018-06-15 11:26 AM, rhys.campb...@swisscom.com wrote: My understanding is that the OS should never allocate swap when swappine

Re: [Maria-discuss] Chewing Through Swap - Swappiness = 0

2018-06-15 Thread Guillaume Lefranc
Rhys.Campbell, 0 means off since kernel version 3.5. See reference here: https://community.hortonworks.com/questions/71095/why-not-set-swappiness-to-zero.html That's why most people use 1 (safe value) Michael Caplan: please look at the size of your mysqld process in "ps aux" command output. Due to

Re: [Maria-discuss] Chewing Through Swap - Swappiness = 0

2018-06-15 Thread Rhys.Campbell
My understanding is that the OS should never allocate swap when swappiness is 0, so that has me confused. 0 doesn't mean off. If you really want to turn if off then see swapoff / adjust your fstab. 1) How much of this is an OS issue vs MariaDB issue? I'd say it's an application problem. You s

[Maria-discuss] Chewing Through Swap - Swappiness = 0

2018-06-15 Thread Michael Caplan
Hi, I'm trying to figure out why my recently put into production MariaDB is so swap hungry. I'm running 10.2.14, with roughly 300GB data (1000K +/- tables). 95% tables are innodb.  I have 64GB RAM, with INNODB buffer pool size set to 50GB (full my.cnf below).  The OS is Ubuntu 16.04.4. This

Re: [Maria-discuss] Chewing Through Swap - Swappiness = 0

2018-06-15 Thread Michael Caplan
Just found this interesting article on the "The MySQL 'swap insanity' problem": https://blog.jcole.us/2010/09/28/mysql-swap-insanity-and-the-numa-architecture/ Has anyone else tried the mentioned solutions? - Forcing interleaved allocation with numactl --interleave=all. - Flushing Linux’s buf