[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-10-26 Thread Launchpad Bug Tracker
This bug was fixed in the package bacula - 7.0.5+dfsg-4ubuntu0.1 --- bacula (7.0.5+dfsg-4ubuntu0.1) xenial; urgency=medium * debian/patches/libmysqlclient_r.patch: Fix bug where MySQL 5.7 is improperly linked on Ubuntu 16.04. Closes LP: #1570923. * debian/patches/disable_mysq

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-10-21 Thread Nish Aravamudan
Verified with 7.0.5+dfsg-4ubuntu0.1. ** Tags removed: verification-needed ** Tags added: verification-done -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula 7.

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-09-08 Thread Mathew Hodson
** Changed in: bacula (Ubuntu) Importance: Undecided => Medium ** Changed in: bacula (Ubuntu Xenial) Importance: Undecided => Medium -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title:

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-09-08 Thread Brian Murray
Hello Kern, or anyone else affected, Accepted bacula into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/bacula/7.0.5+dfsg- 4ubuntu0.1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-09-07 Thread Nish Aravamudan
** Changed in: bacula (Ubuntu) Assignee: Nish Aravamudan (nacc) => (unassigned) ** Changed in: bacula (Ubuntu Xenial) Assignee: (unassigned) => Nish Aravamudan (nacc) ** Changed in: bacula (Ubuntu Xenial) Status: New => In Progress -- You received this bug notification because

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-20 Thread C de-Avillez
** Also affects: bacula (Ubuntu Xenial) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula 7.4 To manage notificatio

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-20 Thread Nish Aravamudan
** Description changed: + [Impact] + + * Bacula users migrating from earlier versions of MySQL e.g. 14.04 -> + 16.04 experience a significant performance degradation if using the + MySQL backend. + + * The fix (from upstream) is to build bacula with the knowledge that + MySQL is thread-safe. +

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-20 Thread Nish Aravamudan
** Changed in: bacula (Ubuntu) Status: In Progress => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula 7.4 To manage notifications about t

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-15 Thread Nish Aravamudan
Hello all, After reviewing the other open Bacula bugs, I've set up a new PPA with a more normal versioning and (hopefully) fixes to all the issues I know about on 16.04 and 16.10 (and I think handles upgrading from 14.04 to 16.04) https://launchpad.net/~nacc/+archive/ubuntu/bacula3 16.04: 7.0.5+

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-06 Thread Nish Aravamudan
@Kern, Great, thanks for the clarification. If you would be so kind as to test the Xenial & Yakkety (maybe in lxc?) builds from my PPA, that would be very helpful! I'll also submit all the patches to Debian from Yakkety. Thanks, Nish -- You received this bug notification because you are a membe

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-06 Thread Kern Sibbald
Nish, The slow speed of MySQL is definitely seen in MySQL 5.7 on Xenial (and perhaps other platforms that release MySQL 5.7). I can say for certain that it does not exist in Ubuntu 14.04 (I am not sure about the intermediate Ubuntu releases 14.10, 15.04, and 15.10). Both the linking problem (mys

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-06 Thread Nish Aravamudan
@Kern, I may have been over-exuberant in my own builds. Can you clarify if the same issue is seen in Xenial? -Nish -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-06 Thread Nish Aravamudan
** Changed in: bacula (Ubuntu) Status: Triaged => In Progress -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula 7.4 To manage notifications about this b

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-06 Thread Robie Basak
Reassigning to bacula as the fix needs to be in bacula and not mysql. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula 7.4 To manage notifications about this

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-06 Thread Robie Basak
And thanks Kern for figuring this out and providing us with a patch! I'll assign to Nish, as I know he's looking at patching bacula with some other fixes. ** Package changed: mysql-5.7 (Ubuntu) => bacula (Ubuntu) ** Changed in: bacula (Ubuntu) Status: Confirmed => Triaged ** Changed in: b

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-04 Thread Launchpad Bug Tracker
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: mysql-5.7 (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title:

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-04 Thread Kern Sibbald
If I could, I would do what you suggest as it would, as you mentioned, simplify the code. The problem is then Bacula 7.4.x would no longer build and run on platforms such as RedHat 4.0, ... I believe the problem is now resolved in what will be released as 7.4.2, and it is backward compatible with

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-04 Thread Lars Tangvald
It's mentioned at the bottom of this page: https://dev.mysql.com/doc/refman/5.5/en/c-api-implementations.html -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-04 Thread Lars Tangvald
libmysqlclient_r was included in 5.5 and 5.6 for backwards compatibility, but it's simply a symlink to libmysqlclient which was thread safe in 5.5, so my suggestion should work just as well for systems with 5.5 and 5.6. But a better long-term solution is to simply remove all checks of this nature s

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-04 Thread Kern Sibbald
Yes, your solution will work quite fine. However, it has the downside of only working with MySQL 5.7 and later, so it not appropriate for the project where people link against lots of older versions of MySQL. I think the original Ubuntu bug report (https://bugs.launchpad.net/bugs/1570923) on the

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-04 Thread Lars Tangvald
Oh, of course; to fix the initial mysqlclient_r build failure I replaced every instance of mysqlclient_r in the source with mysqlclient, which probably fixed the check as well. Might be a better solution (mysqlclient_r is identical with mysqlclient in 5.5 and 5.6 as well, so no need to keep the old

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-03 Thread Lars Tangvald
Ah, that's great! Odd that I didn't see the issue. I've been using my system to test various things like upgrading from earlier MySQL versions, so it's possible I hadn't cleaned up earlier versions completely and the check still passed with 5.7 somehow. Should make a note of this and get into t

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-03 Thread Ubuntu Foundations Team Bug Bot
The attachment "Fixes broken Bacula batch mode for MySQL 5.7 -- applies to Bacula version 7.4.1" seems to be a patch. If it isn't, please remove the "patch" flag from the attachment, remove the "patch" tag, and if you are a member of the ~ubuntu-reviewers, unsubscribe the team. [This is an automa

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-03 Thread Kern Sibbald
I attach a patch to Bacula 7.4.1 that corrects the slow MySQL by properly detecting that the MySQL 5.7 library is thread safe and hence Bacula batch mode can be enabled. Not this patch may also apply to your patched version of Bacula in bug #157092749. ** Patch added: "Fixes broken Bacula batch m

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-07-03 Thread Kern Sibbald
OK, I have rebuilt my Ubuntu 16.04 test server from scratch with MySQL loaded and running. The bad news is that I can definitively say that Bacula with MySQL 5.7 runs something like 10 times slower than it did with the prior version of MySQL as well as ~10 times slower than Postgres. The good new

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-29 Thread Kern Sibbald
I tried the latest apparmor trick, but it fails. It still complains about mysql and does not seem able to fix the problem. In addition, it is also complaining about dovecot :-( Thanks to both you and Robie (off bug). I definitely want Bacula to run well with MySQL and will keep working on this, b

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-29 Thread Lars Tangvald
I've seen such issues pop up before with apparmor, unfortunately; profiles being left in a halfway state when testing with rapidly installing/uninstalling various packages. It might be simple to fix, though, as I think I've cleared this up before: Is there an etc/apparmor.d/usr.sbin.mysqld file?

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-29 Thread Kern Sibbald
No, there are no MySQL programs running, and the daemon is not running. I have tried to clear the errors the best I can and go back and reload everything, but I am completely stuck with trying to remove the mysql- server-5.7. The problem is (reproduced here manually): AppArmor parser error for /

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-29 Thread Lars Tangvald
Are there any mysqld processes still running? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula 7.4 To manage notifications about this bug go to: https://bugs.

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-29 Thread Kern Sibbald
Thanks for your tip. It did get me past the problem with apt not wanting to downgrade from version 10 to 5.7. However, it created other problems. Unfortunately, I am unable to re-install MySQL even after removing all traces of MariaDB and MySQL. There are always errors. It is so bad that even:

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-28 Thread Lars Tangvald
With the default MariaDB install on my Xenial vm I get about the same numbers for those two tests I got with MySQL: 21s and 77s, so must be caused by something more than just the default configs. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-28 Thread Lars Tangvald
I was able to get similar performance problems with MySQL by severely limiting the limit on file descriptors allowed by systemd (it would also make some tests fail outright because it was at the edge of what the server can live with). If there's something in Maria's default config that sets this, i

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-28 Thread Lars Tangvald
I suspect the problem is that purging MariaDB doesn't remove the database (the maintainer scripts are supposed to ask, but seems there's a bug with this). MariaDB and MySQL are no long valid drop-in replacements of each other, so MySQL won't be able to to work with a MariaDB database, which is prob

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-28 Thread Kern Sibbald
Lars, I am sorry. First, I had installed MariaDB and so the failures were for MariaDB and not MySQL. MariaDB is more than 10 times slower than PostgreSQL, and it shows very clearly in iostat and perf top output. iostat shows much higher iowait numbers than PostgreSQL, it appears that most o

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-28 Thread Kern Sibbald
The good news is that I still have the disk with the Ubuntu 16.04 install where I did my original testing, so I plugged it in and booted it. I am now running tests with exactly the same environment I previously used. The bad news is that I still see substantial timing differences between MySQL 5.

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-27 Thread Lars Tangvald
I didn't look too closely at the extra debug output yet, so can't be sure it'll help, but my thought was simply to compare it to my run and see if anything stands out, if any specific part takes much longer in one run, etc. Also note I haven't run the tests with Postgres to compare, but doubt my

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-27 Thread Kern Sibbald
Yes, on 5.7 the mysqlclient_r was replaced with mysqlclient, which caused some linking problems until I corrected the configure.in script. No, I do not have anything else installed that uses MySQL, but I can run more of the regression tests. All the tests on 5.7 were run on a new installation of

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-27 Thread Lars Tangvald
Also also, could you post the output from the test with REGRESS_DEBUG=1? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula 7.4 To manage notifications about th

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-27 Thread Lars Tangvald
Also, were the tests run with a clean MySQL install, or upgraded from previous versions? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula 7.4 To manage notifi

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-27 Thread Lars Tangvald
I can't seem to reproduce this issue. I've tested according to the instructions at http://www.bacula.org/7.4.x-manuals/en/developers/Bacula_Regression_Testing.html (commenting out all disk tests except the two you noted), and I get about the same results as the ones you report for Postgres on:

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-24 Thread Lars Tangvald
That might actually turn out to be important; IIRC the version of MariaDB in Ubuntu 16.04 is closer to MySQL 5.6 than 5.7, so this might be a performance regression introduced in 5.6. Thanks :) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to U

Re: [Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-24 Thread Kern Sibbald
OK, thanks. Since you have an Oracle email address, you might be particularly nterested to know that I tested the MariaDB on Ubuntu 16.04 in place of MySQL, and it was even slower :-) On 06/24/2016 01:08 PM, Lars Tangvald wrote: > I'll use your tests to try to make a simple test case for this,

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-24 Thread Lars Tangvald
I'll use your tests to try to make a simple test case for this, and pass it on upstream. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL 5.7 slow with Bacula 7.4 To manage notifi

[Bug 1592749] Re: MySQL 5.7 slow with Bacula 7.4

2016-06-17 Thread Robie Basak
** Tags added: mysql-5.7-transition ** Changed in: mysql-5.7 (Ubuntu) Assignee: (unassigned) => Lars Tangvald (lars-tangvald) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1592749 Title: MySQL