Re: [Maria-developers] [Maria-discuss] Known limitation with TokuDB in Read Free Replication & parallel replication ?

2016-08-30 Thread Rich Prohaska
ad to some interesting results. On Tue, Aug 30, 2016 at 10:24 AM, Kristian Nielsen wrote: > Rich Prohaska writes: > > > I rearranged the tokudb lock request wait function a little bit, and got > > the lock tree unit tests to compile again (since the API changed). > commit > &

Re: [Maria-developers] [Maria-discuss] Known limitation with TokuDB in Read Free Replication & parallel replication ?

2016-08-17 Thread Rich Prohaska
replicator attempts to kill the query for a mysql slave thread that is waiting for a prior txn to complete. This does not have any effect on tokudb. The workaround for now is to use an extremely small tokudb lock timeout so that the stalls are short. On Tue, Aug 16, 2016 at 9:59 PM, Rich Prohaska wrote

Re: [Maria-developers] [Maria-discuss] Known limitation with TokuDB in Read Free Replication & parallel replication ?

2016-08-16 Thread Rich Prohaska
Hello Kristian, I am working on a second variant of the kill query design that will only kill the pending lock request if any for the thd being killed. The previous design had a problem when killing the query that triggered the wait for call On Aug 15, 2016 7:26 PM, "Rich Prohaska&qu

Re: [Maria-developers] [Maria-discuss] Known limitation with TokuDB in Read Free Replication & parallel replication ?

2016-08-15 Thread Rich Prohaska
Hello Kristian, I have a prototype of the TokuFT code that will cause ALL lock waiters to call their killed callback here: https://github.com/prohaska7/tokuft/tree/kill_lockers On Mon, Aug 15, 2016 at 11:51 AM, Rich Prohaska wrote: > Hello Kristian, > See attached snapshot of slave threa

Re: [Maria-developers] [Maria-discuss] Known limitation with TokuDB in Read Free Replication & parallel replication ?

2016-08-15 Thread Rich Prohaska
8:16 AM, Rich Prohaska wrote: > Hello Kristian, > The simplest kill_query implementation for tokudb would just signal all of > the pending lock request's condition variables. This would cause the > killed callback to be called. A performance refinement, if necessary, >

Re: [Maria-developers] [Maria-discuss] Known limitation with TokuDB in Read Free Replication & parallel replication ?

2016-08-15 Thread Rich Prohaska
n) to identify and signal a condition variable for a blocked thread B. On Mon, Aug 15, 2016 at 5:42 AM, Kristian Nielsen wrote: > Rich Prohaska writes: > > > tokudb lock timeouts are resolving the replication stall. unfortunately, > > the tokudb lock timeout is 4 seconds, so the th

Re: [Maria-developers] [Maria-discuss] Known limitation with TokuDB in Read Free Replication & parallel replication ?

2016-08-14 Thread Rich Prohaska
Hello Kristian, On Sun, Aug 14, 2016 at 1:51 PM, Kristian Nielsen wrote: > Rich Prohaska writes: > > > I suspect that the poor slave replication performance for optimistic > > replication occurs because TokuDB does not implement the kill_query > > handlerton functio

Re: [Maria-developers] [Maria-discuss] Known limitation with TokuDB in Read Free Replication & parallel replication ?

2016-08-14 Thread Rich Prohaska
. InnoDB implements kill_query while TokuDB does not implement it. On Fri, Aug 12, 2016 at 12:47 PM, Rich Prohaska wrote: > Hello Kristian, > I am running your opt2 branch with a small sysbench oltp test (1 table, > 1000 rows, 8 threads). the good news is that the slave stalls du

Re: [Maria-developers] [Maria-discuss] Known limitation with TokuDB in Read Free Replication & parallel replication ?

2016-08-12 Thread Rich Prohaska
Hello Kristian, I am running your opt2 branch with a small sysbench oltp test (1 table, 1000 rows, 8 threads). the good news is that the slave stalls due to lock timeouts are gone. the bad news is that the slave performance is suspect. when slave in conservative mode with 2 threads, the tokudb w

Re: [Maria-developers] TokuDB test suite failures when building at Launchpad

2015-02-08 Thread Rich Prohaska
Hello, tokudb uses getline to retrieve lines from various linux system files and tokudb frees the buffer that getline allocates. perhaps getline has a problem, or tokudb's portability function that computes the system's processor frequency is broken. i dont see a bug in tokudb related to this pro

Re: [Maria-developers] TokuDB test suite failures when building at Launchpad

2015-02-04 Thread Rich Prohaska
3 of the tests fail when they hit the test case time limit. either increase the limit, mark these tests as big tests, or disable these tests. these 3 tests are tokudb.rows-32m-0, tokudb.rows-32m-1 and tokudb.savepoint-5. On Wed, Feb 4, 2015 at 7:08 AM, Otto Kekäläinen wrote: > Failing TokuDB t

Re: [Maria-developers] TokuDB test suite failures when building at Launchpad

2015-02-03 Thread Rich Prohaska
mysqld crashed and left a core file. posting the stack traces from the core file would help. On Tue, Feb 3, 2015 at 6:08 AM, Otto Kekäläinen wrote: > Hello! > > Are here any TokuDB devs who could help me debug why TokuDB does > repeatedly fails to pass build suite tests when built on > Launchp

Re: [Maria-developers] TokuDB disabled in Debian and Ubuntu - help me get it working?

2014-04-14 Thread Rich Prohaska
Hello Otto, Have not investigated these problems yet. Created a tokudb issue to track: https://github.com/Tokutek/mariadb-5.5/issues/53 On Mon, Apr 14, 2014 at 5:03 AM, Otto Kekäläinen wrote: > Hello Richard, > > Any chance of getting your comments on this..? Thanks! > > > > 2014-04-01 12:25 G

[Maria-developers] INT thread variables in mysql and mariadb (all versions as far as i know)

2014-04-08 Thread Rich Prohaska
suppose that I have a THDVAR_INT variable with min = -1 and max = 1, and i set it to -1. how come select @@var returns 4294967295 instead of -1? ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net

[Maria-developers] debugging MDEV-5932, wrong result set for tokudb

2014-03-28 Thread Rich Prohaska
Hello, TokuDB generates an empty result set for a select with sub-select, but generated a non-empty result set for the same query when creating a new table. The result set should be the same in both cases. What is going on here? InnoDB computes an empty result set for both cases. I traced the

[Maria-developers] problem with the linux thread pool in mariadb 5.5

2014-01-16 Thread Rich Prohaska
LIBC_2.3.2 , inline_mysql_cond_timedwait , get_event , worker_main , start_thread , clone thanks rich prohaska ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers

[Maria-developers] system variable value

2013-12-23 Thread Rich Prohaska
I have a ULONGLONG system variable in my storage engine, and I set its value to '-1' on the mysqld command line. Its value gets set to all ones without any warnings or errors. The number conversion functions just cast between longlong and ulonglong types without regard to the sign of the number.

Re: [Maria-developers] RQG crashes tokudb due to unexpected storage engine API call sequence

2013-12-05 Thread Rich Prohaska
a_tokudb.cc:4679:ha_tokudb::index_end 0x7f3b0352d078 131205 20:52:40 [ERROR] TokuDB: toku_c_close: Transaction cannot do work when child exists /home/prohaska/mariadb-5.5.34/storage/tokudb/ha_tokudb.cc:4684 index_end: Assertion `Handlerton: r==0 ' failed (errno=0) On Thu, Dec 5, 2013 at 12:02

[Maria-developers] RQG crashes tokudb due to unexpected storage engine API call sequence

2013-12-05 Thread Rich Prohaska
software does not expect the commit to occur before index_end is called. Is this assumption correct? Since mariadb (and i suspect mysql) does this, it appears that the storage engine should expect commit before index_end. Any comments? Thanks Rich Prohaska

[Maria-developers] updating a string session variable from a storage engine

2013-09-12 Thread Rich Prohaska
i have a MYSQL_THDVAR_STR session variable in my storage engine. i want to update its value from the storage engine. it was suggested that i use "THDVAR(x)=new_value" to do it. i noticed that update_func_str is NOT called, so i wonder about the contract. is the caller responsible for memory man

[Maria-developers] we have seen sporadic crashes in the Protocol::net_store_data function

2013-07-26 Thread Rich Prohaska
Crash occurs when using the TokuDB storage engine in MySQL 5.5.30. Any insight into what may be causing this problem would be really nice. Sorry, but this is all the info that i have. Here is a stack trace from the mysql error log: #1 0x006b760f in handle_fatal_signal (sig=11) at my

[Maria-developers] innodb key comparisons

2013-07-25 Thread Rich Prohaska
of the key comparisons? thanks rich prohaska ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp

Re: [Maria-developers] mysql test question

2013-04-05 Thread Rich Prohaska
Thanks for the pointer! On Fri, Apr 5, 2013 at 5:35 PM, Sergei Golubchik wrote: > Hi, Rich! > > On Apr 05, Rich Prohaska wrote: > > i am interested in writing upgrade tests. we fixed a bug in our storage > > engine that executed some upgrade code for tables created in a

Re: [Maria-developers] mysql test question

2013-04-05 Thread Rich Prohaska
to approach this? thanks On Fri, Apr 5, 2013 at 4:29 PM, Reindl Harald wrote: > > Am 05.04.2013 22:24, schrieb Rich Prohaska: > > I was wondering if there was a way to run a mysql-test on with a > prebuilt data directory. If so, can you point me > > to some example? >

[Maria-developers] mysql test question

2013-04-05 Thread Rich Prohaska
Hello, I was wondering if there was a way to run a mysql-test on with a prebuilt data directory. If so, can you point me to some example? Thanks Rich Prohaska ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers

Re: [Maria-developers] how to build mariadb RPMs

2013-01-30 Thread Rich Prohaska
Hello Sergei, The rpm patch worked great. Thanks On Tue, Jan 29, 2013 at 12:41 PM, Sergei Golubchik wrote: > Hi, Rich! > > On Jan 29, Rich Prohaska wrote: >> Hello Sergei, >> I look forward to using the patch. Please let me known when and where >> to find it. > &g

Re: [Maria-developers] how to build mariadb RPMs

2013-01-29 Thread Rich Prohaska
: > Hi, Rich! > > On Jan 28, Rich Prohaska wrote: >> Hello Sergei, >> >> Mixed results when just using CMAKE_PACKAGING_INSTALL_PREFIX to build >> Mariadb RPMs with a non-default install prefix. >> >> Good news: the installed files use the supplied install pr

Re: [Maria-developers] how to build mariadb RPMs

2013-01-28 Thread Rich Prohaska
Hi, Rich! > > On Jan 24, Rich Prohaska wrote: >> Is it possible to change the MariaDB RPM install directory to be >> something like /opt/someotherplace? I tried using >> CMAKE_INSTALL_PREFIX but it seemed to be ignored. > > Set CPACK_PACKAGING_INSTALL_PREFIX, that works.

[Maria-developers] MariaDB RPMs

2013-01-24 Thread Rich Prohaska
Suppose that we have a RHEL5 machine running and we want to install MariaDB on it. Unfortunately, it conflicts with files installed by the mysql package. # rpm -i MariaDB-5.5.28a-centos5-x86_64-common.rpm warning: MariaDB-5.5.28a-centos5-x86_64-common.rpm: Header V3 DSA signature: NOKEY, key ID 1

Re: [Maria-developers] how to build mariadb RPMs

2013-01-24 Thread Rich Prohaska
Is it possible to change the MariaDB RPM install directory to be something like /opt/someotherplace? I tried using CMAKE_INSTALL_PREFIX but it seemed to be ignored. On Thu, Jan 24, 2013 at 9:49 AM, Sergei Golubchik wrote: > Hi, Rich! > > On Jan 22, Rich Prohaska wrote: >> It wor

Re: [Maria-developers] how to build mariadb RPMs

2013-01-22 Thread Rich Prohaska
It worked very nicely. How hard to you think it is to port to MySQL? Yes, we support MySQL. On Mon, Jan 21, 2013 at 12:01 PM, Sergei Golubchik wrote: > Hi, Rich! > > On Jan 21, Rich Prohaska wrote: >> How do you build the mariadb RPMs? Are you using rpmbuild or cpack? >>

Re: [Maria-developers] how to build mariadb RPMs

2013-01-21 Thread Rich Prohaska
Thanks for the pointer. I will try it out. On Mon, Jan 21, 2013 at 12:01 PM, Sergei Golubchik wrote: > Hi, Rich! > > On Jan 21, Rich Prohaska wrote: >> How do you build the mariadb RPMs? Are you using rpmbuild or cpack? >> Is there a top level script that uses rpmbuild o

[Maria-developers] how to build mariadb RPMs

2013-01-21 Thread Rich Prohaska
How do you build the mariadb RPMs? Are you using rpmbuild or cpack? Is there a top level script that uses rpmbuild or cpack that I should use? Thanks Rich Prohaska ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria

[Maria-developers] extended keys

2012-12-14 Thread Rich Prohaska
the tokudb storage engine on both mysql and mariadb. Is the mariadb design going to change to match the 5.6 implementation, or are the designs now separate? Thanks Rich Prohaska ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria

[Maria-developers] a mysterious (to me) block of code in the middle of ha_recover

2012-12-13 Thread Rich Prohaska
Hello, The ha_recover function in MySQL 5.5.28 has a block of code in the middle of it labelled with WILL_BE_DELETED_LATER that gets compiled into mysqld. The ha_recover function in Mariadb 5.5.28a does not have this code in it. It appears that the code forces prepared transactions to be rolled

[Maria-developers] a mysterious (to me) block of code in the middle of ha_recover

2012-12-13 Thread Rich Prohaska
back in MySQL. Does anyone know what this code does? Does anyone know why this code exists in MySQL but not in Mariadb? Thanks Rich Prohaska ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net

[Maria-developers] test case for mdev 3885 is named incorrectly

2012-12-04 Thread Rich Prohaska
revision 3584 named the test case for mdev 3885 "test_mdev3855" (NOTE 3855). ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help :

Re: [Maria-developers] crash in TC_LOG_MMAP::log_one_transaction in maria-10.0.0

2012-11-19 Thread Rich Prohaska
test ran for a few hours without error. thanks for quickly fixing the problems. how can we get tokudb into the mariadb regression environment? On Mon, Nov 19, 2012 at 12:39 PM, Kristian Nielsen wrote: > Rich Prohaska writes: > >> When one runs multiple XA clients with a debug build

Re: [Maria-developers] crash in TC_LOG_MMAP::log_one_transaction in maria-10.0.0

2012-11-19 Thread Rich Prohaska
cc line 7567. An unlocked mutex is being unlocked. I discussed this problem with Sergei and we think that the problem is caused a few lines above. I updated my branch ( lp:~prohaska7/maria/2pc-crash-with-maria10-and-tokudb) with a proposed bug fix. Rich Prohaska On Sun, Nov 18, 2012 at 6:59

Re: [Maria-developers] crash in TC_LOG_MMAP::log_one_transaction in maria-10.0.0

2012-11-15 Thread Rich Prohaska
fixed. Thanks Rich Prohaska Here is what i did to reproduce the problem: mkdir m10 m10-build cd m10-build # get my maria10 branch and the 6.5.0 fractal tree SDK bzr branch lp:~prohaska7/maria/2pc-crash-with-maria10-and-tokudb wget https://s3.amazonaws.com/tokutek-mysql-6.5.0/tokufractaltreeindex

[Maria-developers] crash in TC_LOG_MMAP::log_one_transaction in maria-10.0.0

2012-11-15 Thread Rich Prohaska
sion. What is the best way to get this fixed? Would it help if i made the test case available? Thanks Rich Prohaska Here is the stack trace: Program received signal SIGABRT, Aborted. 0x003006a32885 in raise () from /lib64/libc.so.6 (gdb) bt #0 0x003006a32885 in raise () from /lib6

[Maria-developers] Fwd: XA problems in mysql-5.6.7-rc

2012-10-19 Thread Rich Prohaska
problems in mysql-5.6.7-rc To: Rich Prohaska Cc: intern...@lists.mysql.com Hi, Rich! On Oct 11, Rich Prohaska wrote: > Hello Sergei, > Can you give me a pointer to a source files, or a source control changeset? This is the bug report: https://bugs.launchpad.net/maria/+bug/578117 And t

Re: [Maria-developers] what compiler should i use when building mariadb?

2012-08-08 Thread Rich Prohaska
the CFI directives that are needed to compile mariadb. On Mon, Aug 6, 2012 at 3:44 PM, Kristian Nielsen wrote: > Rich Prohaska writes: > >> I suspect that we have a tool chain problem here at tokutek. >> We can build maria 5.5 with gcc 4.7.1 and binutils 2.22 on a centos >&g

Re: [Maria-developers] what compiler should i use when building mariadb?

2012-08-06 Thread Rich Prohaska
ourselves). So, we are doing additional experiments to find the root cause of this problem. Thanks for information about successful maria 5.5 builds with gcc 4.7.1. On Mon, Aug 6, 2012 at 7:46 AM, Kristian Nielsen wrote: >>>>>>> "Rich" == Rich Prohaska writes: >

Re: [Maria-developers] what compiler should i use when building mariadb?

2012-08-03 Thread Rich Prohaska
are deprecated in favour of using-declarations; suggestion: add the ‘using’ keyword [-Wdeprecated] On Fri, Aug 3, 2012 at 2:08 PM, Michael Widenius wrote: > > Hi! > >>>>>> "Rich" == Rich Prohaska writes: > > Rich> hello, > Rich> we have been u

[Maria-developers] what compiler should i use when building mariadb?

2012-08-03 Thread Rich Prohaska
: Assembler messages: /home/tokubuild/build-tokudb-46462/mariadb-5.5.25-tokudb-46462-linux-x86_64-build/mariadb-5.5.25-tokudb-46462-src/mysys/my_context.c:207: Error: CFI instruction used without previous .cfi_startproc what compiler do you use to build mariadb? thanks rich prohaska

[Maria-developers] question about MTR

2012-07-24 Thread Rich Prohaska
ines). Is this accurate? Thanks Rich Prohaska ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp

Re: [Maria-developers] problem with savepoints in mariadb 5.5.25

2012-07-11 Thread Rich Prohaska
Hello, Thanks. Per Elena's request, i created bug #1023404. Rich Prohaska On Wed, Jul 11, 2012 at 7:27 AM, Michael Widenius wrote: > > Hi! > >>>>>> "Rich" == Rich Prohaska writes: > > Rich> Hello, > Rich> I posted our fix at lp:~proha

Re: [Maria-developers] problem with savepoints in mariadb 5.5.25

2012-07-10 Thread Rich Prohaska
Hello, I posted our fix at lp:~prohaska7/maria/5.5-savepoint-offset-fix. Does it make sense? Thanks Rich Prohaska On Mon, Jul 9, 2012 at 7:17 PM, Rich Prohaska wrote: > Hello, > It turns out the previous explanation was WRONG. > > Here is another stab at the problem. My understa

Re: [Maria-developers] problem with savepoints in mariadb 5.5.25

2012-07-09 Thread Rich Prohaska
, modifies its idea of the total savepoint data size, and sets it to the offset of the handlerton's local state If this is correct, then why does the ha_initialize_handlerton function do step (2) twice? It looks like a code merge bug to me. Rich Prohaska On Mon, Jul 9, 2012 at 4:41 PM, Rich Pro

[Maria-developers] problem with savepoints in mariadb 5.5.25

2012-07-09 Thread Rich Prohaska
is a possible fix: Move the base initialization of the savepoint_alloc_size from ha_init to the global intiializer. With this change, the handlerton's offsets are computed AFTER the SAVEPOINT space is reserved. Is this correct? Thanks Rich Prohaska ___

[Maria-developers] replication tests crash mysqld in mariadb 5.5.25

2012-06-28 Thread Rich Prohaska
with mariadb-5.5.25 on a centos 5.8 machine, when i run this: ./mysql-test-run.pl --suite=rpl --force --max-test-fail=0 --nowarnings --parallel=4 mysqld crashes in the xtradb code trying to deref a NULL pointer. core files are available. Core was generated by `/home/prohaska/distros/mariadb-5.5

Re: [Maria-developers] mysql engines tests fail on mariadb 5.5.25

2012-06-26 Thread Rich Prohaska
Hello Elena, Thanks for pointing out to us the engine independent tests. We would like to run this test with TokuDB as part of our test process, and look forward to its release. Rich Prohaska Tokutek On Tue, Jun 26, 2012 at 12:58 PM, Elena Stepanova wrote: > Hi Rich, > > > On 6/

[Maria-developers] mysql engines tests fail on mariadb 5.5.25

2012-06-25 Thread Rich Prohaska
ft engines/funcs.se_join_natural_left_outer engines/funcs.sq_all engines/funcs.sq_error engines/funcs.up_calendar_range engines/iuds.delete_time engines/iuds.insert_decimal engines/iuds.insert_number engines/iuds.insert_time engines/iuds.type_bit_iuds engines/iuds.update_delete_number engines/iuds.update_time th

Re: [Maria-developers] Fwd: crash in slave replication with XA transaction

2012-06-08 Thread Rich Prohaska
Hello, Thanks for the feedback on how to fix our replication slave crash. I hacked the mariadb 5.5.23 and ended up with the attached patch. Rich Prohaska On Fri, Jun 8, 2012 at 1:37 PM, Michael Widenius wrote: > > Hi! > > >>>>> "Zardosht" == Zardosht Kas

Re: [Maria-developers] crash in slave replication with XA transaction

2012-06-05 Thread Rich Prohaska
We made a slightly different change for MariaDB 5.5.24 in the TC_LOG_BINLOG::log_and_order function. $ diff log.cc.orig log.cc 7424a7425,7426 > if (thd_get_ha_data(thd, binlog_hton) == NULL) > thd->binlog_setup_trx_data(); Is this correct? Is this sufficient? Thanks RIch Prohask