[Maria-developers] history of lf_hash

2017-08-14 Thread MARK CALLAGHAN
Comments for lf_hash are sparse. Does it implement a well-known algorithm? https://github.com/mysql/mysql-server/blob/8.0/mysys/lf_hash.cc https://github.com/mysql/mysql-server/blob/8.0/include/lf.h -- Mark Callaghan mdcal...@gmail.com ___ Mailing

[Maria-developers] 161M for storage/tokudb isn't friendly

2016-10-21 Thread MARK CALLAGHAN
Filed https://jira.mariadb.org/browse/MDEV-11101 but I have no idea who will fix this. All other engines use less than 20M while tokudb uses 161M including one file in mysql-test that is more than 30M. Lots of time, network and disk space is being wasted by this. -- Mark Callaghan mdcal

Re: [Maria-developers] [MariaDB/server] Compressed binary log (#247)

2016-10-20 Thread MARK CALLAGHAN
ster like brotli, zstd, snappy. > > https://quixdb.github.io/squash-benchmark/#results-table > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.

Re: [Maria-developers] Python Storage Engine

2015-11-02 Thread MARK CALLAGHAN
NAL. > > Regards, > Sergei > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.laun

[Maria-developers] innodb holepunch compression vs the filesystem

2015-10-17 Thread MARK CALLAGHAN
-with-innodb-transparent-page.html http://smalldatum.blogspot.com/2015/09/third-day-with-innodb-transparent-page.html http://smalldatum.blogspot.com/2015/10/wanted-file-system-on-which-innodb.html -- Mark Callaghan mdcal...@gmail.com ___ Mailing list:

Re: [Maria-developers] Memory barrier problem in InnoDB/XtraDB mutex implementation causing hangs

2015-05-26 Thread MARK CALLAGHAN
ost to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-d

Re: [Maria-developers] Memory barrier problem in InnoDB/XtraDB mutex implementation causing hangs

2015-05-19 Thread MARK CALLAGHAN
; only > thing that matters is "when can you push", and getting more releases > out. Never mind what kind of crap is then pushed out to users. > > I am deeply ashamed of treating our users like this. And extremely > unha

Re: [Maria-developers] [Maria-discuss] Enabling feedback pluging for MariaDB 10.1.4

2015-03-12 Thread MARK CALLAGHAN
g installation > to give users an option to enable or disable the plugin. With the plugin > being automatically disabled in non-interactive installations. > > Regards, > Sergei > > ___ > Mailing list: https://launchpad.net

Re: [Maria-developers] Analysing degraded performance at high concurrency in sysbench OLTP

2014-05-02 Thread MARK CALLAGHAN
gt; > It seems that you great people at Percona have a good handle on the InnoDB > issues, together with whatever the Oracle InnoDB team might come up with, > so > it makes sense for me to focus on other stuff. Though it still makes me > cry to > look at that sync array code in InnoDB... > &

Re: [Maria-developers] MariaDB scalability: mutexes

2014-02-26 Thread MARK CALLAGHAN
> Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Mark Callaghan mdcal...@gmail.com _

Re: [Maria-developers] benchmarking next steps

2014-01-23 Thread MARK CALLAGHAN
aster. > > I have done the above fixed in my 10.0 tree. I just need to finalize > and benchmark this before I push... > > Regards, > Monty > -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp

Re: [Maria-developers] benchmarking next steps

2014-01-20 Thread MARK CALLAGHAN
e almost in all cases. An exception is > bottlenecks specific to certain use cases. > > Could you send me any relevant information my way if you have it around? > > Thanks, > Sergey > > On Mon, Jan 20, 2014 at 08:00:45AM -0800, MARK CALLAGHAN wrote: > > Are there other goals

Re: [Maria-developers] benchmarking next steps

2014-01-20 Thread MARK CALLAGHAN
son I asked you a couple months ago about interesting loads > to > analyse for single-threaded performance regressions). > > My experience is that whatever I take the time to look into, I always find > significant opportunities for improvement that are relative easy

Re: [Maria-developers] benchmarking next steps

2014-01-20 Thread MARK CALLAGHAN
-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post t

Re: [Maria-developers] MariaDB-10.0-beta sysbench results

2013-11-22 Thread MARK CALLAGHAN
-56-single-threaded-read-only.html On Fri, Nov 22, 2013 at 12:46 PM, Kristian Nielsen wrote: > MARK CALLAGHAN writes: > > > Resources are finite, but it would be great if MariaDB also did something > > about single-thread performance regressions. MySQL has not done/said mu

Re: [Maria-developers] MariaDB-10.0-beta sysbench results

2013-11-22 Thread MARK CALLAGHAN
doing this, and lets hope we see a lot more > > cheers, > -colin > > -- > Colin Charles, Chief Evangelist > MariaDB | t: +6-012-204-3201 | Skype: colincharles > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to

Re: [Maria-developers] [All] MariaDB's best (download) month ever

2013-09-24 Thread MARK CALLAGHAN
te it remains that way. You might think > its crap, but its unethical to share private emails in public. > > Kristian, I have very high honours for you. Thank you for your occasional > outbursts to remind us to keep it real. > > cheers, > -colin > > > -- > Colin Cha

Re: [Maria-developers] [All] MariaDB's best (download) month ever

2013-09-17 Thread MARK CALLAGHAN
_ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Mark Callaghan mdcal...@gmail.com ___

Re: [Maria-developers] Can there be a better storage engine API?

2013-09-12 Thread MARK CALLAGHAN
tatic/fdwhandler.html http://www.postgresql.org/docs/9.3/static/fdw-callbacks.html http://www.sqlite.org/vtab.html On Fri, Sep 6, 2013 at 12:10 PM, Thomas Jones-Low < thomas.jones-...@foundationdb.com> wrote: > On 8/13/13 6:41 PM, MARK CALLAGHAN wrote: > >> Do we need a bette

Re: [Maria-developers] MariaDB mutex contention

2013-08-20 Thread MARK CALLAGHAN
Mutex contention from various plugins On Tue, Aug 20, 2013 at 9:12 AM, Pavel Ivanov wrote: > Workaround for which problem? > > On Tue, Aug 20, 2013 at 8:17 AM, MARK CALLAGHAN > wrote: > > Is the workaround to use static rather than dynamic plugins? > > > > >

Re: [Maria-developers] MariaDB mutex contention

2013-08-20 Thread MARK CALLAGHAN
I don't think so. > > But if it adds that much overhead, I suppose we'll need to fix it. > Then we fix the unloading too. > > Regards, > Sergei > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to

Re: [Maria-developers] Can there be a better storage engine API?

2013-08-19 Thread MARK CALLAGHAN
> workloads. And while InnoDB will have great cache hit rates when all data > is in-memory. It might write much more data to disk than required. > > Do we need a better API or is the current code good enough? I hope to > hear from people who have done serious storage engine work. &

Re: [Maria-developers] Can there be a better storage engine API?

2013-08-19 Thread MARK CALLAGHAN
te parts of the API, so it isn't a sign that the API is something people want to use. Was TokuMX easier to implement than TokuDB? -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : mari

Re: [Maria-developers] MariaDB mutex contention

2013-08-19 Thread MARK CALLAGHAN
plemented like that) then LOCK_plugin is locked even when plugin's > functionality disabled, because it gets disabled using plugin-specific > variable which can be checked only inside the plugin code. > > > Pavel > > ___ > Mailing li

[Maria-developers] Can there be a better storage engine API?

2013-08-13 Thread MARK CALLAGHAN
e need a better API or is the current code good enough? I hope to hear from people who have done serious storage engine work. -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : m

Re: [Maria-developers] Empty_queries vs Com_empty_queries

2013-05-17 Thread MARK CALLAGHAN
> Unsubscribe : > https://launchpad.net/~maria-**developers<https://launchpad.net/~maria-developers> > More help : > https://help.launchpad.net/**ListHelp<https://help.launchpad.net/ListHelp> > -- Mark Callaghan mdcal...@gmail.com ___

Re: [Maria-developers] Documentation about GTID

2013-05-02 Thread MARK CALLAGHAN
elopers > > Post to : maria-developers@lists.launchpad.net > > Unsubscribe : https://launchpad.net/~maria-developers > > More help : https://help.launchpad.net/ListHelp > > ___ > Mailing list: https://launchpad.net/~maria-developers &g

Re: [Maria-developers] Installing jemalloc on build VMs

2013-04-25 Thread MARK CALLAGHAN
y > handled at runtime (using LD_PRELOAD environment variable). Perhaps someone > familiar with the subject can enlighten us on it. > > > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-devel

[Maria-developers] performance monitoring

2013-04-16 Thread MARK CALLAGHAN
stats and maybe statement_stats or integrate with the PS? http://dev.mysql.com/doc/refman/5.6/en/performance-schema.html http://marcalff.blogspot.com/2013/04/on-configuring-performance-schema.html -- Mark Callaghan mdcal...@gmail.com ___ Mail

Re: [Maria-developers] Benchmark of connect performance

2013-03-19 Thread MARK CALLAGHAN
unchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Mark Callaghan mdcal...@gmail.com ___ Mailing li

Re: [Maria-developers] impact of segmented table_open_cache on sysbench results

2013-03-16 Thread MARK CALLAGHAN
On Fri, Mar 15, 2013 at 3:50 PM, Axel Schwenke wrote: > Hi Mark, > > MARK CALLAGHAN wrote: > > > I didn't see a big change in going from toci=1 to toci=64. I don't > > dispute your results, but I am curious about why it made a difference > > for you but n

Re: [Maria-developers] impact of segmented table_open_cache on sysbench results

2013-03-15 Thread MARK CALLAGHAN
t; Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.

Re: [Maria-developers] deadlock, rotate and prepared xids

2013-03-05 Thread MARK CALLAGHAN
Thanks for the analysis. Filed http://bugs.mysql.com/bug.php?id=68575 for the frequent rotate problem. On Tue, Mar 5, 2013 at 2:02 AM, Kristian Nielsen wrote: > MARK CALLAGHAN writes: > > > http://bugs.mysql.com/bug.php?id=68569 > > This is the classic semi-sync deadlock tha

[Maria-developers] deadlock, rotate and prepared xids

2013-03-04 Thread MARK CALLAGHAN
://bugs.mysql.com/bug.php?id=68569 http://bugs.mysql.com/bug.php?id=68251 -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria

[Maria-developers] my_hash_sort_bin

2013-02-19 Thread MARK CALLAGHAN
rtion that this hash function is lousy holds in general, rather than is limited to this input. And given the large number of machines that run MySQL, MariaDB and Percona Server (and the FB patch) around the world I suspect that we should figure this out. -- Mark Callaghan mdc

Re: [Maria-developers] accelerating CREATE TABLE

2013-01-22 Thread MARK CALLAGHAN
ia-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Mark Callaghan mdcal...@gmail.com ___ Mai

Re: [Maria-developers] Please test: Cassandra batched-inserts, Batched Key Access

2012-08-30 Thread MARK CALLAGHAN
ad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: ht

Re: [Maria-developers] shrink() in sql_string.h

2012-06-07 Thread MARK CALLAGHAN
Filed http://bugs.mysql.com/bug.php?id=65562 Found a fix too. On Wed, Jun 6, 2012 at 4:14 PM, MARK CALLAGHAN wrote: > Why doesn't the shrink() method in sql_string.h check the value of > alloced before calling my_realloc? my_realloc might free Ptr, but when > alloced=0 that memor

[Maria-developers] shrink() in sql_string.h

2012-06-06 Thread MARK CALLAGHAN
} 2bk@work | } -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help

Re: [Maria-developers] Analysing MariaDB 5.5 sysbench performance regression

2012-03-20 Thread MARK CALLAGHAN
ttp://mysqlha.blogspot.com/2009/05/innodb-checksum-performance.html The Facebook patch added support for crc32 checksums that could use crc32 instructions on Intel HW. Official MySQL then adding something like that to one of their new releases. -- Mark Callaghan mdcal...@gmail.com __

Re: [Maria-developers] request for a feature -- LIMIT_ROWS_EXAMINED

2012-03-12 Thread MARK CALLAGHAN
ersion of the > feature in addition to the released version in 5.5. You don't need to maintain the 5.3 version. -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lis

Re: [Maria-developers] [Commits] Rev 3241: Xtradb recently started to access thd members directly , e.g thd->stmt_da (ha_innodb.cc) in file:///H:/bzr/5.5/

2012-01-27 Thread MARK CALLAGHAN
sult is: 1) storage engines don't reuse anything and waste time reimplementing things 2) storage engines reuse things they shouldn't -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to :

Re: [Maria-developers] request for a feature -- LIMIT_ROWS_EXAMINED

2012-01-23 Thread MARK CALLAGHAN
gt; is measurable, then we could improve by making handler::increment_statistics > a function pointer and choosing the right implementation before execution. > This can easily be done if needed. > > Ok, so I will assume your reply means that you accept this approach, and > will >

Re: [Maria-developers] request for a feature -- LIMIT_ROWS_EXAMINED

2012-01-20 Thread MARK CALLAGHAN
The semantics are good for us. The potential overhead from the implementation isn't a concern for our uses. What was the feedback from the MPAB code review? On Fri, Jan 20, 2012 at 7:37 AM, MARK CALLAGHAN wrote: > OK, will have feedback in a few days. > > On Fri, Jan 20, 2012 at 6

Re: [Maria-developers] request for a feature -- LIMIT_ROWS_EXAMINED

2012-01-20 Thread MARK CALLAGHAN
the comments below the > description to get a feeling what is the behavior. > > I can also send you a patch of the current version in case you want to > play with the feature before it is pushed. > > Timour -- Mark Callaghan mdcal...@gmail.com

Re: [Maria-developers] IO statistic in slow log

2012-01-04 Thread MARK CALLAGHAN
st: https://launchpad.net/~maria-developers > Post to     : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help   : https://help.launchpad.net/ListHelp > -- Mark Callaghan mdcal...@gmail.com

Re: [Maria-developers] request for a feature -- LIMIT_ROWS_EXAMINED

2012-01-04 Thread MARK CALLAGHAN
oin algorithms, and the related code has changed. > > Timour > > > On 23.12.2011 06:38, MARK CALLAGHAN wrote: >> >> Yes, I don't think it is a lot of work. I started on it myself but >> don't trust myself to modify optimizer code. I think we can find a >>

Re: [Maria-developers] request for a feature -- LIMIT_ROWS_EXAMINED

2011-12-22 Thread MARK CALLAGHAN
te: > > Hi! > >>>>>> "MARK" == MARK CALLAGHAN writes: > > MARK> A warning would be excellent. An error would be a problem. Returning > MARK> OK is probably not the best result when the examined limit is reached. > > Ok, we will try to develop this

Re: [Maria-developers] request for a feature -- LIMIT_ROWS_EXAMINED

2011-12-21 Thread MARK CALLAGHAN
A warning would be excellent. An error would be a problem. Returning OK is probably not the best result when the examined limit is reached. On Wed, Dec 21, 2011 at 7:17 AM, Timour Katchaounov wrote: >> >> Hi! >> >>>>>>> "MARK" == MARK CALLAGHAN

Re: [Maria-developers] request for a feature -- LIMIT_ROWS_EXAMINED

2011-12-17 Thread MARK CALLAGHAN
risk an additional round trip to the server and for drivers that don't support multi-statement or for limitations on the code that generates the SQL, I don't want to do: set session limit_rows_examined=1000; SELECT /* with rows examined limit */ ... ; set session limit_rows_examined=0; -- Mar

[Maria-developers] request for a feature -- LIMIT_ROWS_EXAMINED

2011-12-16 Thread MARK CALLAGHAN
you interested in implementing this feature for me? We will sponsor the work. The purpose of the feature is to prevent queries from taking too long when there isn't a great index and many rows might be filtered. -- Mark Callaghan mdcal...@gmai

[Maria-developers] MYSQL_THDVAR and SET GLOBAL

2011-11-29 Thread MARK CALLAGHAN
after enabled is affected.", check_fake_changes, NULL, FALSE); -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-

Re: [Maria-developers] [Commits] Rev 3020: MWL#192: Non-blocking client API for libmysqlclient. in http://bazaar.launchpad.net/~maria-captains/maria/5.2

2011-09-23 Thread MARK CALLAGHAN
On Fri, Sep 23, 2011 at 4:32 AM, Kristian Nielsen wrote: > MARK CALLAGHAN writes: > >> Why does this need to save/restore thread contexts (setcontext, etc)? >> I think that if the library is that hard to change then it should be >> fixed or a simpler solution should be a

Re: [Maria-developers] [Commits] Rev 3020: MWL#192: Non-blocking client API for libmysqlclient. in http://bazaar.launchpad.net/~maria-captains/maria/5.2

2011-09-23 Thread MARK CALLAGHAN
On Fri, Sep 23, 2011 at 4:32 AM, Kristian Nielsen wrote: > MARK CALLAGHAN writes: > > As also discussed in the RethinkDB blogs, one needs to be aware of > performance, as some co-routine implementations (eg. POSIX ucontext) are > inefficient. The use of co-routines

Re: [Maria-developers] can "set read_only" be non-blocking?

2011-06-27 Thread MARK CALLAGHAN
On Mon, Jun 27, 2011 at 8:24 AM, Michael Widenius wrote: > > Hi! > > >>>>> "MARK" == MARK CALLAGHAN writes: > > > > MARK> Can there be a variant that doesn't do #2? My workload doesn't use > >> MyISAM > MARK> and I do

Re: [Maria-developers] can "set read_only" be non-blocking?

2011-06-23 Thread MARK CALLAGHAN
On Thu, Jun 23, 2011 at 1:09 AM, Michael Widenius wrote: > > Hi! > > >>>>> "MARK" == MARK CALLAGHAN writes: > MARK> Per the code in set_var.cc: > > > MARK> /* > > MARK> Perform a 'FLUSH TABLES WITH R

[Maria-developers] can "set read_only" be non-blocking?

2011-06-22 Thread MARK CALLAGHAN
eavy way to force LOCK TABLEs to be unlocked. Any long running queries will cause #2 to block. -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubsc

[Maria-developers] how do I count errors per database user?

2011-05-26 Thread MARK CALLAGHAN
o_warnings_for_error= FALSE; } } /* When simulating OOM, skip writing to error log to avoid mtr errors */ DBUG_EXECUTE_IF("simulate_out_of_memory", DBUG_RETURN(0);); if (!thd || MyFlags & ME_NOREFRESH) sql_print_error("%s: %s",my_progname,str); /* pur

Re: [Maria-developers] Summary of the storage engine API changes for group commit

2011-04-06 Thread MARK CALLAGHAN
OK, that is what I wanted to know. On Wed, Apr 6, 2011 at 6:16 AM, Kristian Nielsen wrote: > MARK CALLAGHAN writes: > >> Is commit_ordered called before or after the transaction's XID event >> has been written to the binlog? >> after it has been forced (fs

Re: [Maria-developers] Summary of the storage engine API changes for group commit

2011-04-06 Thread MARK CALLAGHAN
___ > Mailing list: https://launchpad.net/~maria-developers > Post to     : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help   : https://help.launchpad.net/ListHelp > -- Mark Callaghan mdcal...@

[Maria-developers] URLs for worklog tasks include bin name

2011-03-13 Thread MARK CALLAGHAN
=180 is moved from the RawIdeaBin to another bin? -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More

Re: [Maria-developers] User Comment -> Add Comment is bugging in MariaDB worklogs

2011-03-13 Thread MARK CALLAGHAN
The "Follow Up" button has the same behavior. On Sun, Mar 13, 2011 at 9:21 AM, MARK CALLAGHAN wrote: > Go to a worklog, Scroll down, Click on "Add a new comment" > This takes me back to the top of the page. This is confusing and now I > must scroll down again

[Maria-developers] User Comment -> Add Comment is bugging in MariaDB worklogs

2011-03-13 Thread MARK CALLAGHAN
ed is lost. This is a bug. If I enter text on this page and click OK it is not lost. -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://lau

Re: [Maria-developers] question about when locks are released

2011-02-18 Thread MARK CALLAGHAN
Fixed email address for Vamsi On Fri, Feb 18, 2011 at 10:57 AM, MARK CALLAGHAN wrote: > Vamsi, > > In the innodb-release-locks-early patch, do you remember why you > release the locks only _after_ the sync in prepare(), and not before? > > -- > Mark Callaghan > mdcal...

[Maria-developers] question about when locks are released

2011-02-18 Thread MARK CALLAGHAN
Vamsi, In the innodb-release-locks-early patch, do you remember why you release the locks only _after_ the sync in prepare(), and not before? -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to

[Maria-developers] work in progress for the Facebook patch

2011-02-15 Thread MARK CALLAGHAN
lt is level 6. We will evaluate: * using QuickLZ which provides faster compression and decompression than zlib * adding compress_ops and compress_ops_ok per table to information_schema.table_statistics * adding an option to limit compression to the clustered index and not compress s

[Maria-developers] MariaDB and MySQL 5.5

2011-02-10 Thread MARK CALLAGHAN
When will there be a MariaDB branch based on MySQL 5.5? I want to use that as the basis for the 5.5 version of the Facebook patch. -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria

Re: [Maria-developers] pre-allocating binlog to speed up sync_binlog=1

2010-12-22 Thread MARK CALLAGHAN
On Mon, Dec 20, 2010 at 9:17 PM, Arjen Lentz wrote: > Hi Mark, all > > On 21/12/2010, at 12:51 PM, MARK CALLAGHAN wrote: >> >> It would be nice if pre-allocated binlog files were possible, but >> performance results from ext-3 overstates the benefit to be had. If &g

Re: [Maria-developers] pre-allocating binlog to speed up sync_binlog=1

2010-12-20 Thread MARK CALLAGHAN
  : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help   : https://help.launchpad.net/ListHelp > -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-develope

[Maria-developers] LOCK_open contention for high-concurrency workloads

2010-11-07 Thread MARK CALLAGHAN
We discussed this in Istanbul but were vague. Domas has provided more details on the problem. Fixing this will make high-concurrency results much better. http://bugs.mysql.com/bug.php?id=58037&thanks=4 -- Mark Callaghan mdcal...@gmail.com ___ Mai

Re: [Maria-developers] Live Schema Changes

2010-09-24 Thread MARK CALLAGHAN
Nielsen wrote: > MARK CALLAGHAN writes: > >> Define "properly"? I suspect you mean that you want us to spend the >> time to get our changes into MariaDB. > > No, that is not what I meant. I meant write code, tests, etc. like what you > and I want to see in th

Re: [Maria-developers] Live Schema Changes

2010-09-23 Thread MARK CALLAGHAN
maintain a branch on launchpad, not a set of patches. It isn't that hard to maintain them although merging to 5.5 might be some work. Pushing patches from Facebook to anybody else is extra work. I don't have time to do it. I try to make it easy to pull them. -- Mark Callaghan mdcal...

Re: [Maria-developers] Live Schema Changes

2010-09-22 Thread MARK CALLAGHAN
a-developers > More help   : https://help.launchpad.net/ListHelp > > -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpa

Re: [Maria-developers] 64 table join limit

2010-08-05 Thread MARK CALLAGHAN
columns by this mySQL join limit. > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to     : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help   : https://help.l

[Maria-developers] what can go wrong with this code?

2010-06-04 Thread MARK CALLAGHAN
d_of_result(thd); thd->proc_info= "closing tables"; /* Free tables */ close_thread_tables(thd); -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launc

Re: [Maria-developers] Ideas for improving MariaDB/MySQL replication

2010-04-23 Thread MARK CALLAGHAN
On Fri, Apr 23, 2010 at 2:35 AM, Kristian Nielsen wrote: > MARK CALLAGHAN writes: > >> This is a really long thread so a summary elsewhere would be great for >> people like me. > > I agree that the discussion has become quite long. I summarised the group > c

Re: [Maria-developers] Ideas for improving MariaDB/MySQL replication

2010-04-14 Thread MARK CALLAGHAN
ice determines the order, it does not have to fix it) in the >> above pseudocode. Locking it outside may seriously reduce concurrency. > > Agree (in fact, though I did not say so explicitly, I thought of the entire > pseudo code above as being in fact implemented inside the redundancy s

Re: [Maria-developers] [Bug 544173] [NEW] Server crash for multi-engine transaction with binlog disabled

2010-03-25 Thread MARK CALLAGHAN
engine. All of those should be fixed first. If I want to use PBXT (and I do) then I will stop using InnoDB (and I might). When will we have cross-engine deadlock detection? -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~ma

Re: [Maria-developers] LIMIT optimisations

2010-03-10 Thread MARK CALLAGHAN
atic > lengths row here). This is the behavior for all storage engines. I don't think you are going to get the optimization in MySQL that I think you are asking for. I have written about the performance problems of pagination and a workaround in http://www.facebook.com/note.php?note_id=20

Re: [Maria-developers] request for advice on managing a mysql patch in bzr

2010-02-26 Thread MARK CALLAGHAN
nrelated repository, I'm a bit surprised that bzr let you do > that. > > I'm afraid your only option is to replay your changes on a mysql bzr > branch. I ended up doing that. Thanks for the advice. https://code.launchpad.

Re: [Maria-developers] request for advice on managing a mysql patch in bzr

2010-02-26 Thread MARK CALLAGHAN
d merge changes spread over many merge changesets. There apparently isn't a trivial tool to import commits between two branches. Doing something like this does way more than apply the diff for that one change and copy the commit mesage. bzr merge -c revno:2 /s/bzr/fb/5.1 -- Mark C

Re: [Maria-developers] request for advice on managing a mysql patch in bzr

2010-02-26 Thread MARK CALLAGHAN
On Fri, Feb 26, 2010 at 6:36 AM, Sergei Golubchik wrote: > Hi, MARK! > > On Feb 25, MARK CALLAGHAN wrote: >> >> I know this question is more about official MySQL than MariaDB, but it >> is also about sharing code we write at Facebook and all of the patches >> we p

Re: [Maria-developers] request for advice on managing a mysql patch in bzr

2010-02-26 Thread MARK CALLAGHAN
On Fri, Feb 26, 2010 at 1:30 AM, Sergei Golubchik wrote: > Hi, MARK! > > On Feb 25, MARK CALLAGHAN wrote: >> >> One other comment. I don't think the official releases are in >> launchpad. If they were I imagine this would be easier to do. Of >> course, anyone

Re: [Maria-developers] request for advice on managing a mysql patch in bzr

2010-02-25 Thread MARK CALLAGHAN
One other comment. I don't think the official releases are in launchpad. If they were I imagine this would be easier to do. Of course, anyone could republish the official releases there. -- Mark Callaghan mdcal...@gmail.com ___ Mailing list:

[Maria-developers] request for advice on managing a mysql patch in bzr

2010-02-25 Thread MARK CALLAGHAN
3) publish But there will soon be a release of 5.1.45 or 5.1.46 and I don't want to repeat the steps above each time that happens. Do I just publish a large patch for 5.1.44 -> 5.1.4X and get on with my work? Is there a better way? -- Mark Callaghan mdcal...@g

Re: [Maria-developers] Ideas for improving MariaDB/MySQL replication

2010-01-24 Thread MARK CALLAGHAN
ent checksums. I doubt the patch should be reused, as the MySQL replication interface must be improved if we are to innovate -- but the wiki has a lot of details. * http://code.google.com/p/google-mysql-tools/wiki/GlobalTransactionIds * http://code.launchpad.net/~jtolmer/mysql-server/global-trx-ids -- M

Re: [Maria-developers] commit performance when the binlog is enabled

2009-12-29 Thread MARK CALLAGHAN
On Tue, Dec 29, 2009 at 11:23 AM, Sergei Golubchik wrote: > Hi, Paul! > > On Dec 29, Paul McCullagh wrote: >> On Dec 26, 2009, at 3:40 AM, MARK CALLAGHAN wrote: >> >>> * InnoDB locks prepare_commit_mutex in the prepare step >> >> What is the purpos

Re: [Maria-developers] commit performance when the binlog is enabled

2009-12-29 Thread MARK CALLAGHAN
On Tue, Dec 29, 2009 at 11:07 AM, Sergei Golubchik wrote: > Hi, MARK! > > On Dec 29, MARK CALLAGHAN wrote: >> On Mon, Dec 28, 2009 at 9:20 AM, Sergei Golubchik wrote: >> > >> >  trn1> start transaction; insert t1 select * from t2; >> &g

Re: [Maria-developers] commit performance when the binlog is enabled

2009-12-29 Thread MARK CALLAGHAN
On Mon, Dec 28, 2009 at 9:20 AM, Sergei Golubchik wrote: > Hi, MARK! > > On Dec 25, MARK CALLAGHAN wrote: >> >> InnoDB fixed group commit in the InnoDB plugin. This performs as >> expected when the binlog is disabled. This does not perform as I >> expect when

[Maria-developers] commit performance when the binlog is enabled

2009-12-25 Thread MARK CALLAGHAN
mmit record for this trx # fsync done here, group commit may amortize that -- Mark Callaghan mdcal...@gmail.com ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : http

Re: [Maria-developers] Userstats patch applied to MariaDB 5.2

2009-10-24 Thread MARK CALLAGHAN
On Sat, Oct 24, 2009 at 5:30 AM, Michael Widenius wrote: > > Hi! > >>>>>> "MARK" == MARK CALLAGHAN writes: > > > > MARK> 703     1425    2593    4379    4176    4110    maria.nostat > MARK> 684     1281    2439    4064    3896    3882

Re: [Maria-developers] Userstats patch applied to MariaDB 5.2

2009-10-21 Thread MARK CALLAGHAN
On Wed, Oct 21, 2009 at 3:04 PM, Michael Widenius wrote: > > Hi! > >>>>>> "MARK" == MARK CALLAGHAN writes: > > MARK> This includes results from sysbench for Maria 5.2 with/without > MARK> userstat enabled and for several other binaries. The res

Re: [Maria-developers] Userstats patch applied to MariaDB 5.2

2009-10-21 Thread MARK CALLAGHAN
2998 124241 120279 5084dev1020 17233 32641 71906 132926 130436 125125 5084 16241 33986 63226 126277 122702 122002 5138pi 16035 32051 68157 129148 127899 125368 maria.nostat 18644 32239 63443 122932 116283 114760 maria.stat -- Mark Callagha

Re: [Maria-developers] Userstats patch applied to MariaDB 5.2

2009-10-20 Thread MARK CALLAGHAN
On Tue, Oct 20, 2009 at 1:05 AM, Michael Widenius wrote: > > Hi! > >>>>>> "MARK" == MARK CALLAGHAN writes: > > MARK> On Mon, Oct 19, 2009 at 5:52 AM, Sergei Golubchik > wrote: >>> Hi, Monty! >>> >>> On Oct 19, Michae

Re: [Maria-developers] Userstats patch applied to MariaDB 5.2

2009-10-19 Thread MARK CALLAGHAN
ATS separately. The v3/v4 Google patch doesn't have set_concurrent_connections_stats() and I think the problem that Weldon referenced has been fixed. But the requirement to compute concurrent connections per account made the implementation for SHOW USER_STATS much more complex. Do you want to cont

Re: [Maria-developers] Userstats patch applied to MariaDB 5.2

2009-10-19 Thread MARK CALLAGHAN
bench readonly much slower with high concurrency on an 8-core server. But those problems have been fixed in recent versions of the patch. Is MySQL or MariaDB going to run and publish performance regression results for each release/feature? I would love for that to happen, but then I will have les

Re: [Maria-developers] MariaDB and the SCA

2009-09-03 Thread MARK CALLAGHAN
ibutor agreements around! " >> http://askmonty.org/wiki/index.php/MCA_FAQ > > We've made some adjustments, but yes, apparently it is one of the best > contributor agreements around, the community seems to think. That's > why we u

Re: [Maria-developers] Tungsten Replicator and MariaDB

2009-06-20 Thread MARK CALLAGHAN
t > > P.s., Mark, do you have a pointer to the extensibility bug(s)? Justin or Mats might know the bug numbers. The fix for this should be included in the launchpad branch Justin created for global group ids -- https://code.launchpad.net/~jtolmer/mysql-server/global-trx-ids -- Mark Callagha

Re: [Maria-developers] Tungsten Replicator and MariaDB

2009-06-20 Thread MARK CALLAGHAN
, I know you're guilty - plus all those who reviewed your code at > the time) is a 10 year embarassment. Let's get it right, now, shall we? > Thanks Time is finite and the work to do on MySQL is not. It is not that hard to do this feature, but who has the time to do it? And i

Re: [Maria-developers] how to speed up Maria record loading?

2009-06-07 Thread MARK CALLAGHAN
On Sun, Jun 7, 2009 at 1:42 AM, Michael Widenius wrote: > > Hi! > >>>>>> "MARK" == MARK CALLAGHAN writes: > > MARK> On Tue, May 19, 2009 at 1:26 PM, Giuseppe Maxia > wrote: >>> Hi, >>> I am doing some tests with Maria. Out of

  1   2   >