Bug#535162: maildir-utils: deleting messages is really slow

2009-10-30 Thread Stefano Zacchiroli
On Fri, Oct 30, 2009 at 04:40:22PM +0100, Norbert Preining wrote: > On Fr, 30 Okt 2009, Stefano Zacchiroli wrote: > > given that synchronous is set to "no") or else the Xapian > > message-by-message removal. If you already have some debugging code > > Yes, that is it. Yay, at least now we know th

Bug#535162: maildir-utils: deleting messages is really slow

2009-10-30 Thread Norbert Preining
On Fr, 30 Okt 2009, Stefano Zacchiroli wrote: > I _might_ be able to find some time to fix that, given how important it > has become for me, but before doing that I'll try to ask some Xapian > expert friend whether he is confident or not that is the issue. In the Good idea!!! > meantime, can you

Bug#535162: maildir-utils: deleting messages is really slow

2009-10-30 Thread Norbert Preining
On Fr, 30 Okt 2009, Stefano Zacchiroli wrote: > given that synchronous is set to "no") or else the Xapian > message-by-message removal. If you already have some debugging code Yes, that is it. I did poor-mens timing by entering printfs around and seeing where it takes time, and it is the callback

Bug#535162: maildir-utils: deleting messages is really slow

2009-10-30 Thread Stefano Zacchiroli
On Fri, Oct 30, 2009 at 02:45:59AM +0100, Norbert Preining wrote: > from the issue where Stefano posted: > > 2) I haven't straced it yet, but I read the corresponding source code. > > Apparently > > you're first extracting all indexed messages from sqlite and then, one by > > one, you're > > remo

Bug#535162: maildir-utils: deleting messages is really slow

2009-10-29 Thread Norbert Preining
On Fr, 30 Okt 2009, preining wrote: > Only one question, if one of you has some experience with sql (as > I don't). How does one specify a LIST of ids to be removed in a > single sql statement? One more thing while digging throught he code. Maybe using the transaction feature would be nice. For i

Bug#535162: maildir-utils: deleting messages is really slow

2009-10-29 Thread Norbert Preining
HI both of you, On Di, 30 Jun 2009, Helmut Grohne wrote: > Deleting 500 messages makes mu-index take about half an hour. Most of from the issue where Stefano posted: > 2) I haven't straced it yet, but I read the corresponding source code. > Apparently > you're first extracting all indexed messag

Bug#535162: maildir-utils: deleting messages is really slow

2009-06-30 Thread Norbert Preining
forwarded 535162 http://code.google.com/p/mu0/issues/detail?id=7 thanks On Di, 30 Jun 2009, Helmut Grohne wrote: > messages it should be cheaper to start with a fresh index from scratch. Agreed, it is a pain. I forwarded it upstream, but I don't see much activity there, so I am not overly optimis

Bug#535162: maildir-utils: deleting messages is really slow

2009-06-30 Thread Helmut Grohne
Package: maildir-utils Version: 0.4-2 Severity: wishlist I've got a Maildir hierarchy with about 50k mails. I tried to use mu-index to index this Maildir. Updating it after changes takes quite long especially after deleting messages. It also produces heavy disk io load. Deleting 500 messages make