[MlMt] Memory usage
I have been looking at the memory usage of mailmate throughout the years. I have concluded it "uses lots of memory". I have four imap accounts where specifically one have lots of messages. In total I have 2.988.939 messages, and MailMate eats 4.34GByte of memory about half an hour after starting. I tested for the first time Mail Mate on a MacMini with 8G RAM, and after adding the accounts it was up to 8.5G of RAM. As I know MailMate eats lot when booting a new machine (leak somewhere), I restarted it and it is about 3.34GB directly after launch. A bit too much on a host with 8G...so I do not think I will swap hardware just yet. Question, have anyone of you like myself had issues with memory and looked into what might causing it? Any strategies for using less memory? [too many virtual mailboxes] Patrik signature.asc Description: OpenPGP digital signature ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 11 May 2021, at 9:10, Patrik Fältström via mailmate wrote: > I have 2.988.939 messages Jag är imponerad !! ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
2021-05-11 kl 12:22 skrev Jan Erik Moström: > On 11 May 2021, at 9:10, Patrik Fältström via mailmate wrote: > >> I have 2.988.939 messages > > Jag är imponerad !! Instämmer! -- Thomas ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 11 May 2021, at 12:30, Thomas Grundberg wrote: > 2021-05-11 kl 12:22 skrev Jan Erik Moström: > >> On 11 May 2021, at 9:10, Patrik Fältström via mailmate wrote: >> >>> I have 2.988.939 messages >> >> Jag är imponerad !! > > Instämmer! This is one of the reasons I do use MailMate. It can handle that amount of messages with an impressive speed. If one have RAM that is ;-) Patrik signature.asc Description: OpenPGP digital signature ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 11 May 2021, at 9:10, Patrik Fältström via mailmate wrote: > Question, have anyone of you like myself had issues with memory and looked > into what might causing it? It's almost bound to be indexes. There will be indexes for the headers and presumably a full-text one as well. I would not be surprised with a 1:10 relation from index to total mail size, for the text parts (you'll see similar on a DB). Not sure if you can do anything about that but Benny's probably the only person in a position to know. Charlie -- Charlie Clark Waldlehne 23 Düsseldorf D- 40489 Tel: +49-203-3925-0388 Mobile: +49-178-782-6226 ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
[MlMt] Query on compose window layout
A recent update changed the layout of the compose window when using markdown. The rendered markdown output used to appear vertically in a pane below the input text, but now if rendered horizontally in a parallel pane. This uses a lot more screen real estate, so I much prefer the old layout. If there a hidden presence to change this back (I didn’t see anything in the compose tab of Mailmate preferences). Thanks for any clue. DaveO ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Query on compose window layout
On 11 May 2021, at 13:58, David R. Oran wrote: A recent update changed the layout of the compose window when using markdown. The rendered markdown output used to appear vertically in a pane below the input text, but now if rendered horizontally in a parallel pane. This uses a lot more screen real estate, so I much prefer the old layout. Try View -> Layout -> "Preview at Bottom" / "Preview at Right". :-) Kind regards, Tobias Jung ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Query on compose window layout
On 11 May 2021, at 8:13, Tobias Jung wrote: > On 11 May 2021, at 13:58, David R. Oran wrote: > >> A recent update changed the layout of the compose window when using >> markdown. The rendered markdown output used to appear vertically in a pane >> below the input text, but now if rendered horizontally in a parallel pane. >> This uses a lot more screen real estate, so I much prefer the old layout. > > Try View -> Layout -> "Preview at Bottom" / "Preview at Right". > :-) > Ah, I didn’t realize that view/layout was different for main and compose windows. Didn’t think to try it when a compose window was up. Thanks! > Kind regards, > Tobias Jung > ___ > mailmate mailing list > mailmate@lists.freron.com > https://lists.freron.com/listinfo/mailmate DaveO ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
[MlMt] Migrating to Big Sur
To migrate MailMate from Sierra to Big Sur, I moved these folders to identical locations on the new hard boot drive by dragging and dropping in Finder: ~/Library/Application Support/MailMate (folder) ~/Library/Preferences/com.freron.MailMate.plist All copied. I then downloaded the latest daily MM beta and copied it to the Applications folder. After booting into Big Sur and launching MailMate, MM quit immediately and Terminal opened and spit out some errors errors. (Terminal purges previous output on Quit so those are gone for now. I’ll post what I see when I next boot BS and run MM.) Is my process correct? Thanks, Dave ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
[MlMt] Migrating to Big Sur
MM now launches and doesn’t quit immediately. When I am asked for accounts passwords, immediately after entering one I get an alert: “MailMate failed to save a file to disk. (/Users/macmini//Library/Application Support/MailMate/Messages/IMAP/[myemail address%40gmail@imap.gmail.con/State.plist_backup). Error: no such file or directory.” I copied the files (see below) from my previous daily-functioning MM install on my Sierra boot disk to the new Big Sur drive (the entire MM folder, not by opening the folder and selecting all files and dragging those). Any idea why I’m getting this error? Thanks, Dave macOS 11.3.1 Big Sur MailMate 1.14 - - - > To migrate MailMate from Sierra to Big Sur, I moved these folders to > identical locations on the new hard boot drive by dragging and dropping in > Finder: > > ~/Library/Application Support/MailMate (folder) > > ~/Library/Preferences/com.freron.MailMate.plist > > All copied. I then downloaded the latest daily MM beta and copied it to the > Applications folder. > > After booting into Big Sur and launching MailMate, MM quit immediately and > Terminal opened and spit out some errors errors. (Terminal purges previous > output on Quit so those are gone for now. I’ll post what I see when I next > boot BS and run MM.) > > Is my process correct? > > Thanks, > Dave ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Default format=flowed change in 5800?
Hi Benny, can you please address this question, as it has many of us puzzled? Thanks. -Eric On 7 May 2021, at 7:16, Philip Paeps wrote: > On 2021-05-03 21:43:18 (+0800), Pete Resnick wrote: >> Saw this in the release notes for Test Build 5800: >> >> - Changed: By default, MailMate no longer uses the format=flowed standard. >> For now, it can be enabled using MmFormatFlowedEnabled if needed/preferred. >> >> Why the change? There should be more format=flowed in the world, not less, >> IMO. > > I've been wondering about this change too. I know there are awkward > interactions between format=flowed and inline PGP (and possibly S/MIME) but > `MmFormatFlowedEnabled` seems a lot more useful to be default *on* rather > than default *off*. > > I did a `defaults write com.freron.MailMate MmFormatFlowedEnabled -bool true` > immediately after installing r5800. > > Philip > > -- > Philip Paeps > Senior Reality Engineer > Alternative Enterprises > ___ > mailmate mailing list > mailmate@lists.freron.com > https://lists.freron.com/listinfo/mailmate ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Migrating to Big Sur
On 2021-05-11 at 12:27:29 UTC-0400 (Tue, 11 May 2021 09:27:29 -0700) davecc is rumored to have said: MM now launches and doesn’t quit immediately. When I am asked for accounts passwords, immediately after entering one I get an alert: “MailMate failed to save a file to disk. (/Users/macmini//Library/Application Support/MailMate/Messages/IMAP/[myemail address%40gmail@imap.gmail.con/State.plist_backup). Error: no such file or directory.” I copied the files (see below) from my previous daily-functioning MM install on my Sierra boot disk to the new Big Sur drive (the entire MM folder, not by opening the folder and selecting all files and dragging those). Any idea why I’m getting this error? Most likely because ~/Library/Application Support/MailMate/Messages is (usually?) a symbolic link which points to the absolute full pathname of your actual message store and that path does not exist on the new system. If you had a "Custom Location" set for the Messages folder (in Preferences->General) you may be able to fix the problem by switching it off, restarting MM, and switching it back on. If you didn't have that set, you can recreate the default symlink with: ln -sfn ~/Library/Application\ Support/MailMate/Messages.noindex ~/Library/Application\ Support/MailMate/Messages Thanks, Dave macOS 11.3.1 Big Sur MailMate 1.14 - - - To migrate MailMate from Sierra to Big Sur, I moved these folders to identical locations on the new hard boot drive by dragging and dropping in Finder: ~/Library/Application Support/MailMate (folder) ~/Library/Preferences/com.freron.MailMate.plist All copied. I then downloaded the latest daily MM beta and copied it to the Applications folder. After booting into Big Sur and launching MailMate, MM quit immediately and Terminal opened and spit out some errors errors. (Terminal purges previous output on Quit so those are gone for now. I’ll post what I see when I next boot BS and run MM.) Is my process correct? If you had a "Custom Location" set for the Messages folder on the old system, that copy missed all of your messages. -- Bill Cole b...@scconsult.com or billc...@apache.org (AKA @grumpybozo and many *@billmail.scconsult.com addresses) Not Currently Available For Hire ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Migrating to Big Sur
Thanks Bill for your reply. Indeed that was the problem. I had checked the alias and suspecting it, “fixed” it myself (GetInfo>Original>let-monkey-loose-on-keyboard). I should have known better. All set up on Big Sur now and running smoothly. Many thanks. Dave - - - > Most likely because ~/Library/Application Support/MailMate/Messages is > (usually?) a symbolic link which points to the absolute full pathname of your > actual message store and that path does not exist on the new system. If you > had a "Custom Location" set for the Messages folder (in Preferences->General) > you may be able to fix the problem by switching it off, restarting MM, and > switching it back on. If you didn't have that set, you can recreate the > default symlink with: > > ln -sfn ~/Library/Application\ Support/MailMate/Messages.noindex > ~/Library/Application\ Support/MailMate/Messages ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
[MlMt] Memory usage
3 million messages ! Do you really need all of them actively online? If not, and you are just archiving them, with only the need for infrequent access, you might want to consider something like MailSteward. https://mailsteward.com/ I've been using it for over a decade, and it has never lost an email. That allows me to remove the email from my server, and keep significantly less than 3 million "on hand." (For three million messages, you'd want the full mySQL version.) T On 11 May 2021, at 9:00, mailmate-requ...@lists.freron.com wrote: > > -- > > Message: 1 > Date: Tue, 11 May 2021 09:10:32 +0200 > From: Patrik Fältström > To: MailMate Users > Subject: [MlMt] Memory usage > Message-ID: > Content-Type: text/plain; charset="utf-8" > > I have been looking at the memory usage of mailmate throughout the years. I > have concluded it "uses lots of memory". > > I have four imap accounts where specifically one have lots of messages. In > total I have 2.988.939 messages, and MailMate eats 4.34GByte of memory about > half an hour after starting. > ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 11 May 2021, at 19:49, Tracy Valleau wrote: > 3 million messages ! Do you really need all of them actively online? It is VERY convenient to be able to search over all of them :-) Btw, I do have a virtual folder which is "all messages last six months" and default search folder is that one. So I have by the use of virtual folders hidden most email from daily work. Very convenient. > If not, and you are just archiving them, with only the need for infrequent > access, you might want to consider something like MailSteward. > > https://mailsteward.com/ > > I've been using it for over a decade, and it has never lost an email. That > allows me to remove the email from my server, and keep significantly less > than 3 million "on hand." > > (For three million messages, you'd want the full mySQL version.) Thanks! Patrik > T > > On 11 May 2021, at 9:00, mailmate-requ...@lists.freron.com wrote: >> >> -- >> >> Message: 1 >> Date: Tue, 11 May 2021 09:10:32 +0200 >> From: Patrik Fältström >> To: MailMate Users >> Subject: [MlMt] Memory usage >> Message-ID: >> Content-Type: text/plain; charset="utf-8" >> >> I have been looking at the memory usage of mailmate throughout the years. I >> have concluded it "uses lots of memory". >> >> I have four imap accounts where specifically one have lots of messages. In >> total I have 2.988.939 messages, and MailMate eats 4.34GByte of memory about >> half an hour after starting. >> > ___ > mailmate mailing list > mailmate@lists.freron.com > https://lists.freron.com/listinfo/mailmate signature.asc Description: OpenPGP digital signature ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 11 May 2021, at 11:49, Tracy Valleau wrote: If not, and you are just archiving them, with only the need for infrequent access, you might want to consider something like MailSteward. https://mailsteward.com/ Interesting...I don't have that many messages, but I do have lots of stuff I like to keep archived, and right now that's in IMAP mailboxes. Going the MailSteward route—does that create a completely separate silo for archived messages, or is there some mechanism for being able to include those archived messages in a search from the mail client itself? ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 11 May 2021, at 15:23, Randall Meadows wrote: On 11 May 2021, at 11:49, Tracy Valleau wrote: If not, and you are just archiving them, with only the need for infrequent access, you might want to consider something like MailSteward. https://mailsteward.com/ Interesting...I don't have that many messages, but I do have lots of stuff I like to keep archived, and right now that's in IMAP mailboxes. Going the MailSteward route—does that create a completely separate silo for archived messages, or is there some mechanism for being able to include those archived messages in a search from the mail client itself? It will be a separate app and user interface, but it will be indexed for fast searching (and probably faster than the IMAP experience). Another option that has been mentioned frequently on this forum is [EagleFiler](https://c-command.com/eaglefiler/). Glenn P. Parker glenn.par...@comcast.net ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
[MlMt] Memory Usage (Mail Steward)
> Message: 2 > Date: Tue, 11 May 2021 12:28:33 -0400 > From: Eric Sharakan > To: Benny Kjær Nielsen > Cc: MailMate Users > Subject: Re: [MlMt] Default format=flowed change in 5800? > Message-ID: > Content-Type: text/plain; charset="utf-8" > > Hi Benny, can you please address this question, as it has many of us puzzled? > > Thanks. > > -Eric > > On 7 May 2021, at 7:16, Philip Paeps wrote: > >> On 2021-05-03 21:43:18 (+0800), Pete Resnick wrote: >>> Saw this in the release notes for Test Build 5800: >>> >>> - Changed: By default, MailMate no longer uses the format=flowed standard. >>> For now, it can be enabled using MmFormatFlowedEnabled if needed/preferred. >>> >>> Why the change? There should be more format=flowed in the world, not less, >>> IMO. >> >> I've been wondering about this change too. I know there are awkward >> interactions between format=flowed and inline PGP (and possibly S/MIME) but >> `MmFormatFlowedEnabled` seems a lot more useful to be default *on* rather >> than default *off*. >> >> I did a `defaults write com.freron.MailMate MmFormatFlowedEnabled -bool >> true` immediately after installing r5800. >> >> Philip >> >> -- >> Philip Paeps >> Senior Reality Engineer >> Alternative Enterprises >> ___ >> mailmate mailing list >> mailmate@lists.freron.com >> https://lists.freron.com/listinfo/mailmate > -- next part -- > An HTML attachment was scrubbed... > URL: > <http://lists.freron.com/pipermail/mailmate/attachments/20210511/9ad890d9/attachment-0001.htm> > > -- > > Message: 3 > Date: Tue, 11 May 2021 13:03:19 -0400 > From: "Bill Cole" > To: "MailMate Users" > Subject: Re: [MlMt] Migrating to Big Sur > Message-ID: > <1fda7a02-4a3c-4930-a6c0-1c7f89e1b...@billmail.scconsult.com> > Content-Type: text/plain; charset="UTF-8"; format=flowed > > On 2021-05-11 at 12:27:29 UTC-0400 (Tue, 11 May 2021 09:27:29 -0700) > davecc > is rumored to have said: > >> MM now launches and doesn’t quit immediately. >> >> When I am asked for accounts passwords, immediately after entering one >> I get an alert: >> >> “MailMate failed to save a file to disk. >> (/Users/macmini//Library/Application >> Support/MailMate/Messages/IMAP/[myemail >> address%40gmail@imap.gmail.con/State.plist_backup). Error: no such >> file or directory.” >> >> I copied the files (see below) from my previous daily-functioning MM >> install on my Sierra boot disk to the new Big Sur drive (the entire MM >> folder, not by opening the folder and selecting all files and dragging >> those). >> >> Any idea why I’m getting this error? > > Most likely because ~/Library/Application Support/MailMate/Messages is > (usually?) a symbolic link which points to the absolute full pathname of > your actual message store and that path does not exist on the new > system. If you had a "Custom Location" set for the Messages folder (in > Preferences->General) you may be able to fix the problem by switching it > off, restarting MM, and switching it back on. If you didn't have that > set, you can recreate the default symlink with: > > ln -sfn ~/Library/Application\ Support/MailMate/Messages.noindex > ~/Library/Application\ Support/MailMate/Messages > > > > >> >> Thanks, >> Dave >> macOS 11.3.1 Big Sur >> MailMate 1.14 >> >> - - - >> >>> To migrate MailMate from Sierra to Big Sur, I moved these folders >>> to identical locations on the new hard boot drive by dragging and >>> dropping in Finder: >>> >>> ~/Library/Application Support/MailMate (folder) >>> >>> ~/Library/Preferences/com.freron.MailMate.plist >>> >>> All copied. I then downloaded the latest daily MM beta and copied it >>> to the Applications folder. >>> >>> After booting into Big Sur and launching MailMate, MM quit >>> immediately and Terminal opened and spit out some errors errors. >>> (Terminal purges previous output on Quit so those are gone for now. >>> I’ll post what I see when I next boot BS and run MM.) >>> >>> Is my process correct? > > If you had a "Custom Location" set for the Messages folder on the old > system, that copy missed all of your messages. > > > > -- > Bill Cole > b...@scconsult.com or billc...@apache.org > (AKA @grump
Re: [MlMt] Default format=flowed change in 5800?
I looked into _format=flowed_ when Benny made this change to learn about it, and [this blog by Fastmail](https://fastmail.blog/advanced/format-flowed/) outlines some of the major concerns surrounding the standard. Mostly, it seems that it's not well (or consistently) supported. On Tue May 11, 2021 at 11:28 AM, Eric Sharakan wrote: > Hi Benny, can you please address this question, as it has many of us puzzled? > > Thanks. > > -Eric > > On 7 May 2021, at 7:16, Philip Paeps wrote: > >> On 2021-05-03 21:43:18 (+0800), Pete Resnick wrote: >>> Saw this in the release notes for Test Build 5800: >>> >>> - Changed: By default, MailMate no longer uses the format=flowed standard. >>> For now, it can be enabled using MmFormatFlowedEnabled if needed/preferred. >>> >>> Why the change? There should be more format=flowed in the world, not less, >>> IMO. >> >> I've been wondering about this change too. I know there are awkward >> interactions between format=flowed and inline PGP (and possibly S/MIME) but >> `MmFormatFlowedEnabled` seems a lot more useful to be default *on* rather >> than default *off*. >> >> I did a `defaults write com.freron.MailMate MmFormatFlowedEnabled -bool >> true` immediately after installing r5800. >> >> Philip >> >> -- >> Philip Paeps >> Senior Reality Engineer >> Alternative Enterprises >> ___ >> mailmate mailing list >> mailmate@lists.freron.com >> https://lists.freron.com/listinfo/mailmate > > ___ > mailmate mailing list > mailmate@lists.freron.com > https://lists.freron.com/listinfo/mailmate ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Default format=flowed change in 5800?
On 11 May 2021, at 17:04, m...@rhp.tw wrote: I looked into _format=flowed_ when Benny made this change to learn about it, and [this blog by Fastmail](https://fastmail.blog/advanced/format-flowed/) outlines some of the major concerns surrounding the standard. Mostly, it seems that it's not well (or consistently) supported. Ugh. That blog is from 2016, and has several errors: - Thunderbird has it on by default AFAICT. - Even if others don't support format=flowed, the message looks like a normal plain text message on the other end. No harm is done by supporting it. - The IETF uses plain text mailing lists and never asks for format=flowed to be disabled. I have no idea what lists would ask for such a thing or why it would cause any line wrapping problems, except for sending around code patches inline in the text instead of as an attachment. Even there, who doesn't hard-wrap code at 72 characters? (Maybe I'm old.) - The problem with HTML is not bloat, but the inability to edit replies reasonably. - You can use a regular HTML editor to implement; you simply have to be able to realize that the HTML produced only has quoting and nothing else and convert that to text/plain format=flowed. I've done that. It's not rocket science. - His last point seems to be that he has a hammer (Text::Autoformat) and therefore anything that is not a nail is a problem. Color me unimpressed. I am a big supporter of Benny's using Markdown and plain text as much as reasonably possible. I don't want that to go away. If more people would at least interpret format=flowed, the world would be a better place, IMO. pr -- Pete Resnick https://www.episteme.net/ All connections to the world are tenuous at best ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory Usage (Mail Steward)
> I can do a simple "search everything for the word "duh" regexp or something like it? randy ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory Usage (Mail Steward)
The interface is simple fill-in-the fields. I'd suggest visiting the application website, to take a look at it. They do a better job of introducing the app than I will. mailsteward.com Tracy On 11 May 2021, at 16:48, Randy Bush wrote: >> I can do a simple "search everything for the word "duh" > > regexp or something like it? > > randy ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 2021-05-11 at 07:17:25 UTC-0400 (Tue, 11 May 2021 13:17:25 +0200) Charlie Clark is rumored to have said: On 11 May 2021, at 9:10, Patrik Fältström via mailmate wrote: Question, have anyone of you like myself had issues with memory and looked into what might causing it? It's almost bound to be indexes. There will be indexes for the headers and presumably a full-text one as well. I would not be surprised with a 1:10 relation from index to total mail size, for the text parts (you'll see similar on a DB). MM's indices are much less efficient, due to their comprehensive coverage and the nature of email. 1:3.2 is the ratio on my primary machine. One reason for that is that MM indexes every email header it ever sees and many headers are very rare, but it is more significant that it maintains both case-preserving and case-squashed indices for body text and the most common headers, doubling the size of the largest index files. Not sure if you can do anything about that but Benny's probably the only person in a position to know. Benny has actually made substantial improvements in how MM manages memory over the past few years. It is much better about how much of the full index it loads at startup and while it does tend to load more over time, it doesn't behave as greedily as it used to, preventing OS memory compression and seemingly never using "purgeable" memory. If he has some user-accessible trick for reducing memory usage, he has kept it a secret despite multiple threads here on the issue. I suspect that the bottom-line summary is that high memory use is the unavoidable price of MailMate's ridiculously fast and flexible searching and smart mailbox functionality. There is no magical way around the fact that big data is big. -- Bill Cole b...@scconsult.com or billc...@apache.org (AKA @grumpybozo and many *@billmail.scconsult.com addresses) Not Currently Available For Hire ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
[MlMt] Search for anything in the headers
Hi, I had yesterday the need to search for a certain entry in a spam-report (which is in the headers), so that I have some mails that triggered the rule to figure something out about it. Is there any way to do this? I found only things like “common headers”. Any ideas how I can achieve that? Best Niels smime.p7s Description: S/MIME cryptographic signature ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 2021-05-11 15:10:32 (+0800), Patrik Fältström via mailmate wrote: I have been looking at the memory usage of mailmate throughout the years. I have concluded it "uses lots of memory". I have four imap accounts where specifically one have lots of messages. In total I have 2.988.939 messages, and MailMate eats 4.34GByte of memory about half an hour after starting. I tested for the first time Mail Mate on a MacMini with 8G RAM, and after adding the accounts it was up to 8.5G of RAM. As I know MailMate eats lot when booting a new machine (leak somewhere), I restarted it and it is about 3.34GB directly after launch. A bit too much on a host with 8G...so I do not think I will swap hardware just yet. Question, have anyone of you like myself had issues with memory and looked into what might causing it? Any strategies for using less memory? [too many virtual mailboxes] I'm a little behind you with "only" 2,451,756 messages and MailMate is unsurprisingly the biggest memory user on my computer too ... by a significant margin. The next process down is iTerm2 at 334.8M[*]. On my aarch64 Mac Mini with 16G memory, MailMate goes to 3.06G memory immediately after starting. On my MacBook Pro x86_64 laptop, it uses about 4.05G. I believe the configurations are mostly identical since I copied the Application Support directory from the laptop to the Mac Mini when I bought it and I can't remember making any changes on either machine. In the steady state, after about half a day of reading and typing email, MailMate sits around 4GB on my laptop (x86_64) and around 3.3G on my Mac Mini (aarch64). Previous discussions on this mailing list suggested virtual mailboxes contribute a lot to the memory footprint. More recently (September 2020), Benny also mentioned something about caching message views. I do all of my filtering with sieve server-side and only have a handful of virtual mailboxes. I wonder if the number of messages that a virtual mailbox matches contributes something to the memory footprint. You mention elsethread that you have a "all mail in the past six months" virtual mailbox and use it as your default search target. Could it be that MailMate keeps the index of that virtual mailbox in memory? That may be something worth poking at. Philip [*] I never paid attention to the memory usage of iTerm2. That's rather alarming. That's three times as much memory as Safari needs for a DuckDuckGo query about iTerm2's memory use! -- Philip Paeps Senior Reality Engineer Alternative Enterprises ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 2021-05-12 01:49:06 (+0800), Tracy Valleau wrote: 3 million messages ! Do you really need all of them actively online? I can't speak for Patrik but I find it a lot easier to simply keep them all "actively online" than to try to decide which ones to archive. Before I used MailMate, I rotated some of my larger mailboxes annually (and some more often) and it was a huge hassle (with ugly perl scripts) to find anything. If not, and you are just archiving them, with only the need for infrequent access, you might want to consider something like MailSteward. https://mailsteward.com/ I've been using it for over a decade, and it has never lost an email. That allows me to remove the email from my server, and keep significantly less than 3 million "on hand." (For three million messages, you'd want the full mySQL version.) If MailMate weren't so good (or didn't exist), I'd probably be all over this. :) This sounds great. Philip -- Philip Paeps Senior Reality Engineer Alternative Enterprises ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 12 May 2021, at 7:31, Philip Paeps wrote: > I do all of my filtering with sieve server-side and only have a handful of > virtual mailboxes. I wonder if the number of messages that a virtual mailbox > matches contributes something to the memory footprint. You mention > elsethread that you have a "all mail in the past six months" virtual mailbox > and use it as your default search target. Could it be that MailMate keeps > the index of that virtual mailbox in memory? That may be something worth > poking at. Good point. As most of my "old messages" are in separate physical mailboxes, I should not use virtual mailboxes to "filter them out", and that way decrease the number of virtual mailboxes. Specifically keep the number of email messages in virtual mailboxes to a minimum. Thanks for good ideas! Patrik signature.asc Description: OpenPGP digital signature ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
Re: [MlMt] Memory usage
On 12 May 2021, at 5:41, Bill Cole wrote: > Benny has actually made substantial improvements in how MM manages memory > over the past few years. Oh yes!!! > I suspect that the bottom-line summary is that high memory use is the > unavoidable price of MailMate's ridiculously fast and flexible searching and > smart mailbox functionality. There is no magical way around the fact that big > data is big. I understand the size of the indices. I only look at use of memory now. And yes, I do accept the price, but understand a 8G M1 is not really a machine for my mail and MailMate. Patrik signature.asc Description: OpenPGP digital signature ___ mailmate mailing list mailmate@lists.freron.com https://lists.freron.com/listinfo/mailmate
