Re: [Dovecot] Failed build with lucene plugin
Thank you. I'm using the FreeBSD, and clucene is 0.9. Now I'm try
compile 2.3.3.4 which's fails now, and then I'll try build the dovecot
with lucene plugin.
2012/5/22 Nick Rosier :
> Veniamin Gvozdikov wrote:
>>
>> Hi,
>>
>> I've tryed build dovecot with the lucene plugin but I have this is
>> output:
>>
>> /bin/sh ../../../libtool --tag=CXX --mode=compile c++
>> -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib
>> -I../../../src/lib-mail -I../../../src/lib-index
>> -I../../../src/lib-storage -I../../../src/plugins/fts
>> -I../../../src/doveadm -I/usr/local/include -I/usr/local/lib -O2
>> -pipe -fno-strict-aliasing -MT lucene-wrapper.lo -MD -MP -MF
>> .deps/lucene-wrapper.Tpo -c -o lucene-wrapper.lo lucene-wrapper.cc
>> libtool: compile: c++ -DHAVE_CONFIG_H -I. -I../../..
>> -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index
>> -I../../../src/lib-storage -I../../../src/plugins/fts
>> -I../../../src/doveadm -I/usr/local/include -I/usr/local/lib -O2 -pipe
>> -fno-strict-aliasing -MT lucene-wrapper.lo -MD -MP -MF
>> .deps/lucene-wrapper.Tpo -c lucene-wrapper.cc -fPIC -DPIC -o
>> .libs/lucene-wrapper.o
>> Assembler messages:
>> FATAL: can't create .libs/lucene-wrapper.o: Permission denied
>> lucene-wrapper.cc:24:36: error: CLucene/util/CLStreams.h: No such file
>> or directory
>> lucene-wrapper.cc:25:45: error: CLucene/search/MultiPhraseQuery.h: No
>> such file or directory
>> In file included from lucene-wrapper.cc:26:
>> SnowballAnalyzer.h:12: error: expected constructor, destructor, or
>> type conversion before '(' token
>> *** Error code 1
>> 1 error
>> *** Error code 1
>> 1 error
>> *** Error code 1
>> 1 error
>> *** Error code 1
>> 1 error
>
>
> Which platform/OS are you trying to compile on? Which version of CLucene?
> You need at version 2.3.3.4 (not 0.9) as stated on the Wiki
> (http://wiki2.dovecot.org/Plugins/FTS/Lucene)
>
> N.
--
Phone: +7 916 948 58 30
Site: http://zlonet.ru
Re: [Dovecot] Failed build with lucene plugin
Veniamin Gvozdikov wrote:
Thank you. I'm using the FreeBSD, and clucene is 0.9. Now I'm try
compile 2.3.3.4 which's fails now, and then I'll try build the dovecot
with lucene plugin.
You need to compile CLucene 2.3.3.4 with Clang. I've also tried with the
FreeBSD included compiler but it fails. The recent addition of
SOLR-support to the dovecot2 port was made by and at the request of me.
I would like to add lucene 2.3.3.4 to ports as well but don't know the
proper procedure and I also hesitate because it only compiles with
Clang. I've contacted the author of the original lucene port but haven't
received a reply.
Rgds,
N.
2012/5/22 Nick Rosier:
Veniamin Gvozdikov wrote:
Hi,
I've tryed build dovecot with the lucene plugin but I have this is
output:
/bin/sh ../../../libtool --tag=CXX--mode=compile c++
-DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib
-I../../../src/lib-mail -I../../../src/lib-index
-I../../../src/lib-storage -I../../../src/plugins/fts
-I../../../src/doveadm -I/usr/local/include -I/usr/local/lib -O2
-pipe -fno-strict-aliasing -MT lucene-wrapper.lo -MD -MP -MF
.deps/lucene-wrapper.Tpo -c -o lucene-wrapper.lo lucene-wrapper.cc
libtool: compile: c++ -DHAVE_CONFIG_H -I. -I../../..
-I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index
-I../../../src/lib-storage -I../../../src/plugins/fts
-I../../../src/doveadm -I/usr/local/include -I/usr/local/lib -O2 -pipe
-fno-strict-aliasing -MT lucene-wrapper.lo -MD -MP -MF
.deps/lucene-wrapper.Tpo -c lucene-wrapper.cc -fPIC -DPIC -o
.libs/lucene-wrapper.o
Assembler messages:
FATAL: can't create .libs/lucene-wrapper.o: Permission denied
lucene-wrapper.cc:24:36: error: CLucene/util/CLStreams.h: No such file
or directory
lucene-wrapper.cc:25:45: error: CLucene/search/MultiPhraseQuery.h: No
such file or directory
In file included from lucene-wrapper.cc:26:
SnowballAnalyzer.h:12: error: expected constructor, destructor, or
type conversion before '(' token
*** Error code 1
1 error
*** Error code 1
1 error
*** Error code 1
1 error
*** Error code 1
1 error
Which platform/OS are you trying to compile on? Which version of CLucene?
You need at version 2.3.3.4 (not 0.9) as stated on the Wiki
(http://wiki2.dovecot.org/Plugins/FTS/Lucene)
N.
Re: [Dovecot] Failed build with lucene plugin
On 22.5.2012, at 13.47, Nick Rosier wrote: > You need to compile CLucene 2.3.3.4 with Clang. I've also tried with the > FreeBSD included compiler but it fails. The recent addition of SOLR-support > to the dovecot2 port was made by and at the request of me. I would like to > add lucene 2.3.3.4 to ports as well but don't know the proper procedure and I > also hesitate because it only compiles with Clang. I've contacted the author > of the original lucene port but haven't received a reply. It would also be interesting to try if Dovecot would work with Lucene++: https://github.com/luceneplusplus/LucenePlusPlus CLucene people were planning on somehow merging the projects, but that doesn't seem to be happening very fast.
[Dovecot] fts_lucene crashing
I found this in mail.err. Anyone ever experience this? May 22 14:51:51 mba dovecot: imap(formulaire): Panic: file lucene-wrapper.cc: line 196: unreached May 22 14:51:51 mba dovecot: imap(formulaire): Error: Raw backtrace: /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(+0x4200a) [0x7f7e0edfd00a] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(+0x4204e) [0x7f7e0edfd04e] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7e0edd43c0] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(+0x850e) [0x7f7e0d57a50e] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(+0xa7be) [0x7f7e0d57c7be] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(+0xa952) [0x7f7e0d57c952] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(lucene_index_lookup+0x7b) [0x7f7e0d57ce0b] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(+0x73a7) [0x7f7e0d5793a7] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_backend_lookup+0x63) [0x7f7e0d98ece3] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xa32d) [0x7f7e0d99232d] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_search_lookup+0xa6) [0x7f7e0d992a26] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xba25) [0x7f7e0d993a25] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x27) [0x7f7e0f0c1957] -> dovecot/imap() [0x4158a7] -> dovecot/imap() [0x415c62] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xc4) [0x7f7e0ee09cd4] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x5b) [0x7f7e0ee0ac2b] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f7e0ee09998] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f7e0edf6233] -> dovecot/imap(main+0x285) [0x4086e5] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed) [0x7f7e0ea1f76d] -> dovecot/imap() [0x40885d] May 22 14:51:51 mba dovecot: imap(formulaire): Fatal: master: service(imap): child 32761 killed with signal 6 (core dumped) I get these errors very very often. When I look at lucene-wrapper.cc source code I see the following 196: if (uni_utf8_to_ucs4(str, &dest_arr) < 0) i_unreached(); Any ideas? -Joe
[Dovecot] sieve
Hi,
I'd like to keep all emails coming from alom-alert@anydomain and not
forward those but rest of the emails will be kept and forwarded as
well.
I put following in the .dovecot.sieve
if header :contains "Sender" "alom-alert@" {
keep;
if not header :contains "Sender" "alom-alert@" {
redirect "my@emailid on server";
redirect "x...@gmail.com";
redirect "a...@tbc.edu";
stop;
}
}
Is this correct?
Thanks,
UG
Re: [Dovecot] sieve
Upendra Gandhi wrote:
> I'd like to keep all emails coming from alom-alert@anydomain and not
> forward those but rest of the emails will be kept and forwarded as
> well.
>
> I put following in the .dovecot.sieve
>
> if header :contains "Sender" "alom-alert@" {
> keep;
> if not header :contains "Sender" "alom-alert@" {
> redirect "my@emailid on server";
> redirect "x...@gmail.com";
> redirect "a...@tbc.edu";
> stop;
> }
> }
You can find a list of available extensions in Dovecot wiki
http://wiki2.dovecot.org/Pigeonhole/Sieve
and include such extensions like this:
require ["fileinto","regex","vacation"];
The nesting of the curly brackets seems to be wrong:
The inner branch which should trigger the redirects
will never be reached, since it resides inside of the
bracket of condition 'if header :contains "Sender" "alom-alert@"'.
I'm thinking of something like this (without having checked syntax):
if header :contains "Sender" "alom-alert@" {
keep;
}
redirect "my@emailid on server";
redirect "x...@gmail.com";
redirect "a...@tbc.edu";
stop;
Regards,
Daniel
Re: [Dovecot] sieve
On Tue, May 22, 2012 at 3:37 PM, Daniel Parthey
wrote:
> Upendra Gandhi wrote:
>> I'd like to keep all emails coming from alom-alert@anydomain and not
>> forward those but rest of the emails will be kept and forwarded as
>> well.
>>
>> I put following in the .dovecot.sieve
>>
>> if header :contains "Sender" "alom-alert@" {
>> keep;
>> if not header :contains "Sender" "alom-alert@" {
>> redirect "my@emailid on server";
>> redirect "x...@gmail.com";
>> redirect "a...@tbc.edu";
>> stop;
>> }
>> }
>
> You can find a list of available extensions in Dovecot wiki
> http://wiki2.dovecot.org/Pigeonhole/Sieve
> and include such extensions like this:
> require ["fileinto","regex","vacation"];
>
> The nesting of the curly brackets seems to be wrong:
> The inner branch which should trigger the redirects
> will never be reached, since it resides inside of the
> bracket of condition 'if header :contains "Sender" "alom-alert@"'.
>
> I'm thinking of something like this (without having checked syntax):
>
> if header :contains "Sender" "alom-alert@" {
> keep;
> }
> redirect "my@emailid on server";
> redirect "x...@gmail.com";
> redirect "a...@tbc.edu";
> stop;
Thanks Daniel. It worked flawlessly. I didn't need to add require
statement, script worked even without it.
Re: [Dovecot] fts_lucene crashing
On 22.5.2012, at 22.44, Joe Beaubien wrote: > I found this in mail.err. Anyone ever experience this? > > May 22 14:51:51 mba dovecot: imap(formulaire): Panic: file > lucene-wrapper.cc: line 196: unreached Some search key (sent by client) wasn't valid UTF-8. I found one way of how it could happen, this fixes it: http://hg.dovecot.org/dovecot-2.1/rev/03ea2388bb27 If the crash still happens even after that, a gdb backtrace would be helpful: http://dovecot.org/bugreport.html
Re: [Dovecot] Berkeley DB with Dovecot
On Mon, May 21, 2012 at 02:37:28PM +0200, Sven Hartge wrote: > Jerry wrote: > > On Mon, 21 May 2012 06:14:10 -0400 Charles Marcus articulated: > >> Out of curiousity... > >> > >> How is the performance of SQLite? I'm assuming it is only > >> recommended for servers that are not under heavy load... SQLite support in Postfix is fairly young. I'm not sure about Dovecot, but again I doubt it has been around as long as real RDB systems. It hasn't existed as long as they have! 2000 May 29 was the initial Alpha release. In contrast, MySQL appeared in 1995, and PostgreSQL evolved in 1996 from a much older project. SQLite.org has a very old article where someone did some read and write benchmarking against MySQL and PostgreSQL. In those tests it did very well. This is what I'd expect, since there is nothing between the application and the database. The SQLite file will be cached in system RAM if it is frequently accessed, which in a moderate mail server, it certainly would be. I don't have a busy system, but I expect it could handle anything one might throw at it. > >> What are the main advantages/disadvantages of using SQLite > >> over MySQL? At this point there is no easy frontend for SQLite-managed mail servers. If you want to give a non-technical user the ability to manage accounts, at this point, you'd probably have to write a GUI interface. (That should not be a problem for a competent programmer in just about any language.) Being younger code, it is less well tested. If you recall, I stumbled upon a potentially serious bug in Postfix, fixed in 2.8.9 and 2.9.0. Poorly managed file permissions could have led to SQL injection attacks. (But Postfix does complain about it if the logs is not owned by and only writable by root.) SQLite.org has a good "when to use SQLite" page: http://sqlite.org/whentouse.html > > I found numerous links for just that sort of information on > > Google & Bing. These two seem rather informative. > > > http://stackoverflow.com/questions/2824135/how-fast-is-berkeley-db-sql-compared-to-sqlite > > http://www.oracle.com/technetwork/database/berkeleydb/learnmore/bdbvssqlite-wp-186779.pdf > > Hmm. > > Those documenets only talk about heavy writing to the database > which is not involved in the Dovecot scenario discussed here, where > the database is used as a data storage for the configuration which > is mostly read. Note that the same is true of BDB. I wouldn't expect SQLite to beat BDB on raw read speed, but I'd expect it to show respectably, as did the Oracle author (as he stated in the stackoverflow page.) SQLite might vary widely depending on the schema and SQL queries. BDB, OTOH, is not going to vary in that regard: it's only a Key-to- Value mapping. In comparing SQLite to BDB, I did optimize my own setup to reduce some of the multiple queries Postfix does. If a lookup of "user@domain" has no result, my queries also check for "domain", and that value would be returned. So it's possible that 3 simple BDB lookups are going to be beaten by 1-2 complex SQL queries in SQLite. > So the question, how fast SQLite is during read operations compared > to BDB is still unanswered. Indeed it is not. We need someone to do the testing. :) -- http://rob0.nodns4.us/ -- system administration and consulting Offlist GMX mail is seen only if "/dev/rob0" is in the Subject:
Re: [Dovecot] Berkeley DB with Dovecot
:2012-05-22T18:20:/dev/rob0: > > >> What are the main advantages/disadvantages of using SQLite > > >> over MySQL? Well the main one... You don't have a full blown RDBMS running which in my opinion is a waste of resources. Anyway I also have a SQLite based Dovecot and Exim setup. In case you care to take a look at my setup(note the php part is nowhere near done/complete or even tested): http://repo.or.cz/w/virtuo.git The shell frontend though works. -- Andraž 'ruskie' Levstik Source Mage GNU/Linux Games/Xorg grimoire guru Re-Alpine Coordinator http://sourceforge.net/projects/re-alpine/ Geek/Hacker/Tinker Ryle hira.
