[Dovecot] Solr's index update

2009-03-31 Thread Rui Carneiro
Hi all, In the wiki says this: "Currently the indexes are updated only while searching" @ http://wiki.dovecot.org/Plugins/FTS This also is applied to Solr Indexes? If not, when Solr Indexes are updated? Thank you, Rui Carneiro -- mail: rui@gmail.com, rui.carne...@portugalmail.n

Re: [Dovecot] Solr's index update

2009-03-31 Thread Rui Carneiro
On Tue, Mar 31, 2009 at 5:10 PM, Timo Sirainen wrote: > On Mar 31, 2009, at 11:25 AM, Rui Carneiro wrote: > > Hi all, >> >> In the wiki says this: "Currently the indexes are updated only while >> searching" @ http://wiki.dovecot.org/Plugins/FTS >&

Re: [Dovecot] Solr's index update

2009-03-31 Thread Rui Carneiro
On Tue, Mar 31, 2009 at 7:28 PM, Timo Sirainen wrote: > On Tue, 2009-03-31 at 19:21 +0100, Rui Carneiro wrote: > > Another question. I read this on the TODO list: > > > > fts-solr: handle DELETE, RENAME > > > > I am interested to look deeper on this. Any start

[Dovecot] Compile and configure Solr plugin

2009-04-07 Thread Rui Carneiro
turned 89 Fatal: Invalid configuration in /etc/dovecot/dovecot.conf I'm missing some steps in this installation for sure, do anyone have any clue? Thanks, Rui Carneiro

Re: [Dovecot] Compile and configure Solr plugin

2009-04-07 Thread Rui Carneiro
Hi all, I already find the problem. I was trying to compile and install Dovecot with a previous (I didn't know about it) installed version from Ubuntu repositories. I removed the installed version and now it works just fine. Sorry about the spam :P Regards, Rui Carneiro On Tue, Apr 7, 20

Re: [Dovecot] auth-master: Permission denied [sigh]

2009-04-12 Thread Rui Carneiro
Hi, I was having problems with permissions on auth-master too. I solve them creating manually the folder /var/run/dovecot with correct permissions but i see you already did that :\ On Sun, Apr 12, 2009 at 5:27 PM, James Butler wrote: > I've been messing with this for too long, now, and I'm blind

[Dovecot] FTS Plugin design

2009-04-13 Thread Rui Carneiro
x27;s design and how the plugins are called from the core system and I was wondering if anyone could help me with that. Sorry if this doubts sound stupid but I am newcomer on Dovecot. Regards, Rui Carneiro

Re: [Dovecot] FTS Plugin design

2009-04-17 Thread Rui Carneiro
d was feeded correctly with all attachment lines. I don't know if this is related with the value of MESSAGE_PART_FLAG_ATTACHMENT or if I am missing something (like setting block.hdr = NULL or some more code to handle new flags). Thank you, Rui Carneiro On Wed, Apr 15, 2009 at 11:23 PM, Timo Sirai

Re: [Dovecot] FTS Plugin design

2009-04-20 Thread Rui Carneiro
Hi, The problem was on the flag. My hexa to binary conversions was wrong. Regards, Rui Carneiro On Fri, Apr 17, 2009 at 10:03 AM, Rui Carneiro wrote: > Thank you for all tips. The design look more clear to me now. > > I have one more question. I looked into fts_build_want_index_par

Re: [Dovecot] FTS Plugin design

2009-04-21 Thread Rui Carneiro
Hi again, Anyone know some good libraries to handle the content of files like pdf, ppt, doc, etc? I am already indexing attachments all I need now is extract the text of them. Regards, Rui Carneiro On Mon, Apr 20, 2009 at 3:29 PM, Rui Carneiro wrote: > Hi, > > The problem was on the

Re: [Dovecot] FTS Plugin design

2009-04-21 Thread Rui Carneiro
Great idea! I will give news soon. On Tue, Apr 21, 2009 at 5:32 PM, Timo Sirainen wrote: > I've no idea, but you could at least look at some of the other full text > search engines. I remember them advertising indexing support for all kinds > of formats. Maybe they're using some specific librar

Re: [Dovecot] FTS Plugin design

2009-04-22 Thread Rui Carneiro
accept input from stdin (we need to create temporary files). What approach would be better? Using applications like pdftotext and catdoc or, on the other hand, use their libraries and do it almost from scratch? Regards Rui Carneiro On Tue, Apr 21, 2009 at 5:52 PM, Rui Carneiro wrote: > Gr

Re: [Dovecot] FTS Plugin design

2009-04-22 Thread Rui Carneiro
as much as generic I can for possible improvements in the future. Regards, Rui Carneiro

Re: [Dovecot] FTS Plugin design

2009-04-23 Thread rui . carneiro
somewhere anyway). [1] Notably PDF has some index tables at EOF - 1k if I remember correctly. I hadn't thought on that before but I think you are right. The only question here is writing data to memory or hd. Thank you all, Rui Carneiro -- Portugalmail, Comunicações S.A. www.portugalmail.net

Re: [Dovecot] fts-solr plugin issue (Marked invalid)

2009-05-04 Thread Rui Carneiro
c and look to the functions that communicate with Solr and change the error handling. I think this "miss feature" will be useful to me soon. Rui Carneiro -- Portugalmail, Comunicações S.A. www.portugalmail.net PS: Sorry but my current knowledge on this is not very much at the moment.

Re: [Dovecot] fts-solr plugin issue (Marked invalid)

2009-05-04 Thread Rui Carneiro
I do not have sure if I understood your problem correctly. Are you trying to index attachments from messages? Or Dovecot is indexing some "bad" parts and you just do not know why? Regards, Rui Carneiro -- Portugalmail, Comunicações S.A. www.portugalmail.net Citando Nikolai Derzh

Re: [Dovecot] FTS Plugin design

2009-05-05 Thread Rui Carneiro
e.g. fts_build_mail()) and send all in once to FTS backend? I hope I've made myself clear. Regards, Rui Carneiro -- Portugalmail, Comunicações S.A. www.portugalmail.net

Re: [Dovecot] FTS Plugin design

2009-05-15 Thread Rui Carneiro
also make it possible to pretty easily modify > in future to not write temporary files for specific content types if > it's not required. > I tried your approach and I think it is working pretty well. Now I only need to look carefully to the output of external programs and build th

Re: [Dovecot] FTS Plugin design

2009-05-18 Thread Rui Carneiro
why files are getting corrupted? Thank you, Rui Carneiro -- Portugalmail, Comunicações S.A. www.portugalmail.net

Re: [Dovecot] FTS Plugin design

2009-05-18 Thread Rui Carneiro
lock.data just before fts_backend_build_more() and the value is EF (the correct one would be E2). I think binary data is being corrupted anywhere before fts_backend_build_more() and I don't have any idea where. Any help would be appreciated. Thank you, Rui Carneiro -- Port

Re: [Dovecot] FTS Plugin design

2009-05-19 Thread Rui Carneiro
e any charset defined on headers so, by default, charset_utf8=1 and charset_trans is garbage (I have no idea where that garbage came from). To avoid this problem swap the some lines of code that set ctx->binary_input to the function's beginning. Please see the attachment to checked any problem

Re: [Dovecot] FTS Plugin design

2009-05-19 Thread Rui Carneiro
On Tue, May 19, 2009 at 8:51 PM, Timo Sirainen wrote: > You forgot the attachment. > Oh Sorry, I am not at the office now (almost 10pm here) I will send it tomorrow morning. Rui Carneiro --- Portugalmail, Comunicações S.A. www.portugalmail.net

Re: [Dovecot] FTS Plugin design

2009-05-20 Thread Rui Carneiro
Now, with attachment. /* Copyright (c) 2006-2009 Dovecot authors, see the included COPYING file */ #include "lib.h" #include "buffer.h" #include "base64.h" #include "str.h" #include "unichar.h" #include "charset-utf8.h" #include "quoted-printable.h" #include "rfc822-parser.h" #include "rfc2231-par

Re: [Dovecot] FTS Plugin design

2009-05-22 Thread Rui Carneiro
bigger than this value the fts-plugin crash. There is anything in your TODO-List that solves this problem? Regards, Rui Carneiro PS: asap I will send you my code for your approval :) -- Portugalmail, Comunicações S.A. www.portugalmail.net

Re: [Dovecot] FTS Plugin design

2009-05-22 Thread Rui Carneiro
vecot didn't crash. It's Friday and I will not be able to do the gdb backtrace on weekend but it will be the first thing I will do Monday morning. Regards, Rui Carneiro -- Portugalmail, Comunicações S.A. www.portugalmail.net

Re: [Dovecot] FTS Plugin design

2009-05-25 Thread Rui Carneiro
Citando Timo Sirainen : > I guess it works around some other bug then. If it's a memory-related > bug you could also see if valgrind complains something: > > protocol imap { > .. > mail_executable = /usr/bin/valgrind /usr/local/libexec/dovecot/imap > } Here is the output (I cloned the http://

Re: [Dovecot] FTS Plugin design

2009-05-26 Thread Rui Carneiro
lper /usr/local/libexec/dovecot/imap The crash occurs after indexing all stuff and when imap is returning the result. Thank you, Rui Carneiro -- Portugalmail, Comunicações S.A. www.portugalmail.net

Re: [Dovecot] FTS Plugin design

2009-05-26 Thread Rui Carneiro
the code. Thank you for all the support! Regards, Rui Carneiro -- Portugalmail, Comunicações S.A. www.portugalmail.net

[Dovecot] Solr Plugin make only INBOX able to search

2009-08-19 Thread rui . carneiro
search text " the result is always empty. I tried TEXT, SUBJECT and BODY arguments and none of them returned any email. Any idea of the problem's source? Regards, Rui Carneiro

Re: [Dovecot] Solr Plugin make only INBOX able to search

2009-09-07 Thread rui . carneiro
Hi again, Anyone could help me?

Re: [Dovecot] FTS Plugin design

2009-09-08 Thread rui . carneiro
7;s name what is not correct. Now I am trying to find a way to know the mime part id of the parts used on fts_build_mail. Is that already possible or I need to do that by my own? Thank you in advance, Rui Carneiro

Re: [Dovecot] Solr Plugin make only INBOX able to search

2009-09-14 Thread Rui Carneiro
On Mon, Sep 14, 2009 at 2:54 AM, Timo Sirainen wrote: > Hmm. Seems to work here: > > x create "Test Folder" > x OK Create completed. > x copy 1:* "Test Folder" > x OK [COPYUID 1251759136 20163:20174 1:12] Copy completed. > x search text multiple > * SEARCH 1 > x OK Search completed (0.000 secs).

Re: [Dovecot] Solr Plugin make only INBOX able to search

2009-09-23 Thread Rui Carneiro
On Mon, Sep 14, 2009 at 2:54 AM, Timo Sirainen wrote: > > BTW. Note that Solr schema file was changed a bit to use less disk > space. But that shouldn't have caused this kind of a bug. The problem is caused by my custom schema. My changes are breaking the search someway. Thank you Timo. >