Hi All! There is a good news. ASSP successfully passed rebuild on fresh installation of Windows 2008 SP2 with all updates, Perl v5.14.2 with all modules updates and clean ASSP install Also I've tried to run rebuildspam at last ASSP 2.2.2 build 12174 and succeed.
It looks like some Microsoft update for Windows 2003 Server interfere with perl or some perl module causing access violation. It's a little strange cause I tried on 3 different server with Windows 2003 server installed and rebuildspam has failed on them with the same error. Best regards Alexander Shabalin From: Shabalin, Alexander Sent: Friday, June 22, 2012 11:20 AM To: 'Thomas Eckardt' Subject: Re: [Assp-test] Rebuild crashes perl Nope: The only thing assp says before die Jun-22-12 10:42:09 [Worker_10000] Error: MainThread stuck for 123 seconds after: MainLoop start poll Sockets - last debug step was: mainloop before restart check! And I think this is has done while DrWatson snapshotting crashed thread. BTW. After I stop Error Reporting Service ASSP has processed about 1000 spam mail and then died. I checked again and this time assp died immediately after rebuild starts. Rebuilddebug.txt says that is checked only 2 files. I've tried clean install on Windows 2008 SP2 x86 without any perl and system updates - successful rebuild. Today I'm plan to install all updated to the system then check again. After that I'll install updates on all perl modules and run rebuild once again. I'll mail results as soon as I have any results. Best regards Alexander Shabalin From: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Sent: Friday, June 22, 2012 9:03 AM To: Shabalin, Alexander Subject: Antwort: RE: Antwort: Re: [Assp-test] Rebuild crashes perl Alexander, please try the attached. There are no special settings required. An scheduler Bug is fixed, which could cause the crash - tell me if it works. Thomas Von: "Shabalin, Alexander" <ashaba...@jgl.ru> An: Thomas Eckardt <thomas.ecka...@thockar.com>, Datum: 21.06.2012 11:42 Betreff: RE: Antwort: Re: [Assp-test] Rebuild crashes perl ________________________________________ C:\>perl -e "use Digest::MD5; print Digest::MD5::md5_hex('abc');" 900150983cd24fb0d6963f7d28e17f72 C:\>perl -e "use Win32::Unicode;" C:\>perl -e "use Lingua::Stem::Snowball;" C:\>perl -e "use Lingua::Identify;" C:\>perl -e "use Lingua::StopWords;" I've tried to run perl assp.pl under my admin user with full access rights to assp and perl folders. No effect. I have a very little knowledge of perl. Maybe you can say what function is processing every mail so I add some output to console after every line to look where crash is happened. Best regards Alexander Shabalin -----Original Message----- From: Thomas Eckardt [mailto:thomas.ecka...@thockar.com] Sent: Wednesday, June 20, 2012 9:14 PM To: Shabalin, Alexander Subject: Antwort: Re: [Assp-test] Rebuild crashes perl >DrWatson says: Application exception occurred: App: C:\Perl\bin\perl.exe (pid=5708) When: 19.06.2012 @ 17:11:49.425 Exception number: c0000005 (access violation) Looks like the user has no permission to any of the required files in assp/ib or Perl 'c0000005 (access violation)' - or a XS file for a module is missing. The rebuild uses the following modules: Digest::MD5 Win32::Unicode Lingua::Stem::Snowball Lingua::Identify Lingua::StopWords BerkeleyDB or DB_File File::Copy IO::Handle IO::Socket Encode warnings Because the crash appears at file access, I think 'Digest::MD5' could be the reason - assp calculates a MD5 hash for each mail body to identify identical mails. But also any of Win32::Unicode Lingua::Stem::Snowball Lingua::Identify Lingua::StopWords could cause the crash. You can disable any or all of the above modules, except 'Digest::MD5' - this is part of the base Perl distro and must be available! check with : perl -e "use Digest::MD5; print Digest::MD5::md5_hex('abc');" C:\>perl -e "use Digest::MD5; print Digest::MD5::md5_hex('abc');" 900150983cd24fb0d6963f7d28e17f72 C:\> Thomas Von: "Shabalin, Alexander" <ashaba...@jgl.ru> An: ASSP development mailing list <assp-test@lists.sourceforge.net>, Kopie: Victor Miasnikov <v...@tut.by>, Thomas Eckardt <thomas.ecka...@thockar.com> Datum: 20.06.2012 12:33 Betreff: Re: [Assp-test] Rebuild crashes perl Hi! I've tried to set ASSP_AFCDetectSpamAttachRe:= and have no positive result. I even tried to remove plugin from Plugins folder with no result. Clean install Perl v5.14.2, updating modules and clean install ASSP has the same effect - crash when rebuild starts. I'll try to install new virtual server with Windowd 2008 SP2 x32 and try again. I'll write down here in any case at the end or experiment. Also I've tried to disable SMTP as recommend Thomas and run perl assp.pl Console output: [skipped startup init and move to num] Jun-20-12 13:50:03 [Worker_10001] C:/assp/errors/spam Jun-20-12 13:50:03 [Worker_10001] File Count: 2 Jun-20-12 13:50:03 [Worker_10001] Processing... errors/spam with 2 files Jun-20-12 13:50:03 [Worker_10001] Ignore files older than Sep-24-09 13:50:03 in folder errors/spam Jun-20-12 13:50:03 [Worker_10001] Imported Files: 0 Jun-20-12 13:50:03 [Worker_10001] Finished in 1 second(s) Jun-20-12 13:50:03 [Worker_10001] C:/assp/errors/notspam Jun-20-12 13:50:03 [Worker_10001] File Count: 2 Jun-20-12 13:50:03 [Worker_10001] Processing... errors/notspam with 2 files Jun-20-12 13:50:03 [Worker_10001] Ignore files older than Sep-24-09 13:50:03 in folder errors/notspam Jun-20-12 13:50:03 [Worker_10001] Imported Files: 0 Jun-20-12 13:50:03 [Worker_10001] Finished in 1 second(s) Jun-20-12 13:50:03 [Worker_10001] C:/assp/spam Jun-20-12 13:50:03 [Worker_10001] File Count: 9,926 Jun-20-12 13:50:03 [Worker_10001] Processing... spam with 9,926 files C:\assp> ---------- rebuilddebug.txt output: Jun-20-12 13:50:03 C:/assp/errors/spam Jun-20-12 13:50:03 File Count: 2 Jun-20-12 13:50:03 Processing... errors/spam with 2 files Jun-20-12 13:50:03 ignore files older than Sep-24-09 13:50:03 in folder errors/spam Jun-20-12 13:50:03 Imported Files: 0 Jun-20-12 13:50:03 Finished in 1 second(s) Jun-20-12 13:50:03 C:/assp/errors/notspam Jun-20-12 13:50:03 File Count: 2 Jun-20-12 13:50:03 Processing... errors/notspam with 2 files Jun-20-12 13:50:03 ignore files older than Sep-24-09 13:50:03 in folder errors/notspam Jun-20-12 13:50:03 Imported Files: 0 Jun-20-12 13:50:03 Finished in 1 second(s) Jun-20-12 13:50:03 C:/assp/spam Jun-20-12 13:50:03 File Count: 9,926 Jun-20-12 13:50:03 Processing... spam with 9,926 files Jun-20-12 13:50:09 file (1): C:/assp/spam/1.eml Best regards Alexander Shabalin From: Victor Miasnikov [mailto:v...@tut.by] Sent: Wednesday, June 20, 2012 11:50 AM To: Thomas Eckardt Cc: Shabalin, Alexander Subject: Fw: ASSP v2.2.2(12169) Fw: Re: ASSP_AFCDetectSpamAttachRe:= Re: Try turn off new feature ( . . .) related with calculation md5 sum. of attachment[s] ( primary images, .pdf , .zip ) Re: [ Assp - test ] Rebuild crashes perl Fw: 27968-47007 [Worker_1] Hi! > Then all other files one by one. And perl is going down after each file. This can be related ASSP_AFCDetectSpamAttachRe ? Best regards, Victor Miasnikov Blog: http://vvm.blog.tut.by/ ----- Original Message ----- From: "Victor Miasnikov" vvm (at) tut.by To: "Shabalin, Alexander" Sent: Wednesday, June 20, 2012 10:42 AM Subject: ASSP v2.2.2(12169) Fw: Re: ASSP_AFCDetectSpamAttachRe:= Re: Try turn off new feature ( . . .) related with calculation md5 sum. of attachment[s] ( primary images, .pdf , .zip ) Re: [ Assp - test ] Rebuild crashes perl Hi! > Jun-19-12 20:40:03 Processing... spam with 9,926 files > Jun-19-12 20:40:09 file (1): C:/assp/spam/0.eml > > After deleting 0.eml I've getting the same with the next file > > Jun-19-12 20:45:48 Processing... spam with 9,926 files > Jun-19-12 20:45:54 file (1): C:/assp/spam/1.eml > > Then all other files one by one. And perl is going down after each file. Please, check this in Youre enviroment: == try ASSP_AFCDetectSpamAttachRe:= ( this turn off "Check .MD5 of .img" ) == == After I set ASSP_AFCDetectSpamAttachRe:= rebuildspam stopped crashed == See in P.P.S. Best regards, Victor Miasnikov Blog: http://vvm.blog.tut.by/ > PS. Sorry for my poor English. Donn't worry: Normal English :-) ----- Original Message ----- From: "Shabalin, Alexander" To: "ASSP development mailing list" Sent: Tuesday, June 19, 2012 8:32 PM Subject: Re: [Assp-test] Rebuild crashes perl > Jun-19-12 20:40:03 Processing... spam with 9,926 files > Jun-19-12 20:40:09 file (1): C:/assp/spam/0.eml > > After deleting 0.eml I've getting the same with the next file > > Jun-19-12 20:45:48 Processing... spam with 9,926 files > Jun-19-12 20:45:54 file (1): C:/assp/spam/1.eml > > Then all other files one by one. And perl is going down after each file. > > > Best regards > Alexander Shabalin P.P.S. ----- Original Message ----- From: "Victor Miasnikov" vvm (at) tut.by To: "Grayhat"Sent: Friday, March 02, 2012 5:38 PM Subject: Re: ASSP_AFCDetectSpamAttachRe:= Re: Try turn off new feature ( . .. .) related with calculation md5 sum. of attachment[s] ( primary images, ..pdf , .zip ) Re: [Assp-test] fixes in assp 2.1.2 build 12058 . . . After I set ASSP_AFCDetectSpamAttachRe:= rebuildspam stopped crashed Please, check this in Youre enviroment Best regards, Victor Miasnikov Blog: http://vvm.blog.tut.by/ ----- Original Message ----- From: "Grayhat" To: "Victor Miasnikov" vvm (at) tut.by Sent: Friday, March 02, 2012 5:22 PM Subject: Re: ASSP_AFCDetectSpamAttachRe:= Re: Try turn off new feature ( . .. .) related with calculation md5 sum. of attachment[s] ( primary images, ..pdf , .zip ) Re: [Assp-test] fixes in assp 2.1.2 build 12058 > >> ASSP_AFCDetectSpamAttachRe:= > > No such a thing; as I wrote, I *removed* the plugings (stopped ASSP, > renamed them from ".pm" to ".pm.bak") so ASSP doesn't even load them > and there's NO trace of them in the assp.cfg file; again, I suspect > it's something *inside* ASSP; probably some branch path related to > HMM (even if it's disabled) -- ----- Original Message ----- From: "Victor Miasnikov" vvm (at) tut.by To: "Colin"; "ASSP development mailing list" Sent: Friday, February 03, 2012 10:16 AM Subject: 1) Try turn off .Check .MD5 of .img by set ASSP_AFCDetectSpamAttachRe:= Y) Turn on debug Z) problem not related unicode_in_filenames feature? Or related? Re: [Assp-test] Rebuildspamdb problems . . . > Where ASSP fails, the ASSP process just stops running. > No errors, no dumps or anything. > My monitoring script detects this and starts ASSP back up again. If ASSP_AFCDetectSpamAttachRe:=image\/ try ASSP_AFCDetectSpamAttachRe:= ( this turn off "Check .MD5 of .img" ) . . . Best regards, Victor Miasnikov ----- Original Message ----- From: "Thomas Eckardt" <thomas.ecka...@thockar.com> To: "Victor Miasnikov" <v...@tut.by> Sent: Thursday, April 19, 2012 3:04 PM Subject: Antwort: $webAdminPort = _ _ ; {= Douglas Fraser : this covers the situation where $webAdminPort has both a IP address and a port number Fw: [Assp-user] Reporting a bug? Fw: 27968-47007 [Worker_1] . . . _ DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* DISCLAIMER: ******************************************************* This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the individual to whom it is addressed. This email was multiple times scanned for viruses. There should be no known virus in this email! ******************************************************* ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test