Menu
▾
▴
Re: [Assp-user] SpamDB rebuild dies
|
From: Jay <he...@he...> - 2015-10-22 19:17:43
|
Good Day Thomas. So I have further information from the command line: perl.exe *32 this time died at 1.82GB ram usage in the taskmanager. Here's the last 2 lines in the command window when perl.exe disappeared from the taskmanager: Oct-22-15 15:08:00 [Worker_5] Disconnected: session:705DDD84 104.206.121.4 - pro cessing time 1 seconds Error in my_thread_global_end(): 10 threads didn't exit So this would lead me to believe that perl for some reason just drops off unexpectedly. Here's a few lines from the rebuildrun.txt and rebuilddebug.txt: Rebuildrun.txt: Oct-22-15 14:53:23 C:/ASSP/notspam Oct-22-15 14:53:24 File Count: 94,245 Oct-22-15 14:53:24 Processing... notspam with 21,000 files Oct-22-15 14:54:03 ignore and remove files older than Sep-21-15 14:53:23 in folder notspam RebuildDebugr.txt: Oct-22-15 15:08:05 file (9533)[0]: C:/ASSP/notspam/14692--4655619.eml Oct-22-15 15:08:05 file (9534)[0]: C:/ASSP/notspam/4894--4655620.eml Oct-22-15 15:08:05 file (9535)[0]: C:/ASSP/notspam/8649--4655618.eml Oct-22-15 15:08:05 file (9536)[0]: C:/ASSP/notspam/19865--4655617.eml Oct-22-15 15:08:05 file (9537)[0]: C:/ASSP/notspam/3469--4655615.eml Oct-22-15 15:08:05 file (9538)[0]: C:/ASSP/notspam/11129--4655614.eml On 10/22/2015 11:06 AM, Jay wrote: > Good day Thomas. > > We don't use the BerkleyDB. UseBerkleyDB is off and useDB4Rebuild is off. > > Last section in rebuildrun.txt: > Oct-20-15 17:02:44 c:/assp/notspam > Oct-20-15 17:02:45 File Count: 88,069 > Oct-20-15 17:02:45 Processing... notspam with 21,000 files > Oct-20-15 17:03:23 ignore and remove files older than Sep-19-15 > 17:02:44 in folder notspam > > I already have a rebuilddebug.txt file in place. Here's the last section: > Oct-20-15 17:08:48 file (4122)[0]: c:/assp/notspam/1098--4653603.eml > Oct-20-15 17:08:48 1 ham-attachment/image entries processed in file > c:/assp/notspam/1098--4653603.eml > > I will run ASSP in cmd line mode and see what displays in the cmd > window. Hopefully it will give me a clue as to what is causing this. > Do you think General Debug Mode /(debug)/ <javascript:void(0);> might > be useful here as well? > > I appreciate the advice and help. Thank you. > > > On 10/22/2015 3:56 AM, Thomas Eckardt wrote: >> - is the Perl module BerkeleyDB installed ? >> - is 'useDB4Rebuild' set to on ? >> >> - start assp interactive (cmd) - start the rebuild - the last lines >> in the >> cmd windows may show the reason >> - have a look in to rebuildrun.txt - what is the last line logged >> there ? >> - in addition you may enable the debug output of the rebuild task >> (create >> the file rebuilddebug.txt) >> >>> It seems to die around 1.8GB >> the 4GB limit is imposed for the value of 'physical + virtual' memory ! >> >>> I do have a memory limit set in ASSP but I have >>> that set to 3096mb which would be 3GB of ram. >> While the rebuild is running, the internal memory usage check is >> switched >> off. >> >> Thomas >> >> >> >> >> >> Von: Jay <he...@he...> >> An: For Users of ASSP <ass...@li...> >> Datum: 21.10.2015 21:13 >> Betreff: [Assp-user] SpamDB rebuild dies >> >> >> >> So I have a weird issue happening all of the sudden. We are using ASSP >> version 2.4.5(15162) and I have RebuildSchedule set for a 6am rebuild >> everyday on our Windows mail server. We are running a 64bit version of >> Windows 7 on our mail server and use the 32bit version of Perl >> 5.16.3(1604). The server itself is using a Core i7 3.4GHz processor and >> 16GB of ram. There are some days when the rebuild finishes fine but most >> days it seems the rebuild just dies in the middle of it and never >> finishes. It even happens when I kick the rebuild off manually. >> >> So today I kicked off the rebuild manually through the email interface >> on the server and watched the task manager to see where the rebuild >> would die. It seems to die around 1.8GB of ram the Perl 32 just drops >> off the task manager. I do have a memory limit set in ASSP but I have >> that set to 3096mb which would be 3GB of ram. Looking at my ASSP log >> file there is no indication that ASSP is restarting at all (which it >> shouldn't be yet) and the log just stops when Perl died which is to be >> expected. I have to start the ASSP service back up again. Any idea if >> Perl has a memory usage upper limit? I know being 32bit a 4GB limit is >> imposed on any 32bit application but I am not even getting close to >> that. >> >> I checked the version of all the modules I have active on the server in >> ASSP and either they are the same version that is required or higher in >> some cases. Anyone else run into a similar situation with this? I >> checked through my system logs and nothing there is indicating an issue >> anywhere. We use MySQL for our spamdb and hmmdb. >> >> Thank you ahead of time for any input/advice. I appreciate it. >> >> >> >> ------------------------------------------------------------------------------ >> >> _______________________________________________ >> Assp-user mailing list >> Ass...@li... >> https://lists.sourceforge.net/lists/listinfo/assp-user >> >> >> >> >> >> >> DISCLAIMER: >> ******************************************************* >> This email and any files transmitted with it may be confidential, >> legally >> privileged and protected in law and are intended solely for the use >> of the >> >> individual to whom it is addressed. >> This email was multiple times scanned for viruses. There should be no >> known virus in this email! >> ******************************************************* >> >> >> >> >> ------------------------------------------------------------------------------ >> >> >> >> _______________________________________________ >> Assp-user mailing list >> Ass...@li... >> https://lists.sourceforge.net/lists/listinfo/assp-user >> >> >> ----- >> No virus found in this message. >> Checked by AVG - www.avg.com >> Version: 2015.0.6173 / Virus Database: 4450/10870 - Release Date: >> 10/22/15 > > > > > ------------------------------------------------------------------------------ > > > _______________________________________________ > Assp-user mailing list > Ass...@li... > https://lists.sourceforge.net/lists/listinfo/assp-user > > > ----- > No virus found in this message. > Checked by AVG - www.avg.com > Version: 2015.0.6173 / Virus Database: 4450/10870 - Release Date: 10/22/15 |
