#8 memory error

[soulis]

Hello,

I try to generate sitemap with access logs method.
When the script parses the log file, I take the errors as shown below:

Opened ACCESSLOG file: /home/[mysite]/logs/[logfile.gz]
Traceback (most recent call last):
File "sitemap_gen.py", line 2203, in ?
sitemap.Generate()
File "sitemap_gen.py", line 1775, in Generate
input.ProduceURLs(self.ConsumeURL)
File "sitemap_gen.py", line 1115, in ProduceURLs
for line in file.readlines():
File "/usr/local/lib/python2.4/gzip.py", line 414, in readlines
line = self.readline()
File "/usr/local/lib/python2.4/gzip.py", line 388, in readline
c = self.read(readsize)
File "/usr/local/lib/python2.4/gzip.py", line 225, in read
self._read(readsize)
File "/usr/local/lib/python2.4/gzip.py", line 277, in _read
uncompress = self.decompress.decompress(buf)
MemoryError

Can anyone help me with this?

thanks,
Soulis

[Nobody/Anonymous]

I have fixed sitemap_gen.py so it now does not consume enormous amount of memory and python does not die with MemoryError. Look here <a href="http://www.bashkirtsev.com/2009/05/14/sitemap/">http://www.bashkirtsev.com/2009/05/14/sitemap/</a>

[Nobody/Anonymous]

1