[WM] Webmake performance

Oliver Strutynski olistrut.gmx.net
Thu Nov 21 14:10:07 GMT 2002


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Thursday 21 November 2002 12:07, Justin Mason wrote:
> Well, the idea is to save bandwidth as well -- by not changing the file,
> the file's modification date remains unchanged, so web caches and browsers
> using If-Modified-Since headers etc. will not invalidate it.

I see your point here. In my case however, the cache and the out files were
out of sync: There were no dependencies in the cache-db, so the files were
processed, but since the correct outfiles already existed, so new cache
information was written. Would it be an option to just re-write the cache-db
entry for a file if it already exists in the out directory and is not being
replaced? The performance hit should not be too big even when this happens
and for files that didn't change webmake should not even get to this point.

I also noticed that webmake is really sensitive to changes to the webmake file
while running webmake. When this accidentially happened webmake's dependency
checks (dep on webmake file) caused all file to be re-generated until I
deleted both the out-directory and the cache file.

> > [...]
> > Any way to work around that?
>
> no, afraid not... this code is a bit crufty these days.  Again this needs
> a solid rewrite some day soon...

Ok, I just removed the "if ($fname eq $SUBST_EVAL) {" check - I know this is
never an issue in my case, but of course that's not a general solution. Also
I removed some of the clean-options, I might look into other performance
issues if I find the time... I'm down to 8 seconds compared to 3 with my old
scripts on a set of 1000 (very small) files.

> as a matter of interest, is the "section" metadata stored in the files
> using <wmmeta>, or external to them using <metatable>?

Metadata is stored in the files and I don't see a way to move it to an
external file (it's just so much more convenient to edit metadata along with
the file).

Thanks again for your help!

Oliver

- --
_____________________________________________________________________
 Oliver Strutynski                       oliver.strutynski at in.tum.de
                                                    olistrut at gmx.net
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.6 (GNU/Linux)
Comment: For info see http://www.gnupg.org

iD8DBQE93VjyuUAlUEFqtKYRAlPLAJ40sFkbiOe9zMDn+uXvbWXX6hh8OwCg+HZw
H80aS6iexoJ9UfmjbPqN+ow=
=EA9i
-----END PGP SIGNATURE-----





More information about the Webmake-talk mailing list