gitpan / lcwa Goto Github PK

   _                    
  | | _____      ____ _ 
  | |/ __\ \ /\ / / _` |
  | | (__ \ V  V / (_| |
  |_|\___| \_/\_/ \__,_|
                        
  lcwa -- Last Changes Web Agent

  Version 1.0.4 (03-09-1997)

  LCWA is a web agent which determines the last changes time of documents in
  an Intranet's webcluster by crawling in a fast way through its webareas via
  HTTP.  It was written with speed in mind, so it uses a variable number of
  pre-forked crawling clients which work in parallel.  They are coordinated
  via a server which implements a shared URL stack and a common result pool.
  Each client first pops off an URL from the stack, retrieves the document,
  determines its last changes time and then sends it back to the result pool.
  Additionally if the currently fetched document is of type HTML, it parses
  out all hyperlinks it contains and pushes these back to the shared stack, so
  they can be processed the next time by itself or the other clients.

  The documentation and latest release can be found on
  http://www.engelschall.com/sw/lcwa/

  Copyright (c) 1997 Ralf S. Engelschall, All rights reserved.

  This program is free software; it may be redistributed and/or modified
  only under the terms of either the Artistic License or the GNU General
  Public License, which may be found in the distribution of this program.
  Look at the files ARTISTIC and COPYING.

  This program is distributed in the hope that it will be useful, but
  WITHOUT ANY WARRANTY; without even the implied warranty of
  MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See either the
  Artistic License or the GNU General Public License for more details.

                              Ralf S. Engelschall
                              [email protected]
                              www.engelschall.com