Received: from SOUTH-STATION-ANNEX.MIT.EDU by po10.MIT.EDU (5.61/4.7) id AA02232; Wed, 2 Apr 97 15:15:52 EST Received: from geneva.netgen.com by MIT.EDU with SMTP id AA03375; Wed, 2 Apr 97 15:15:49 EST Received: from mail.mccmedia.com by netgen.com (SMI-8.6/SMI-SVR4) id PAA15196; Wed, 2 Apr 1997 15:15:47 -0500 Resent-Date: Wed, 2 Apr 1997 15:15:47 -0500 Received: from basis.basis.com (unverified [204.52.207.1]) by mail.mccmedia.com (EMWAC SMTPRS 0.83) with SMTP id ; Wed, 02 Apr 1997 12:14:22 -0800 Received: (from mail@localhost) by basis.basis.com (8.6.12/8.6.9) id OAA19901 for ; Wed, 2 Apr 1997 14:11:20 -0700 Received: from uniblab.basis.com(204.134.1.212) by basis.basis.com via smap (V1.3) id sma019881; Wed Apr 2 14:09:42 1997 Received: from dino.basis.com (dino.basis.com [204.134.1.140]) by uniblab.basis.com (8.6.11/8.6.9) with SMTP id MAA22853 for ; Wed, 2 Apr 1997 12:36:49 -0700 Message-Id: <2.2.32.19970402190850.0116e52c@mail.basis.com> X-Sender: dclark@mail.basis.com X-Mailer: Windows Eudora Pro Version 2.2 (32) Mime-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Date: Wed, 02 Apr 1997 13:08:50 -0600 To: robots@mail.mccmedia.com From: Dan Clark Subject: searching for spiders Sender: robots-request@mail.mccmedia.com Resent-Message-Id: Resent-From: robots@mail.mccmedia.com X-Unsub: To leave, send text 'LEAVE' to Lines: 25 Xref: meno.media.mit.edu list.robots:736 Does anyone know of a spider which would allow me to feed it a list of about 500 links and then go out and index those links into a database which I could then maintain. I am wanting to create a search index on a specialized group of links for a non-profit project I'm working on. Any information on available spiders or spider services would be greatly appreciated. Thanks, Dan Clark \\\\\\|////// =E7 =F4 =F4 c ------------------------------ooo0--------O--------0ooo---------------------= --- Dan Clark =20 Internal System=20 Support Administrator (505) 345-5232 ________________________________________________________ ooo0 =20 ( ) 0ooo \ ( ( ) \ ) ) / ( /