Received: with ECARTIS (v1.0.0; list gopher); Wed, 12 Oct 2005 21:08:18 -0500 (CDT) Received: from mx.freeshell.org ([192.94.73.21] helo=sdf.lonestar.org ident=root) by glockenspiel.complete.org with esmtp (Exim 4.50) id 1EPsVv-0000Ao-MP for gopher@complete.org; Wed, 12 Oct 2005 21:08:16 -0500 Received: from sdf.lonestar.org (IDENT:newmanbe@sdf.lonestar.org [192.94.73.1]) by sdf.lonestar.org (8.13.1/8.12.10) with ESMTP id j9D27qDl016548 for <gopher@complete.org>; Thu, 13 Oct 2005 02:07:52 GMT Received: (from newmanbe@localhost) by sdf.lonestar.org (8.13.1/8.12.8/Submit) id j9D27q9C005510 for gopher@complete.org; Wed, 12 Oct 2005 21:07:52 -0500 (CDT) Date: Wed, 12 Oct 2005 21:07:52 -0500 From: Benn Newman <newmanbe@sdf.lonestar.org> To: gopher@complete.org Subject: [gopher] Re: New Gopher Wayback Machine Bot Message-ID: <20051013020752.GA20333@SDF.LONESTAR.ORG> References: <20051012180132.GA19083@complete.org> <200510122345.QAA17070@floodgap.com> Mime-Version: 1.0 Content-type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200510122345.QAA17070@floodgap.com> User-Agent: Mutt/1.4.2.1i X-Spam-Status: No (score 0.6): AWL=0.574, FORGED_RCVD_HELO=0.05 X-Virus-Scanned: by Exiscan on glockenspiel.complete.org at Wed, 12 Oct 2005 21:08:16 -0500 Content-Transfer-Encoding: 8bit X-archive-position: 1113 X-ecartis-version: Ecartis v1.0.0 Sender: gopher-bounce@complete.org Errors-to: gopher-bounce@complete.org X-original-sender: newmanbe@sdf.lonestar.org Precedence: bulk Reply-to: gopher@complete.org List-help: <mailto:ecartis@complete.org?Subject=help> List-unsubscribe: <mailto:gopher-request@complete.org?Subject=unsubscribe> List-software: Ecartis version 1.0.0 List-Id: Gopher <gopher.complete.org> X-List-ID: Gopher <gopher.complete.org> List-subscribe: <mailto:gopher-request@complete.org?Subject=subscribe> List-owner: <mailto:jgoerzen@complete.org> List-post: <mailto:gopher@complete.org> List-archive: <http://www.complete.org/mailinglists/archives/> X-list: gopher

On Wed, Oct 12, 2005 at 04:45:56PM -0700, Cameron Kaiser wrote: > I'm a little concerned about your project since I do host a number of large > subparts which are actually proxied services, and I think even a gentle bot > going methodically through them would not be pleasant for the other side > (especially if you mean to regularly update your snapshot). I agree with Cameron and think that until it supports robots.txt, it shoudl be disabled. I also think it would be a good idea to have it from a single, publically known domain name. -- Benn Newman newmanbe@sdf.lonestar.org | gopher://igneous-rock.homeunix.net

Bradley's Bromide: If computers get too powerful, we can organize them into a committee -- that will do them in.