Received: with LISTAR (v1.0.0; list gopher); Sun, 14 Jan 2001 20:25:41 -0600 (CST)
Return-Path: <jgoerzen@complete.org>
Delivered-To: gopher@complete.org
Received: from erwin.complete.org (cc695330-a.indnpls1.in.home.com [24.8.87.207])
	by pi.glockenspiel.complete.org (Postfix) with ESMTP
	id 268123B912; Sun, 14 Jan 2001 20:25:41 -0600 (CST)
Received: (from jgoerzen@localhost)
	by erwin.complete.org (8.11.1/8.11.1/Debian 8.11.0-6) id f0F2MHA01494;
	Sun, 14 Jan 2001 21:22:17 -0500
X-Authentication-Warning: erwin.complete.org: jgoerzen set sender to jgoerzen@complete.org using -f
To: gopher@complete.org
Subject: [gopher] Re: Gopher "robots.txt" (was Re: New V-2 WAIS database)
References: <200101140056.QAA12702@stockholm.ptloma.edu>
From: John Goerzen <jgoerzen@complete.org>
Date: 14 Jan 2001 21:22:16 -0500
In-Reply-To: <200101140056.QAA12702@stockholm.ptloma.edu>
Message-ID: <87y9wdpnaf.fsf@complete.org>
Lines: 36
User-Agent: Gnus/5.090001 (Oort Gnus v0.01) XEmacs/21.1 (Channel Islands)
MIME-Version: 1.0
Content-type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 8bit
X-archive-position: 95
X-listar-version: Listar v1.0.0
Sender: gopher-bounce@complete.org
Errors-to: gopher-bounce@complete.org
X-original-sender: jgoerzen@complete.org
Precedence: bulk
Reply-to: gopher@complete.org
X-list: gopher

This proposal would be extremely difficult to implement for gopher
sites that carry mirrors, especially mirrors of other gopher sites.

-- John

Cameron Kaiser <spectre@stockholm.ptloma.edu> writes:

> I'd like to see an approach on a per-directory (menu) basis, maybe a selector
> like this in menus not to be indexed:
> 
> iFFerror.hostF909
> 
> F, of course, is Gopherese for <TAB>. It's a null display string of item
> type i, so normal clients just display a blank line. You can encode any
> sort of pragma this way; I just encoded it in the port number for poor sods
> who use IE so that clicking on the link doesn't do anything useful. 909 as
> the port number is the pragma for the robot to not index anything in this
> directory/menu, so it leaves it alone.
> 
> Such a pragma, like I said, would be wide open for other applications and
> best of all is very simple to implement on both robot (my) side and servers.
> 
> Comments?
> 
> -- 
> ----------------------------- personal page: http://www.armory.com/~spectre/ --
>  Cameron Kaiser, Point Loma Nazarene University * ckaiser@stockholm.ptloma.edu
> -- Immigration is the sincerest form of flattery. -- Jack Paar ----------------
> 
> 
> 

-- 
John Goerzen <jgoerzen@complete.org>                       www.complete.org
Sr. Software Developer, Progeny Linux Systems, Inc.    www.progenylinux.com
#include <std_disclaimer.h>                     <jgoerzen@progenylinux.com>