Received: with LISTAR (v1.0.0; list gopher); Sun, 14 Jan 2001 20:25:41 -0600 (CST) Return-Path: Delivered-To: gopher@complete.org Received: from erwin.complete.org (cc695330-a.indnpls1.in.home.com [24.8.87.207]) by pi.glockenspiel.complete.org (Postfix) with ESMTP id 268123B912; Sun, 14 Jan 2001 20:25:41 -0600 (CST) Received: (from jgoerzen@localhost) by erwin.complete.org (8.11.1/8.11.1/Debian 8.11.0-6) id f0F2MHA01494; Sun, 14 Jan 2001 21:22:17 -0500 X-Authentication-Warning: erwin.complete.org: jgoerzen set sender to jgoerzen@complete.org using -f To: gopher@complete.org Subject: [gopher] Re: Gopher "robots.txt" (was Re: New V-2 WAIS database) References: <200101140056.QAA12702@stockholm.ptloma.edu> From: John Goerzen Date: 14 Jan 2001 21:22:16 -0500 In-Reply-To: <200101140056.QAA12702@stockholm.ptloma.edu> Message-ID: <87y9wdpnaf.fsf@complete.org> Lines: 36 User-Agent: Gnus/5.090001 (Oort Gnus v0.01) XEmacs/21.1 (Channel Islands) MIME-Version: 1.0 Content-type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit X-archive-position: 95 X-listar-version: Listar v1.0.0 Sender: gopher-bounce@complete.org Errors-to: gopher-bounce@complete.org X-original-sender: jgoerzen@complete.org Precedence: bulk Reply-to: gopher@complete.org X-list: gopher This proposal would be extremely difficult to implement for gopher sites that carry mirrors, especially mirrors of other gopher sites. -- John Cameron Kaiser writes: > I'd like to see an approach on a per-directory (menu) basis, maybe a selector > like this in menus not to be indexed: > > iFFerror.hostF909 > > F, of course, is Gopherese for . It's a null display string of item > type i, so normal clients just display a blank line. You can encode any > sort of pragma this way; I just encoded it in the port number for poor sods > who use IE so that clicking on the link doesn't do anything useful. 909 as > the port number is the pragma for the robot to not index anything in this > directory/menu, so it leaves it alone. > > Such a pragma, like I said, would be wide open for other applications and > best of all is very simple to implement on both robot (my) side and servers. > > Comments? > > -- > ----------------------------- personal page: http://www.armory.com/~spectre/ -- > Cameron Kaiser, Point Loma Nazarene University * ckaiser@stockholm.ptloma.edu > -- Immigration is the sincerest form of flattery. -- Jack Paar ---------------- > > > -- John Goerzen www.complete.org Sr. Software Developer, Progeny Linux Systems, Inc. www.progenylinux.com #include