Received: with ECARTIS (v1.0.0; list gopher); Fri, 14 Oct 2005 10:47:17 -0500 (CDT) Received: from mo-69-69-114-6.sta.sprint-hsd.net ([69.69.114.6] helo=erwin.lan.complete.org) by glockenspiel.complete.org with esmtps (with TLS-1.0:RSA_AES_256_CBC_SHA:32) (TLS peer CN erwin.complete.org, certificate verified) (Exim 4.50) id 1EQRm7-0003c3-62; Fri, 14 Oct 2005 10:47:17 -0500 Received: from katherina.lan.complete.org ([10.200.0.4]) by erwin.lan.complete.org with esmtps (with TLS-1.0:RSA_AES_256_CBC_SHA:32) (No TLS peer certificate) (Exim 4.50) id 1EQRly-0000Ax-SY; Fri, 14 Oct 2005 10:47:06 -0500 Received: from jgoerzen by katherina.lan.complete.org with local (Exim 4.54) id 1EQRly-0007ln-Nf; Fri, 14 Oct 2005 10:47:06 -0500 Date: Fri, 14 Oct 2005 10:47:06 -0500 From: John Goerzen <jgoerzen@complete.org> To: gopher@complete.org Subject: [gopher] Gopher bot status Message-ID: <20051014154706.GB29734@katherina.lan.complete.org> MIME-Version: 1.0 Content-type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.11 X-Spam-Status: No (score 0.1): FORGED_RCVD_HELO=0.05 X-Virus-Scanned: by Exiscan on glockenspiel.complete.org at Fri, 14 Oct 2005 10:47:17 -0500 Content-Transfer-Encoding: 8bit X-archive-position: 1125 X-ecartis-version: Ecartis v1.0.0 Sender: gopher-bounce@complete.org Errors-to: gopher-bounce@complete.org X-original-sender: jgoerzen@complete.org Precedence: bulk Reply-to: gopher@complete.org List-help: <mailto:ecartis@complete.org?Subject=help> List-unsubscribe: <mailto:gopher-request@complete.org?Subject=unsubscribe> List-software: Ecartis version 1.0.0 List-Id: Gopher <gopher.complete.org> X-List-ID: Gopher <gopher.complete.org> List-subscribe: <mailto:gopher-request@complete.org?Subject=subscribe> List-owner: <mailto:jgoerzen@complete.org> List-post: <mailto:gopher@complete.org> List-archive: <http://www.complete.org/mailinglists/archives/> X-list: gopher

Just thought you all would be interested to know:

The gopher bot has cached 32,215 selectors, representing 6.5GB of data.

480431 selectors have been identified so far. Of those, 252033 remain scheduled for visiting, and most of those are across about 20 large servers.

I'll keep you updated.

The next question is: what to do with this resource when it's ready?

I can obviously post it on quux.org somewhere, but I would like for other people to have copies too. Single points of failure are bad in a community this size. And, of course, its utility isn't *now*, when all the material is accessible, but down the road.

I'm thinking of making a torrent of a tar.bz2, or perhaps even mail out some DVD+Rs.

-- John Goerzen Author, Foundations of Python Network Programming http://www.amazon.com/exec/obidos/tg/detail/-/1590593715