Message-ID: <44EC663B.3020305@sdf.lonestar.org>
Date: Wed, 23 Aug 2006 09:29:15 -0500
From: Benn Newman <newmanbe@sdf.lonestar.org>
User-Agent: Thunderbird 1.5.0.5 (Windows/20060719)
MIME-Version: 1.0
To: gopher@complete.org
Subject: [gopher] Re: Gopherspace archive
References: <33786.69.21.205.10.1155595127.squirrel@69.21.205.10>
 <20060815014741.GB5040@katherina.lan.complete.org>
 <44EC0986.9080504@route-add.net> <44EC4C25.3030008@route-add.net>
 <20060823140721.GD21150@excelhustler.com>
In-Reply-To: <20060823140721.GD21150@excelhustler.com>
Content-type: text/plain
Content-Transfer-Encoding: 8bit
Sender: gopher-bounce@complete.org
Errors-to: gopher-bounce@complete.org
Precedence: bulk
Reply-to: gopher@complete.org

John Goerzen wrote:
> OK, well there are about half a dozen people that would like a copy of
> this.
> 
> Do any of you that have expressed interest have the capability to put it
> online where others can download it?
> 
> Before I spend a weekend burning a whole stack of DVDs, perhaps we can
> optimize this a bit.
> 
> The 40GB is before compression.  After compression with, say, tar.bz2,
> it should be more manageable -- but still a significant amount of data.
> 
> -- John
I do not have a place to put it up for download; I could, however try to 
make a full text index (Using something even more portable then the full 
text search back-end I was using on my Gopher server, a porter's 
nightmere). I was reading a paper on the indexing system for refer (in a 
nutshell bibTeX for troff). It can also be used as a general indexer. 
The paper talks about (very impressive compared to using grep) an index 
of 32,000,000 bytes (~32megabytes) (apparently, that was all the English 
text they had on their system! Why do we need these big drives anyway! 
:)). With all the software and binary stuff taken out, I think it should 
(nearly) manageable. The index file shouldn't be nearly as big as the 
whole archive, I could then make a front end to that (yay for sed and awk!).
--
Benn Newman


-- Binary/unsupported file stripped by Ecartis --
-- Type: application/x-pkcs7-signature
-- File: smime.p7s
-- Desc: S/MIME Cryptographic Signature