From craig@hughes-family.org  Sat Oct  5 12:38:05 2002
Return-Path: <craig@hughes-family.org>
Delivered-To: yyyy@localhost.spamassassin.taint.org
Received: from localhost (jalapeno [127.0.0.1])
	by jmason.org (Postfix) with ESMTP id C055216F03
	for <jm@localhost>; Sat,  5 Oct 2002 12:38:04 +0100 (IST)
Received: from jalapeno [127.0.0.1]
	by localhost with IMAP (fetchmail-5.9.0)
	for jm@localhost (single-drop); Sat, 05 Oct 2002 12:38:04 +0100 (IST)
Received: from granger.mail.mindspring.net (granger.mail.mindspring.net
    [207.69.200.148]) by dogma.slashnull.org (8.11.6/8.11.6) with ESMTP id
    g958BfK03016 for <jm@jmason.org>; Sat, 5 Oct 2002 09:11:41 +0100
Received: from user-2injgi2.dsl.mindspring.com ([165.121.194.66]
    helo=belphegore.hughes-family.org) by granger.mail.mindspring.net with
    esmtp (Exim 3.33 #1) id 17xk2y-0007R8-00; Sat, 05 Oct 2002 04:12:24 -0400
Received: from belphegore.hughes-family.org (unknown [10.0.240.200])
    (using TLSv1 with cipher EDH-RSA-DES-CBC3-SHA (168/168 bits)) (No client
    certificate requested) by belphegore.hughes-family.org (Postfix) with
    ESMTP id 8BB783FDD; Sat,  5 Oct 2002 01:12:23 -0700 (PDT)
Date: Sat, 5 Oct 2002 01:12:23 -0700 (PDT)
From: Craig R Hughes <craig@hughes-family.org>
To: Daniel Quinlan <quinlan@pathname.com>
Cc: Justin Mason <yyyy@spamassassin.taint.org>,
	SpamAssassin Developers <SpamAssassin-devel@lists.sourceforge.net>
Subject: Re: [SAdev] nightly mass-check and hit-frequencies
In-Reply-To: <yf265whg1ai.fsf@proton.pathname.com>
Message-Id: <Pine.LNX.4.44.0210050111040.4446-100000@belphegore.hughes-family.org>
X-Habeas-Swe-1: winter into spring
X-Habeas-Swe-2: brightly anticipated
X-Habeas-Swe-3: like Habeas SWE (tm)
X-Habeas-Swe-4: Copyright 2002 Habeas (tm)
X-Habeas-Swe-5: Sender Warranted Email (SWE) (tm). The sender of this
X-Habeas-Swe-6: email in exchange for a license for this Habeas
X-Habeas-Swe-7: warrant mark warrants that this is a Habeas Compliant
X-Habeas-Swe-8: Message (HCM) and not spam. Please report use of this
X-Habeas-Swe-9: mark in spam to <http://www.habeas.com/report/>.
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII

Daniel Quinlan wrote:

DQ> jm@jmason.org (Justin Mason) writes:
DQ> 
DQ> > But I think rsync is key; it's very efficient bandwidth-wise, and it
DQ> > allows you to select which ones you want just as well as wget would.
DQ> > (Bandwidth is a much bigger issue for me and some other of the europeans
DQ> > involved, than it would be for you guys ;)  IMO it's by far the most
DQ> > efficient and scriptable way to do this stuff, these days.
DQ> 
DQ> It must be horrible being a dial-up user in 2002.  If we can *automate*
DQ> rsync submission with good *authentication*, it would be fine with me.
DQ> The current rsync method is not sufficiently authenticated, though.

I'll take a look at it.  I'm sure there's got to be some reasonly easy way to 
have rsync carry itself over ssh and secure access using ssh keys.

DQ> > I suggest we use the hughes-family.org server for rsyncing, as we do for
DQ> > the corpus_submit stuff -- in a separate subdirectory, though! -- then
DQ> > I'll take a look at getting a nightly hit-frequencies-collation system
DQ> > going.

Ok, I'll take a look at it.

C