From: David Wood (jbevren_at_starbase.globalpc.net)
Date: 2004-02-06 12:41:48
That said, and if you dont want people archiving your website, I have three
words:
robots dot txt
Learn how to use it.
On Fri, 6 Feb 2004, Groepaz wrote:
> On Friday 06 February 2004 13:39, Cameron Kaiser wrote:
> > > > - Is there an easy way to download the whole archive?
> > >
> > > If you have curl, and don't need the attachments... otherwise use your
> > > favourite browser's archive making facilities.
> >
> > May I say that as someone who pays for my bandwidth, I hate people who do
> > this, and I will block them indefinitely from my site if I see activity
> > of this sort. This drives up load average, diminishes outgoing traffic, and
> > is just plain rude.
>
> err isnt the purpose of websites that they are beeing downloaded? especially
> if they are archived? but maybe thats just me ... :=P
>
> gpz
>
>
> Message was sent through the cbm-hackers mailing list
>
Message was sent through the cbm-hackers mailing list
Archive generated by hypermail pre-2.1.8.