From: David Wood (jbevren_at_starbase.globalpc.net)
Date: 2004-02-06 12:41:48
That said, and if you dont want people archiving your website, I have three words: robots dot txt Learn how to use it. On Fri, 6 Feb 2004, Groepaz wrote: > On Friday 06 February 2004 13:39, Cameron Kaiser wrote: > > > > - Is there an easy way to download the whole archive? > > > > > > If you have curl, and don't need the attachments... otherwise use your > > > favourite browser's archive making facilities. > > > > May I say that as someone who pays for my bandwidth, I hate people who do > > this, and I will block them indefinitely from my site if I see activity > > of this sort. This drives up load average, diminishes outgoing traffic, and > > is just plain rude. > > err isnt the purpose of websites that they are beeing downloaded? especially > if they are archived? but maybe thats just me ... :=P > > gpz > > > Message was sent through the cbm-hackers mailing list > Message was sent through the cbm-hackers mailing list
Archive generated by hypermail pre-2.1.8.