Originally Posted by FrankZ
I am sure you have not seen their hosting contract
therefore you are unsure of how much they are paying. Typically the hosting contracts I have been involved with allow for busrting bamdwidth and usually that costs around double. By doing a 126Mb pull at one go you could change the rate at which they are charged. Usually in hosting environments you pay for the peak and those peaks can get very expensive.
All I am suggesting is you ask before you pull an entire site. You don't know how big the site is before you pull it, you don't know the affect you are having on their bandwidth costs, nor do you know if the site is capable of sustaining that kind of load.
I'm not condoning what geckosenator did, but there is a way to tell wget
to be nice about the bandwidth it uses by specifying it using the --limit-rate=amount
option. The amount may be expressed in bytes, kilobytes with the k
suffix, or megabytes with the m
suffix. For example, --limit-rate=20k
will limit the wget retrieval rate to 20KB/s. Of course, if you specify more than your Internet
provider is capable of delivering based on your subscription, you can't exceed it.
is an extremely powerful command, and in the wrong hands it can really, really cause problems.