faqts : Computers : Programming : Languages : Python : Common Problems : Web Programming

+ Search
Add Entry AlertManage Folder Edit Entry Add page to http://del.icio.us/
Did You Find This Entry Useful?

8 of 10 people (80%) answered Yes
Recently 7 of 9 people (78%) answered Yes

Entry

Where can I find a Python script to download an entire web site?

May 30th, 2000 04:51
unknown unknown, Andrew Dalke, Simon


Try websucker, which is distributed with Python under Tools as part
of webchecker.  It isn't in Parnassus because it's part of Python
itself.

websucker.py, while an awesome utility, doesn't actually suck the entire
site.  For instance, it will pull the image files on a page if those
images are statically SRC-ed.  If there is an onmouseover directive, for
instance, which changes the image source to another file, it will not
grab the other file, even if it lies in the same directory as the first
image.