Main > Software Forum

Need a web bot / to snag art files from a website or anyone have any ideas ?

(1/1)

mrclean:
Previously on another site some one was able to "rip" a web site of its contents basically a bot / download manager every single one that ive used can't seem to do the job Does any one know of a good one?

CM:
http://en.wikipedia.org/wiki/Wget is a good start.

mrclean:

--- Quote from: CM on July 11, 2007, 09:34:35 pm ---http://en.wikipedia.org/wiki/Wget is a good start.

--- End quote ---

even after downloading a GUI for that im still uterly confused

CM:
From WGET's manual:

You want to download all the gifs from a directory on an http server. You tried wget http://www.server.com/dir/*.gif, but that didn't work because http retrieval does not support globbing. In that case, use:

          wget -r -l1 --no-parent -A.gif http://www.server.com/dir/
     

More verbose, but the effect is the same. -r -l1 means to retrieve recursively (see Recursive Download), with maximum depth of 1. --no-parent means that references to the parent directory are ignored (see Directory-Based Limits), and -A.gif means to download only the gif files. -A "*.gif" would have worked too.

ahofle:
Teleport Pro is a good one:
http://www.tenmax.com/teleport/pro/home.htm

Navigation

[0] Message Index

Go to full version