Build Your Own Arcade Controls Forum

Main => Software Forum => Topic started by: mrclean on July 11, 2007, 09:25:03 pm

Title: Need a web bot / to snag art files from a website or anyone have any ideas ?
Post by: mrclean on July 11, 2007, 09:25:03 pm

Previously on another site some one was able to "rip" a web site of its contents basically a bot / download manager every single one that ive used can't seem to do the job Does any one know of a good one?

Title: Re: Need a web bot / to snag art files from a website or anyone have any ideas ?
Post by: CM on July 11, 2007, 09:34:35 pm

http://en.wikipedia.org/wiki/Wget (http://en.wikipedia.org/wiki/Wget) is a good start.

Title: Re: Need a web bot / to snag art files from a website or anyone have any ideas ?
Post by: mrclean on July 11, 2007, 10:31:06 pm

Quote from: CM on July 11, 2007, 09:34:35 pm

http://en.wikipedia.org/wiki/Wget (http://en.wikipedia.org/wiki/Wget) is a good start.

even after downloading a GUI for that im still uterly confused

Title: Re: Need a web bot / to snag art files from a website or anyone have any ideas ?
Post by: CM on July 11, 2007, 10:48:26 pm

From WGET's manual:

You want to download all the gifs from a directory on an http server. You tried wget http://www.server.com/dir/*.gif, but that didn't work because http retrieval does not support globbing. In that case, use:

          wget -r -l1 --no-parent -A.gif http://www.server.com/dir/
     

More verbose, but the effect is the same. -r -l1 means to retrieve recursively (see Recursive Download), with maximum depth of 1. --no-parent means that references to the parent directory are ignored (see Directory-Based Limits), and -A.gif means to download only the gif files. -A "*.gif" would have worked too.

Title: Re: Need a web bot / to snag art files from a website or anyone have any ideas ?
Post by: ahofle on July 12, 2007, 01:18:04 am

Teleport Pro is a good one:
http://www.tenmax.com/teleport/pro/home.htm