Build Your Own Arcade Controls Forum

Main => Forum/Website Discussion => Topic started by: krick on August 19, 2009, 08:28:03 pm

Title: BYOAC robots.txt
Post by: krick on August 19, 2009, 08:28:03 pm

Saint,

You should add some Disallows to your robots.txt so that the robots don't spend a lot of time indexing invalid content.  The reason I noticed this is that a LOT "action=printpage" content indexed in google, which is very frustrating when you want the normal page with navigation (no to mention ads)...


http://www.google.com/search?q=site%3Ahttp%3A%2F%2Fforum.arcadecontrols.com%2F+"action%3Dprintpage" (http://www.google.com/search?q=site%3Ahttp%3A%2F%2Fforum.arcadecontrols.com%2F+"action%3Dprintpage")


Here's a good thread on how to build a search engine friendly robots.txt for SMF...

http://www.simplemachines.org/community/index.php?topic=67944.0

Title: Re: BYOAC robots.txt
Post by: saint on October 11, 2009, 02:58:17 pm

OK. Change made. Will take a while for Google to work it through.