Main Restorations Software Audio/Jukebox/MP3 Everything Else Buy/Sell/Trade
Project Announcements Monitor/Video GroovyMAME Merit/JVL Touchscreen Meet Up Retail Vendors
Driving & Racing Woodworking Software Support Forums Consoles Project Arcade Reviews
Automated Projects Artwork Frontend Support Forums Pinball Forum Discussion Old Boards
Raspberry Pi & Dev Board controls.dat Linux Miscellaneous Arcade Wiki Discussion Old Archives
Lightguns Arcade1Up Try the site in https mode Site News

Unread posts | New Replies | Recent posts | Rules | Chatroom | Wiki | File Repository | RSS | Submit news

« previous next »
Pages: [1]
  
Go Down

Author Topic: Saint, hide the sandbox site with robots.txt  (Read 2426 times)

0 Members and 1 Guest are viewing this topic.

krick

  • Trade Count: (+1)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 2006
  • Last login:May 23, 2025, 03:48:36 am
  • Gotta have blue hair.
Saint, hide the sandbox site with robots.txt
« on: December 30, 2010, 10:23:06 pm »
Stuff from the forumsandbox site is showing up in Google.

You should hide the sandbox site with a custom robots.txt just for the sandbox...

http://www.robotstxt.org/faq/prevent.html

The sooner you get on this, the better since it's almost impossible to remove stuff from Google once it's been crawled.

Logged
Hantarex Polo 15KHz
Sapphire Radeon HD 7750 2GB (GCN)
GroovyMAME 0.197.017h_d3d9ex
CRT Emudriver & CRT Tools 2.0 beta 13 (Crimson 16.2.1 for GCN cards)
Windows 7 Home Premium 64-bit
Intel Core i7-4790K @ 4.8GHz
ASUS Z87M-PLUS Motherboard

saint

  • turned to the Dark Side
  • Supreme Chancellor
  • Trade Count: (+6)
  • Full Member
  • *****
  • Offline Offline
  • Posts: 6150
  • Last login:August 22, 2025, 07:24:03 am
  • I only work in cyberspace...
    • Build Your Own Arcade Controls
Re: Saint, hide the sandbox site with robots.txt
« Reply #1 on: December 30, 2010, 11:01:31 pm »
Thanks - done.
Logged
--- John St.Clair
     Build Your Own Arcade Controls FAQ
     http://www.arcadecontrols.com/
     Project Arcade 2!
     http://www.projectarcade2.com/
     saint@arcadecontrols.com

Crazy Cooter

  • Senator Cooter was heard today telling the entire congressional body to STFU...
  • Trade Count: (0)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 2044
  • Last login:August 19, 2025, 11:29:13 pm
Re: Saint, hide the sandbox site with robots.txt
« Reply #2 on: December 31, 2010, 11:10:22 pm »
It just showed up for me.  Seems to still have the links.
Logged

krick

  • Trade Count: (+1)
  • Full Member
  • ***
  • Offline Offline
  • Posts: 2006
  • Last login:May 23, 2025, 03:48:36 am
  • Gotta have blue hair.
Re: Saint, hide the sandbox site with robots.txt
« Reply #3 on: January 01, 2011, 02:03:30 am »
Quote from: Crazy Cooter on December 31, 2010, 11:10:22 pm
It just showed up for me.  Seems to still have the links.

The robots.txt looks good to me...

http://forumsandbox.arcadecontrols.com/robots.txt
Logged
Hantarex Polo 15KHz
Sapphire Radeon HD 7750 2GB (GCN)
GroovyMAME 0.197.017h_d3d9ex
CRT Emudriver & CRT Tools 2.0 beta 13 (Crimson 16.2.1 for GCN cards)
Windows 7 Home Premium 64-bit
Intel Core i7-4790K @ 4.8GHz
ASUS Z87M-PLUS Motherboard
Pages: [1]
  
Go Up
« previous next »