Any way to block website from being searched

[HenryHunt]

Hi, this is just a thing I have been wondering about while creating web based applications. If I registered a domain, is there any way I would be able to stop all search engines from searching it? For example if it was just a personal site for me to test things and upload data, would there be any way to stop all search engines searching in it but it still be online so if you had the URL you would be able to access it like a normal site. Like the concept of storing a local copy of a file on a computer in which other computers can't search for it but the person with access to the computer can. Hope this makes sense and that I have not confused anyone

 

[moaz786]

Pretty easy, actually. Just copy & paste this into notepad, save it as "robots.txt" (either with or without the quotes, it doesn't matter) and upload to your website:

# robots.txt generated at http://www.mcanerin.com
User-agent: *
Disallow: /

 

[setishock]

Bad bots and some good bots totally ignore the robot.txt file. Make an entry in your htaccess document to block all search engines.