Go Back   Computer Forums > Web Design | Website Development > Web Design and Development | Site Reviews
Click Here to Login
Join Computer forums Today


Reply
 
Thread Tools Search this Thread Display Modes
 
Old 10-14-2013, 01:45 PM   #1
Beta Member
 
Join Date: Oct 2013
Location: UK
Posts: 1
Default Any way to block website from being searched

Hi, this is just a thing I have been wondering about while creating web based applications. If I registered a domain, is there any way I would be able to stop all search engines from searching it? For example if it was just a personal site for me to test things and upload data, would there be any way to stop all search engines searching in it but it still be online so if you had the URL you would be able to access it like a normal site. Like the concept of storing a local copy of a file on a computer in which other computers can't search for it but the person with access to the computer can. Hope this makes sense and that I have not confused anyone
__________________

HenryHunt is offline   Reply With Quote
Old 10-14-2013, 07:44 PM   #2
Solid State Member
 
Join Date: May 2012
Location: United States
Posts: 10
Thumbs up Re: Any way to block website from being searched

Pretty easy, actually. Just copy & paste this into notepad, save it as "robots.txt" (either with or without the quotes, it doesn't matter) and upload to your website:

Code:
# robots.txt generated at http://www.mcanerin.com
User-agent: *
Disallow: /
__________________

moaz786 is offline   Reply With Quote
Old 10-15-2013, 07:43 AM   #3
Wizard of Wires
 
setishock's Avatar
 
Join Date: Feb 2005
Location: Not sure
Posts: 10,030
Default Re: Any way to block website from being searched

Bad bots and some good bots totally ignore the robot.txt file. Make an entry in your htaccess document to block all search engines.
setishock is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off



All times are GMT -5. The time now is 11:54 AM.


Powered by vBulletin® Version 3.8.8 Beta 4
Copyright ©2000 - 2017, vBulletin Solutions, Inc.
Search Engine Friendly URLs by vBSEO 3.6.0