Click Here to Login
Join Computer forums Today


View Single Post
Old 12-24-2010, 01:43 AM   #1
Hemat
Beta Member
 
Join Date: Dec 2010
Posts: 1
Default Twitter's robots.txt question:

Twitter's robots.txt, It shows everything is disallowed, but surprisingly search engines are crawling and indexing everybody's profiles pages, Why?
__________________
Hemat is offline   Reply With Quote
 

All times are GMT -5. The time now is 02:10 PM.


Powered by vBulletin® Version 3.8.8 Beta 4
Copyright ©2000 - 2020, vBulletin Solutions, Inc.
×