Click Here to Login
Join Computer forums Today

View Single Post
Old 12-24-2010, 01:43 AM   #1
Beta Member
Join Date: Dec 2010
Posts: 1
Default Twitter's robots.txt question:

Twitter's robots.txt, It shows everything is disallowed, but surprisingly search engines are crawling and indexing everybody's profiles pages, Why?
Hemat is offline   Reply With Quote

All times are GMT -5. The time now is 02:10 PM.

Powered by vBulletin® Version 3.8.8 Beta 4
Copyright ©2000 - 2020, vBulletin Solutions, Inc.