Go Back   Computer Forums > General Computing > Cyber Safety and Computer Security
Click Here to Login
Join Computer forums Today


Reply
 
Thread Tools Search this Thread Display Modes
 
Old 07-28-2010, 10:16 PM   #1
Beta Member
 
Join Date: Jul 2010
Posts: 2
Unhappy webcrawlers

Would anybody be able to tell me how you tell when there's a webcrawler?
How can one prevent it?

Thanks.
__________________

allat is offline   Reply With Quote
Old 07-29-2010, 02:12 AM   #2
In Runtime
 
Join Date: Apr 2007
Posts: 446
Send a message via MSN to Comp_Pro
Default Re: webcrawlers

You can prevent them by installing an anti-virus, anti-spyware and firewall. A good combination would be AVG free anti-virus, Zonealarm Free Firewall, and SpyBot - Search and Destroy.

Be sure to run regular scans (at least once a week) to remove any that have made their way onto your computer. If you really want to know if you have one at the moment, just install SpyBot - Search and Destroy and update your definitions and scan your computer with it. If there are any botnets/webcrawlers on your computer, it will delete it.
__________________

__________________
Intel i7 4770k 3.50ghz, 32gb Corsair Vengeance RAM (8x4 kit), 2 x 2TB WD Black HHD, nVidia 770GTX 4gb OC, Asus Z87-A Motherboard, running Windows 7 64 bit.
Comp_Pro is offline   Reply With Quote
Old 07-29-2010, 12:55 PM   #3
Site Team
 
root's Avatar
 
Join Date: Mar 2004
Posts: 8,007
Default Re: webcrawlers

web crawlers are what search engines use to index websites.

they literally crawl the internet following links, reading pages and reporting the content back to their providers, that's how Google manage to index the internet.

you can (supposedly) stop web crawls by using a file on the root of your web server called robots.txt, or assuming the web crawlers don't pay attention to this you can regularly review your web server logs and ban traffic from web crawlers IP addresses or address ranges.


if you mean worms, then firewalls can stop those.
__________________
I didn’t fight my way to the top of the food chain to be a vegetarian…
Im sick of people saying 'dont waste paper'. If trees wanted to live, they'd all carry guns.
"The inherent vice of capitalism is the unequal sharing of blessings; The inherent vice of socialism is the equal sharing of miseries."
root is offline   Reply With Quote
Old 07-30-2010, 02:45 AM   #4
In Runtime
 
Join Date: Apr 2007
Posts: 446
Send a message via MSN to Comp_Pro
Default Re: webcrawlers

Opps, excuse my mistake. I thought webcrawlers were botnets
__________________
Intel i7 4770k 3.50ghz, 32gb Corsair Vengeance RAM (8x4 kit), 2 x 2TB WD Black HHD, nVidia 770GTX 4gb OC, Asus Z87-A Motherboard, running Windows 7 64 bit.
Comp_Pro is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off



All times are GMT -5. The time now is 02:43 AM.


Powered by vBulletin® Version 3.8.8 Beta 4
Copyright ©2000 - 2017, vBulletin Solutions, Inc.
Search Engine Friendly URLs by vBSEO 3.6.0