Re: Website visit automation script
personally I'd use PHP.
what you want to do is run the script that should have logic as such
start data stream,
use open page function
send search variables to page. (e.g. site.com/search?keywords=search+terms)
(or your might have to send a post statement rather than using the get method -depends how their search page works)
set up a loop, search through the returned page line by line (for $line0, line<=sizeof($page), line++)
use regex to search regular expressions, (like <tr><td class="product">Product name)
use the split function to split out all the redundant stuff around the line
store your returned results in a database (with other information you require, such as data and time which can be generated locally)
schedule a task
task = "C:\php\php.exe d:\scripts\price_scraping.php"
time = midnight each night.
I didn’t fight my way to the top of the food chain to be a vegetarian…
Im sick of people saying 'dont waste paper'. If trees wanted to live, they'd all carry guns.
"The inherent vice of capitalism is the unequal sharing of blessings; The inherent vice of socialism is the equal sharing of miseries."