Re: Website crawlers?
that mirrors a whole site, it does it by saving the text and pictures of the site that you're on to your local computer.
also you set a link depth, so it follows links on the first page to pages inside the site.
the tool os meant for mirroring whole websites.
it is exactly what you want to copy a whole website off line. anything that is a link that you can click the program will follow and mirror the content at the end of that link.
I didn’t fight my way to the top of the food chain to be a vegetarian…
Im sick of people saying 'dont waste paper'. If trees wanted to live, they'd all carry guns.
"The inherent vice of capitalism is the unequal sharing of blessings; The inherent vice of socialism is the equal sharing of miseries."