They're files that are stored on your computer to basically make surfing the site faster. Its basically a method used to cache these pages, if that makes any sense.
Delete them? Go for it! You should always delete these files from time to time.
Yes I second using Ccleaner, if you want to do it manually then go to Control panel, Internet Options, then select Delete in the temporary INTERNET box.