Yes, restart. When you see any logo or anything like that, press f10, delete, f1, or something like that. You'll see a blue screen come up or something like that, and then you should look for something that says "pc health status" or something analogous. yeah. the temps should be there.
Macbook Pro and Logitech z5500s. All you really need.