Yeah I would suggest just pressing anything and everything. And check the bottom, top, sides, back, everywhere, the chances are the power button is somewhere out of the ordinary.
Oooh man, I remember those computers! LOL, but that would case a problem, eh ;P Perhaps theres a way to modify the connection on the back. It's probably just something that needs to be shored out.