Yup.
Use masking tape to cover the panel (so it won't scratch anything else). If you're going with a pre-cut window, make sure you trace it with the washer around the edges, then you'll have enough room for the window and the gasket to seal around the window. After that, dremel away!