I've checked those settings too and they are fine.
Keeping Firefox open is not a feasible option when you shut down your PC.
I'm using version 3.0.10.
I ended up completely uninstalling the program, then reinstalling it. Be sure to backup (export) your bookmarks first. It works fine for me now.