Just determine you max overclock by increasing only one clock at a time. Start with the core clock, and increase in 25MHz increments running stability tests in between. When you have determined the max speed for the core, you can move on to the memory and repeat the process. I recommend using Rivatuner.