*very horrified expression*
You're a trusting person. I always set the vCore manually, even on a stock clock. I guess I'm paranoid like that. Don't wanna fry a $200 processor.
Anyway, basic overclocking is lower the CPU multiplier to the next whole number (9,10,11,12, etc) and slowly up the FSB in 5-10 MHz increments. Raise the FSB, boot and test stability. Run Prime95 for twenty minutes (that should give you a rough idea, anyway) and if everything checks out, then restart and continue the overclock. Monitor the temperatures with CoreTemp. It's a good program.
If the overclock doesn't pass the test, then try upping the voltage. It'll be something like vCore. Some motherboards call it different things, but you'll figure it out. Once you get to a clock you like, and it seems to be stable, then run Prime95 for at least 8 hours. I personally run the stress test for quite a bit longer than that, but I like 100% stable overclocks that will run Folding@Home nonstop for weeks at a time.
That should get you started. Mind you, it's a VERY simplified explanation, so if you have any questions, add me to Steam Friends. I have a button in my sig.
-Xen