Listomatic does a good job in sumarizing navigation tricks.
(mind you, CSS Showcase does a pretty good job as well)

Basically, for a PURE CSS nav list create a list — then pretty it up with CSS.
In particular:

Make it in-line
Set Padding and Margins
Set a borders (if you want)
Create a:link and a:hover f you want rollover effects