We just purchased a P-30 this year and love it! She's pretty quick in light winds, actually, and extremely comfortable. I've had some difficulty running down wind in a wing-and-wing set but that's probably more my issue than the boats.
I'm 6' as well and the 30 is just about right although I wouldn't mind the couple of extra inches you'll have on the 323. At 5'3", the Admiral is just fine!
In short, I don't believe that there's a better boat for the money
. Jump at it and, if you find yourself on Lake Michigan, give us a shout!