It's not the time (other than winter), it's the sea state.
Marine Point Forecast for Latitude 37.82°N and Longitude 122.68°W
Just went down and came back last Friday - Monday. Sailed some going down, half motor
, motored all the way back. Sometimes a tad of wind
makes the conditions MORE comfortable.
If it were my boat, I'd just check the sea state one day and poke your head
outside the Gate and see what's comfortable for you before committing to the whole trip. Then look up the conditions to see what was there so you understand the swell, wind
wave and period concepts.