with most cruiser type boats it will probably not matter......
boats can be a little off without noticable differences from tack to tack.
of course I am speaking in inches and not feet.
it is however esthetically displeasing to eye up a rig and find it not to be plumb. (definitly psychologically damaging on the race
I would expect the affect to be slower on both tacks and not so much closer to the wind
on the "short side"
rake, forestay tension relatiive to back stay /runner tension and the type of rig you have will have more to play on pointing ability. then comes more racing
adjustments like twist/draft position etc.etc
but why ask such a question when you can simply do it right in the first place?