Outboard Directional-Control Issues

[mow2000]

I bought a 27' sailboat, 2.5' draft (centerboard up) with an 8hp outboard mounted to the right of the rudder. The outboard is fixed and steering is done via the rudder. Initially I noticed the outboard was not fixed straight but was slightly clockwise. When stationary and starting to move forward I pivoted to port and when moving in reverse i pivoted to starboard. I adjusted the motor to as close to straight-ahead as i could eyeballing it and still have the pivoting problem but maybe not so pronounced. Is this just a fact of life given the motor is offset to starboard and there is no propwash behind the rudder? If so should I rotate and lock the motor slightly counter-clockwise to counter this?