It sounds like torque reaction or more simply "prop walk." The propellor is like a wheel moving the stern of your boat sideways. So if the prop is rotating clockwise viewed from astern it will be walking the stern to starboard and the bow will point to port. The further astern the prop, the more noticible this effect is. The propellor has more grip at its deeper point where the water is at higher pressure. It's quite normal. Racing outboard
boats can have twin engines with the props going opposite directions to cancel this out.
You can't change it. Any propellor will do the same thing.
High performance propellor aircraft like the Spitfire or Mustang did a similar thing on take off especially, as the plane tried to rotate around the propellor the pilots had to correct with the controls.
has a dual prop for their large powerboat engines with 2 propellors on the same axis rotating in opposite directions to cancel this effect out. Some aircraft also used counter rotating propellors. Helicopters try to rotate around the rotor blades. That's why they have a tail rotor to counteract the effect. And that's how they turn left or right by reducing or increasing the pitch
of the tail rotor.
On my own boat when I'm motoring if I don't use the autohelm
or tie the tiller it will turn if I let the tiller go even though my propellor is about 8' in front of the rudder
Prop walk can be used to your advantage when you are docking
. It will steer the stern one direction going forward and the opposite way in reverse.