All play from hinges moving is bad.
However, note that some designs will have some space left between the pintle and the gudgeon. On my boat this space is filled with a poly sleeve that limits the movement and also gives very smooth movement. When the sleeve is new there is next to nil play, after a couple of years the play is noticeable.
But if this is not your case and if the hinges move - fix it.