Unless the X motor tuning is too “conservative” I don’t see that being a factor. Sounds more like belt tension, maybe . . or something else that happens when the gantry is in motion.
I invite others with “real” bots to jump in to help you. ( I only use the electronics box to play with a.t.m. )
edit
Did you see this recent post ?