Yeah, something's obviously changing when it's in motion.
Could be something daft like a front LCA bush fitted 90° out so it's compliant in the wrong direction, or there's some slack somewhere that can't be found.
I'd have ripped the whole front end out and replaced everything by now, which...