Thanks for the help. Glad to report it all came apart after some more sledge persuasion! Didn't ruin the cv too which is a plus!
VW had a great idea putting the ball joint right under the driveshaft haha, but oh well it's all working fine once again