they are stuck on the retaining clip, they need to be 'tapped' in with a soft hammer / rubber mallet etc, be careful not to damage the gaiter.
I normally do this when first inserting the driveshaft by aligning the shaft perfectly level and then they go straight in, I expect you are trying to fit them with the shaft at an angle, thus they get stuck on the retaining clip.
