If you added a bunch of shims on the upper kingpin/trunion bearing cap, but didn't add any under the lower cap... then the knuckle, spindle, and hub would no longer be in alignment with the center of the axlehousing.

You should use roughly equal thicknesses of shims on the upper and lower caps to get the correct pinion preload, not just add all of them on the upper cap.