I used to run into the same problem on my old AP high-steer setup with a 3 degree shim. While the contact did result in rubbing the paint off the tie rod, it did not seem to have any other negative affects. Before I had the bumpstops set right, it would bind up the steering, but raising the stops to limit the rubbing cured that.

I also had trouble with the pitman arm hitting the springs as well, again just enough to take the paint off the spring. A dropped spring hanger fixed that and also eliminated the need for the shims by tipping down the front of the axle, raising the pinion:

http://www.4crawler.com/4x4/CheapTricks/CrossoverSteering/index.shtml#SpringHangerDrop

Just several of the issues you encounter when running relatively low lift with crossover steering.

How thick is the fat end of the shim (I'm guessing just short of 1/2")? Could always swap them out for a slightly thinner set made out of 3/8" stock, maybe reducing the angle to 2.5 degrees or whatever is the maximum angle that will fit in the thinner material.