Like Brian said, those big ol' shackles in front might be part of the problem. Toyota axles only have about 2 degrees of caster stock, lowering the front mount can make it even less. Your drag link angle looks fine, but I would try shorter shackles and/or rotate the housing for more caster. Take that for what it is worth though, it is hard to tell from those pictures.

Harry Wagner
Harry Situations
4x4Wire's Toyota Section