Before looking at other causes for your wobble, I'd get that linkage squared away, and then check your toe-in adjustment. Then check for loose steering components.

The hard steering in one direction is definitely a problem. Get that fixed first.

1977 CJ-7, fiberglass body, AMC 360 w/ headers, DUI ignition, Edelbrock intake and Holley 4150 carb, TF999, Dana 300, 4.56 gears lockers, York air comp, 4" susp lift, 2" body lift, BFG 35" M-T tires, Megashifter, AGR pump & box, REP8000 winch.