Worn tires and /or steering components are often the culprit on XJ's. If you haven't done a lift or anything I'd reccomend strarting with a switching your front tires to back and looking for any loose or worn parts in your front end. New steering dampener helps sometimes too.

Still bad, try borrowing a set of tires off a buddys Jeep for a day to see if it goes away.