So apparently my skid plate is also an integral part of supporting the transmission!

I went to have a new soft top installed today (WOOO!!)

and got my skid plate problems fixed as well. The stock holes where stripped out (rusted out perhaps?) and he welded in some plates, and installed new bolts all the way around. I guess if I hadnt gotten it fixed and the tranny shifted more, it would have royally screwed my TJ. Its all good now :-)