So the end results are I replaced the following just to be sure:
Calipers (went with nap and they are nice but spendy at 70/ea but they are PC too!), new front lines, new wheel cylinders, new rear shoes I had laying around.

Brakes still not up to snuff so I bled and bled and bled no real change. Then I bled the master which helped slightly but still spongy pedal that was to quite low to the floor floor. Adjusted the rear shoes to no avail either.

Finally adjusted the hell out of the booster pushrod and bingo no more issues so far. Im not sure how or why it was out of adjustment but it was.

Im not sure why but ever since I changed the rear is when this all started. Whatever seems to be fine now.