I think taking the axle apart is easier than other jobs you've already done.

It looked like it was going to be a real bi*ch but I found a clue when looking up bearing specs. It is a deep groove bearing, which means the balls inside are spaced out and held by a soft bronze cage. Pried that out, moved all the balls to one side and the bearing came apart. I did 3 this way and feel that the least amount of effort was expended (also did not shock/damage/bend any parts.)

When the bearing comes apart the brake will fall off the axle and you are left with the shaft and some rings on it (bearing, retainer, etc.) Least effort rule again: grind the rings down to about 2mm and start hitting them with a sharp chisel. They crack and fall off.

It was MORE effort to get the new bearing, then retainer hammered onto the axle with a long pipe (too long to fit in my press.)

Of course it is harder the first time, my long winded replies are meant to convey all the crap I wished I knew before I dug into this.