If it is the pilot they can be a bear to get out. Rent or buy the pilot bearing tool. You can make one if you're cheap (like me) out of a big carriage bolt and a few odd plumbing parts if you have a grinder at your disposal. The key is to pull the bearing straight out. Yank on it at an angle and you'll be there for a lo-o-ng time, as in forever.

For the carriage bolt tool get one with a head bigger than the inside diameter of the bearing and grind it down to a pointy egg shape, Just small enough to slip inside the bearing at an angle but big enough to catch the inside of the bearing on both sides when you straighten it up. Throw a spacer over the bolt end (bigger than the outside of the bearing, 1-1/2" plumbing coupling works) a big fender washer, a nut and tighten it down. Mine popped out in four turns... this is after four hours of trying to yank it out with tools completely unsuited to the task. Good luck with it.