I woke up last night thinking of all the possibilities and had one more thought. Since the bearing is hollow (note the bolt sticking out in the picture above), I wondered if a screw extractor might let me twist it out.

TA DA!!!!!

Thanks everyone.