Turns out that the previous owner (I'm guessing) when he did some welding on the Oddy frame got some weld splatter on the collars on the drive shaft. After I found the splatter and lightly ground them down the pillow block came off easily. Thanks for your reply(s) !!!