How are you trying to remove it? Generally they come out pretty easy if you drive one side into the block with a hammer and punch, then pry it out by the edge with water pump pliers (channellocks).
I've used the slide hammer technique on flat plugs, and real small ones, but the other way is easier on "normal" freeze plugs