8BA hone lifter bores, need advice

I bought Egge adjustable lifters. I installed them and went to work adjusting them. They were tight and as I was holding them with an Allen wrench, the pinholes that are drilled through the bores got distorted and now I'm getting interference. Most of the lifters no longer work freely. I've got a 1" ball hone and a blade type brake cylinder hone. I can't find any real advice on doing this though. Anyone on here have some wisdom? The 1" ball hone feels really tight in the bore.