Being able to collapse a lifter with just finger pressure on the rocker arm is NOT normal. Either clean and reassemble, or replace any lifter in that condition. While it's possible to make a lifter bleed down with a heavy, constant pressure against it, like with a pry bar, it should not be able to be compressed easily.
Jerry