Maybe you kept pushing it back in?

An infection maybe would have solved it quicker. I have removed many slivers by letting them get infected for a day or two and the pus pops them out easily.