If you can feel the scratches with you thumbnail, you should probably lap them out. There is a good article on lapping in the wiki here:
Hone Lapping 101 - Straight Razor Place Wiki