I use my Swaty much the same way, (except for the shirt with the pockets...LOL...
They are great little stones. Invaluable....

Just a couple of swipes before I shave, and I rarely need to hone....