You do not rinse it well enough. ;) Give it a good hair shampoo wash and the soap smell should go away. (you should do that regularly anyway)

I had a 26mm GN silvertip. It was only very slightly...