Why not?

I usualy don't shave with my glasses on but if I do the only problem I have is solved by taking them off when I lather so I don't get them full of soap!