I actually do both!

I rinse most of the lather and stuff off, and then give the razor a wipe on a flannel I have by the sink.

It never even occured to me to do one or the other, I just did...