Basically if you want it cleaner you will have to spend more time on it.
Personally I would drop below 400 grit, maybe 240 or somewhere around there. Then dont move up in grit until your satisfied...