You simply need more time on the 4K side.
A 4000 grit stone will be slow, not much metal removed on it.
Keep at it:)