After countless hours of obsessing over grinders I finally came up with a solution to my grinder interfering with the wheel on my old setup.
This 8x2 iron caster has bearings (not sure how long they will last) and turns true.
I'm now working on a tool rest, and have ordered an entire set of 2x48 belts.
all thats left to get is the matching 6" and 4" caster and have a small drive pulley turned for slow speed finish grinding.
All in all it tracks perfectly straight and I cant wait to give it a go!

Special thanks to Spazzola, your post/videos about grinder setups are a great inspiration.