I don't really know any remedies for them, but perhaps someone else in the forum can give you some good advice on treatment. I don't suffer from ingrowns like others do.

I've found that I have some very difficult spots on my neck that sometimes I just cannot get very well with my straight razor sometimes. I find that streaching the skin in that area is even more critical than other places for me. One thing that has helped lately for me is to use a lot less pressure than I do on my checks with the straight and stretch the skin as much as possible and don't try to get silky smooth shaves on that part of my neck.

It's not worth the trouble it causes for me, so I just shave one pass there and try to remove as much of the beard there in one pass and leave it at that.