Yes if you took the view point that all Nazi related items be destroyed you would have to persuade the Polish government to destroy the Auschwitz concentration camp, the French Government to destroy the U-boat pens at Lorient Keroman Submarine Base and so on. What would be the point? You cannot deny or rewrite history, only learn from it if you can.
It is a personal choice for an individual as to whether or not they wish to own Nazi related items. There is no right or wrong decision only what is right for that individual.
Bob