Iconoclasm in western Zen

Recently I have been faced with the same notion, coming from several different people that mainly practice (western) Soto Zen.

They had all very strong opinions on statues/ images of buddhas and bodhisattvas that made me rather sad. They are often against images on altars and even quite hostile towards the concept, always citing this and that koan, saying Zen master xy also destroyed buddha statues or burned sutras, and take this as a direct guide to their behaviour and a reason to be openly disrespecful towards buddhist statues and images.

I know it's their own twisted notion of emptiness, and not being attached to statues and rituals etc, I've unfortunately heard that so many times in several forms and contexts. How do you react to these? I often just smile and nod through it, because I don't want to start a fight or anything, but it really gets to me.

If some of you have a good roundabout "why zen isn't as iconoclastic as you might think" write up that would be great. Not even to use in an argument, but mostly for my own peace of mind. Or just any thoughts or experiences you have on the matter. I appreciate the input.