I don't really "get it" but I have constant music playing in my head, so listening to music while riding doesn't work for me. Even when road riding. Shokz bone-conducting headphones seem to work for a lot of folks.
That said, passing someone with a speaker playing doesn't bother me. I only hear them for a few seconds. If we are going in the same direction, I'll change course. There are far more important things in the world to get butt-hurt over.
