Fair question. That is something you'd take to HR.

If you think you can't have that conversation with HR (fear of retaliation or mis-understanding etc), then I perhaps a consultation with a attorney that specializes in labor law and the workplace.

That is what I'd do if I felt it was a real problem.

Don't talk to HR. It will escalate the entire situation and you gain nothing. It's like going to the teacher when you don't get along with kids at school - everyone's gonna hate you even more. You need to deescalate the situation and talk to people personally. If that doesn't help, it is time to move on...