Can you use, "Ça me n'est pas égal", to mean it does indeed bother you?

Hi Vernon,

I have checked with other French people in France as it sounded odd to me and they agree to not having heard it used.

We would probably say something like "Je (ne) suis pas d'accord avec ça. "

Hope this helps!