I mean that word actually means something, and at least it's not a verb people use as an adjective.

Just because you aren't bothered by things people describe as "toxic" in non-medical contexts doesn't mean it isn't a usefully specific and descriptive word.