It would be better to have this issue raised in a wider context.
Every religion believes that the people who do not belong to it are muggles to say the least (and people outside know / understand / feel this).
New Testament Jesus says:
He that is not with me is against me; and he that gathered not with me scattered. (Luke 11:23, Matthew 12:30)
These words find an alarming incarnation at the time of the Inquisition and in the dogma of eternal torment in hell.