But how would they know which house to just treat like criminals once something happens? Or which children can be bullied for possibly becoming evil later on for having a hat tell them to be in the "evil" house?