Am I the only one who doesn't trust voting by mail?

For some reason it just sounds suspicious, and i do undertsand that some people can't make it to the voting booth for several physical reasons, but how does it work exactly? do they wait until election day to add them to the tally?