Do grad school recommendation letters have to be put in letterhead envelopes?

Obviously, the purpose here is to ensure that the letters are authentic and not tampered with: letterhead (and envelopes) from the referee's place of work, signature across the seal. The signature is most important, but your referee could set out explicitly that he is a former employee of wherever -- that would explain the lack of letterhead.