Imo, yes, you were out of line.

The amount on the envelope is only the shipping amount.
Add the cost of the envelope, which could be a dollar.
Then add the cost of gas for driving to the post...