I always thought it went back to the fish metaphor. The scales are on the sides. Life is full of fish metaphors.