Actually water is at its highest density at around 4 degrees celsius (~39 degrees Fahrenheit), then it starts expanding as the temperature goes lower.