Cosmic Latte: The Average Color of the Universe