The first piece of evidence is the cosmological red shift. when an object moves away from us the light waves are stretched to the longer wavelengths and lower frequencies. In an expanding universe light fro distant stars is said to be red shifted.
Cosmic microwave background radiation. This radiation is very low energy and very uniform throughout the universe. This energy is theorized to be leftover from the Big Bang.