New galaxies were still forming 2-4 billion years ago, billions of years after the highest point of star formation in the universe has been thought to have occurred.