Galactus

Galactus was driven away early in the career of the Fantastic Four and hasn't been back (it's a big universe). The Silver Surfer stuck around, has long since escaped the boundary of the Earth, and comes back occasionally.