Evidence that supports quasars being the nuclei of very distant galaxies includes
1) the existence of quasar fuzz.
2) the observation of a supernova near a quasar whose distance from its brightness is consistent with the large redshift.
3) gravitational lensing of some quasars by nearby galaxies.
4) all of the above.