Does the size of a secondary mirror determine how big images are at the eyepiece?

No. But it does determine how bright the individual star and planet images will be if the secondary mirror does not match the projected size of the primary mirror at its distance along the optical axis.