The relay is what sends power to the starter assembly, both the motor and the solenoid. The solenoid is there to make the spur gear in the starter engage with the flywheel.
Usually it the starter motor that goes, not the solenoid, but it's not unheard of. Doesn't the starter spin when you...