The connection at the speaker is probably loose. You can get to it very easily by popping the door panel off and removing the speaker, usually just 4 screws. Then remove the speaker connection and reconnect.
Otherwise, make sure the wiring harness is secure at the stereo.