Yes
you should check the voltage.
But, odds are your problem is down stream. It sounds more like you have a corroded plug or it has become disconnected. Trace the wires backwards from both, following the wiring harness. Inspect and clean each plug connection. Odds are they both run to the same plug. Those tend to foul up in older cars and trucks.