yes start with a code scanner.. it's obd-1 for you're explorer.
if it's not throwing codes constantly, and it sounds good, then i'd probably start with the fuel system...
maybe the fuel filter is clogged? replace it, it's a good idea to replace the filter every 50k miles anyhow.
also try a bottle of injector cleaner (or premium fuel with "techron" or other cleaners in it) what state are you in?
Since you're ecc power relay seems to be giving issues, i'd replace that (or at least clean it's terminals very, very good, as well as the socket) it could be an electrical problem causing the whole thing just because of some resistance in a cruddy connection at that relay.