Most likely it is the solenoid. However the converter could just be bad. The stock converters are famous for this. I would have it looked at, because if the converter clutch takes a dump, it can send material through your whole tranny. Can cause you serious transmission problems, or can lead to a rebuild. There are upgraded converters available with a much better lock-up clutch and brazed fins.