Sounds like it's either the radius arm bushing or ball joints, or both. Either way, if the wheel bearings scared you off then there is no way you'll be able to tackle the ball joints.
Jack up the suspect wheel and do what engera suggested. Then have someone step on the brake while you try...