When I replaced my speakers, I had to remove the panels. It wasn't very hard though. I put in all four speakers in about 45 min. I'm not sure about the newer X's though. I didn't have to mess around with the wiring at all. You also need to detatch the window/lock controls from the panel before you take it off.