Did you pull the small cover that sits above the main door panel to see if you can remove the mirror without having to pull the entire door panel?
If you do have to remove the entire panel, behind the grab handle for pulling the door closed, there is a small plastic cover, pull it off, there is a screw behind there.....also, behind the door handle for exiting, I believe there is also a plastic cover with a screw behind it.....the rest are clips, pull hard working your way around, then slide the door panel up and off.