I used a very thin flat head screwdriver. One of the caps got a minor chip but it was on the inside. Seriously thought I was going to break them getting them off.

To get the rail and tail fin off you need to pull the head liner.