Yeah, you'll have to take the interior panel off. BE CAREFUL! It's easy to break the clips on the black armrest that houses the window switches. There is 1 screw in the interior door handle and two more behind the armrest. Like Scott said, you may have to remove the window.

If you're not doing this right now, I may have some photos from when I replaced the entire lock mechanism and they probably show a view of the clip in place. I can post them in a few hours.