I am surprised that Rickster never had a fail-safe mechanism put in. I have done shaved door handles for customers in the past and every kit always had a manual trigger located under the drievrs side door to open the driver's door, IF the alarm was off/door unlocked. My guess is, he didnt use a kit and probably did some custom setup of his own.
And yes, a door swap is your best bet, even though paint matching is NEVER gonna happen with that custom job. Reworking your existing doors to grind out the plastic and cut out the spotted in sheetmetal is far above and beyond a simple fix.
I would just get a shop that deals in automotive electronics to see if they can find and resolve the existing problem and live with the shaved handles. Its not gonna be an easily reverse engineered solution since you are dealing with that custom paint.
Gary Noonan
'01 S/C VX / '18 Forester XT