I think it would depend on how it was done, if you use both pins (make a new hole in your cargo carrier) the weight doesnt move any further from the frame which is the concern. It would put more stress on the hitch itself, but thats never been an issue to my knowledge, the weight is transferred to the frame in the same manner
if you re-use the existing hole in the cargo carrier and just use 1 pin, you will definitely increase the distance from the frame and increase the twisting effect.
the reason i have a problem with wheel spacers is not the stress on the steering/suspension components, its the stress on the wheel studs. a spacer which lets the studs pass through creates two shear points on the studs, and moves the weight farther down the studs. a wheel spacer that bolts to the hub and has its own studs reduces this and is less harmful to the vehicle. but as far as wheels with low offset vs wheel spacers, the stress on the suspension and steering is the same