The rear seats may also be rattling a bit. You may want to adjust them up or down and see if different positions make a difference.
I found that the passenger seat rattles around when only the driver is in the car. If you adjust it more upright it seems to help.