Never put a CD in the 6th slot of the factory CD changer. This has saved me from problems with the changer for two years.
I had my changer replaced twice under warranty, so it took me a while to figure it out.
Without a disc in the 6th slot the changer works flawlessly, two years for me now. Your mileage may vary.