It's far easier (and less insane) to take your wheels to a machine shop and have them bored to the proper diameter. Grinding down the hubs is like removing bone from the perimeter of your skull to make a tight hat fit. Just adjust the hat.