Nah. It's either there or it isn't. Some have had it split in 2 during removal of the PCV. I just noticed that the lower half of mine was gone when I pulled out the PCV & the grommet came with it. If you're getting some oil residue around the PCV, then you may want to replace it.
Note: Check the grommet before you go to buy a new PCV since the new one will NOT come with it. You don't want to have to make 2 trips to the parts store.