Cleaning vibrator?

ok so yesterday i bought one and tried it out and then ya know cleaned it like you are supposed to and i got one of those Pearlized Vibes from spencers and i dont know if i was washing it wrong or something but like the metalic stuff was coming off so it is looking all plain and not pearly i guess is what i want to say... but is this normal? am i cleaning it too hard maybe?