Why do you say "he's pulling it off" when somebody manages to wear something strange without looking like a total nutter? Wouldn't it be more descriptive to say "he's keeping it on"?
Because, really, if you're pulling it off, you should be keeping it on.