50 Cent says celebs are 'silent' on Diddy because 'they've been to his parties'