So i think i figured out my problem. It is the Xbox privacy settings, my account is bugged and does not have the correct settings to change them. It has to be raised with XBOX support.
When i log into privacy settings i dont see "Other Can:" which is where you change the communication settings. You should all check this and if its missing log with Microsoft /xbox support.