If the Profile Field for Phone number is not required, then the phone number for an address added to a site account should not be required.

If you set the Profile Field for the Phone number to be not required, and the site user adds an address to their account, the phone number is still a required field. Profile Field settings, such as what is required, should carry over to the address settings when adding a new address.