Remove billing address when using credit card payment methods

I would like to see the billing address go away on the checkout page if the user is paying with a credit card. We use PayPal, specifically, and the billing details are caputed on PayPal's site, so there is no need to collect that information on the checkout page.