Yes you can, and you can even say within a Company Record which locations are subject to the delivery charge.

Open the Company Record

Choose the appropriate Location from the the dropdown list at the top to display the the Location info

In the bottom right of the details check the box Delivery Charge Apply?

Select a Delivery Charge from dropdown the list

Save the changes