Yes you can, and you can even say within a Company Record which locations are subject to the delivery charge.
Open the Company Record
Choose the appropriate Location from the the dropdown list at the top to display the the Location info
In the bottom right of the details check the box Delivery Charge Apply?
Select a Delivery Charge from dropdown the list
Save the changes