I need to make an exception to a resource that I've made available for reservations. Can I do this?

Yes!  Find the resource and select edit next to the line item detail, then select Create Availability Exception. Select the date and time that you want to add the exception to and save the changes.  View the changes on your Public site.