You may follow the steps to change the working day to a public holiday:
Go to the Core module, click Calendar Setup.
Select the Calendar ID.
Click on Work Calendar or Leave Calendar.
Click on the day you would like to change.
Right-click and change to P.
Enter the details for Holiday ID, Description and click Save.