Step 1 - Login to your account
Step 2 - Locate the relevant location / store - under Configure -> Locations, press edit on the location you would like to set up it's delivery hours.
Step 3 - Choose the delivery zone you would like to edit hours: notice that each delivery zone might have a different hours. [Press Edit]
Step 4 - set the delivery hours: please notice that you can define different hours for different days. By "Add more hours" you can "split" the day allocations, and set different time for each day.