The correct answer is "was staying".
Explanation:
The sentence describes an action that was in progress at a specific time in the past (from 1 to 5 o'clock yesterday). Therefore, we should use the past continuous tense (was/were + -ing form of the verb).
Answer: was staying