Stay is a regular verb and like all regular verbs forms its past participle by adding -ed. Writing from A to Z provides a list of common irregular verbs on pages 340-342.

Check the following resources for useful practice material: 1) Guide to Grammar and Writing, 2) Colleen Hildebrand's UCI Correction Symbols with hyperlinks.