ahorseback
/əˈhɔːsbak/(also a horseback, a-horseback) Now somewhat archaic (US informal in later use)
adverb
On horseback.
Origin
Late 15th century; earliest use found in William Caxton (1415x24–1492), printer, merchant, and diplomat. Apparently from on horseback, with reduction of the first element.