The hermitage of Sant Josep de Pego is located within the town center, in Pla de la Font. Like the other three hermitages of Pego, it became a focus of Christianization.
Pego was characterized, like the rest of the territories during the Muslim domination, for being divided into farmsteads that depended on a castle. Among many other farmhouses in Pego, Atzeneta is where the Sant Josep hermitage is located, which is based on the mosque that existed there.