Gharib Mirza seems to have left Shahr-i Babak few months after assuming Imamate. He seems to have repaired for about one year out of Shahr-i Babak, leaving behind his hujjat, called Badiuddin Khwaja Kassim, and at length settled down in Anjudan, most possibly in 900/1494. Pir Shihabuddin Shah (d. 1884) also writes in his "Khitabat-i Aliyya" (pp. 42-43) that, " The thirty-fourth Imam Abbas Shah (Gharib Mirza) was obliged to live for some time away from his ancestral home (watn-i maluf), i.e., Shahr-i Babak." The reason of his absence was that the rambling bands of Chaghatays and Turkomans had once again gushed from Jurjan and Tabaristan after being supressed in 883/1478 by the Ak-Koynunlu commander, Sufi Khalil Beg. They plundered the surrounding localities of Kirman and Sirjan.
Anjudan (Injodan or Anjidan) is situated at the foot of relatively low rocky range, about 37 kilometers east of Arak (former Sultanabad) and about the same distance westward from Mahallat in central Iran. It is separated 35-40 kilometers with Kahek by a number of shallow ranges, and is also close to Qumm and Kashan. The Ismailis had begun their settlements slowly in Anjudan most probably during the time of Imam Mustansir billah II, and had taken there agriculture. It was the cradle land of the Ismaili mission in post-Alamut era. The Syrian Ismailis called Anjudan as "the abode of the faithfuls" (dar al-mominin). It was simply walled to protect the populace in times of insecurity.
Gharib Mirza at length shifted to Anjudan and kept himself completely out of the vortex of politics, and passed a life of darwish, where he became known as Gharib Mirza i.e., "an unknown stranger." Earlier, he was generally known as Abbas Shah. He also applied the name Gharib Mirza in his writing in Anjudan. His eloquent power was impressive and sweet, and was highly respected among the local non-Ismaili orbits. He was a man of affable temperament and wide human sympathies which made him a popular figure in the locality. An anonymous manuscript dating about 1196/1782 cites the anecdote of a certain peasant, whom the Imam had gifted a piece of land in Shahr-i Babak, who in turn said, "Sayed Gharib Shah is a generous like his ancestor, Imam Jafar Sadik." He thus had set an example to the local people by an act of humanity and generosity which created a salutary effect upon his fellow-citizens.