In 1853 Syed Inayat Ali Shah and Syed Ameer Shah permanently moved to the new mansion in Dera Ismail Khan. At the time of settling in Dera Ismail Khan the political and religious landscape had considerably changed and the minds and hearts of Dera’s residents had changed accordingly. The Syed’s were despondent at the end of Sadozai rule and the women of the Sadozai family did not wield the same power that they once used to.
When the Syeds came back to Dera (after the events in Darya Khan as mentioned in 13) some troublemaker Sadozai’s challenged the ancestry of the Syeds and asked to be shown proof whether they truly belonged to Syed family. The discussion about the legitimacy of the Syed ancestry went on long enough to where Syed Ameer Shah passed away without the resolution of this issue. After his death and burial at “Tibba Fazil Shah”, the legitimacy issues were brought front and center. Things regressed to the point that one day, a Sadozai Khan publically and openly confronted and challenged Syed Inayat Ali Shah about the legitimacy of his connection to the Syed ancestry while walking about one day.
Syed Inayat Ali Shah was unhappy at this confrontation and asked for the Syed Naqvi-Bukhari-Jalali ancestry tree, for confirmation, from fellow Syed relatives – the offspring of their and Syed Inayat Ali Shah’s progenitor – Syed Mohammad Shah Meeran Shah Mauj Darya. To further prove the lineage at Syed Inayat Ali Shah’s written request via mail Syed Nad Ali Shah, Syed Asghar Ali Shah, Syed Murad Ali Shah, Syed Jewa Shah, Syed Khair Shah—all descendents of Syed Zinda Talha Noori—residents of Lahore came to Dera Ismail Khan in person to attest to the matter.
On Wednesday August 19, 1868 at the office of Makhdoom Chan Charagh son of Makhdoom Noor Zaman Shah after attestations, verifications, and testimonials the family tree presented was authenticated. A month later on 29 Rabi-us-Saani, 1285 Hijri i.e. Tuesday 13 October, 1868 at a luncheon was arranged at the residence of the Nazim of Dera Ismail Khan Abdullah Khan Sadozai son of Hafiz Ahmed Khan Sadozai through Ghulam Rasool son of Abdul Hakim belonging to the race Saahi and a resident of Moza Chehkaan. At the end of the luncheon the authenticated family tree of the Syeds was presented to the Sadozai Khan who raised the most ruckuses. Immediately, upon satisfaction the said Sadozai khan apologized for his allegations and The Syeds was recognized as the direct descendents of the Prophet Muhammad (SAW). It was then that the Syed Inayat Ali Shah accepted this apologies and the matter was then ended.