Born in Istana Pelamin, Alor Setar, Kedah, Abdul Rahman was the seventh son and twentieth child of Sultan Abdul Hamid Halim Shah, the twenty-fourth Sultan of Kedah.
Abdul Rahman began his education in 1909 at a Malay Primary School, Jalan Baharu, in Alor Setar and was later transferred to the Government English School, now the Sultan Abdul Hamid College, Alor Setar, where he studied during the day and read the Qur'an in the afternoon.
Abdul Rahman's powers as Prime Minister were severely curtailed, and on 22 September, 1970, he was forced to resigned as Prime Minister in favour of TunAbdulRazak.