In 1951, when the Conservatives returned to power, Morrison was elected Speaker of the House of Commons. He was opposed by Labour MP Major James Milner, who said it was his party's turn to have a Speaker of the House. It was the first contested election for the post in the twentieth century. Morrison was elected in a vote on party lines.
Morrison held the post of Speaker until 1959, when he resigned from Parliament. As was customary for former Speakers he was made a Viscount, taking the title Viscount Dunrossil of Vallaquie.
He was appointed Governor-General of Australia the same year. By this time support for the idea of British Governors-General was declining in Australia, but the Liberal Prime Minister, Robert Menzies, was determined to maintain the British link.
Dunrossil took office in February 1960. Exactly a year later he died suddenly in Canberra, the first and only Australian Governor-General to die in office.
Sir Ronald Craufurd Munro-Ferguson (from 10 Dec 1920 1stViscount Novar, of Raith, in the County of Fife, and of Novar, in the County of Ross)
Alexander Gore Arkwright Hore-Ruthven, 1st Baron Gowrie, of Canberra in the Commonwealth of Australia and of Dirleton in the County of East Lothian (from 8 Jan 19451st Earl of Gowrie, 1stViscount Ruthven of Canberra, of Dirleton, in the County of East Lothian)
William Shepherd Morrison, 1stViscountDunrossil, of Vallaquie in the Isle of North Uist and County of Inverness