Born near Delta, York County, Pennsylvania, he was the son of Joseph and Jane (Graham) Ross. At eighteen, after having received a classical education, he moved to Canonsburg, Pennsylvania and taught at what would become Washington and Jefferson College. He studied law and was admitted to the bar in 1784 focusing on land law. A Federalist, he was a member of the convention that drafted a new constitution for Pennsylvania in 1789-1790.