The Mull of Galloway at the end of the Rinns of Galloway is Scotland's most southerly point. Drummore is a few miles north of it, the southernmost village in Scotland, and (unexpectedly) further south than the English cities of Newcastle and Carlisle. It is about 16 miles from the nearest major town, the ferry port of Stranraer, to which it is linked by good bus services (a railway was proposed in 1877 but was opposed by a major landowner, the Earl of Stair, and finally abandoned after the failure of the City of Glasgow Bank in 1882).

Drummore lies where the Kildonan Burn runs out to the sea, and shares its name with High Drummore a mile up Glen Lee, and also with Durummore Glen half a mile to the east. The name is the Gaelic "druim mor" or "big ridge", and it has been suggested that it was named for the motte associated with the castle of the Adairs of Kinhilt, whose lands were granted in 1602 by King James VI. The rather scattered names, however, probably make it more likely that the hill-ridge itself is in question, for all that at 200 rising to 300 feet it is not all that prominent compared to the 450-foot Muntloch Fell and Inshanks Fell a mile or two to the west, or even the 250-foot Mull of Galloway itself three miles to the south.

The southern Rinns was clearly an area of early Christian activity following the missionary work of Ninian across Luce Bay in the Machars, since a number of local place-names evince the presence of Irish saints. Shortly before 1860, at Low Curghie less than a mile up the coast north of Drummore, and not far from an extant standing stone, a gravestone was discovered which appeared to date to the 5th or 6th century, with a weathered Latin inscription in which the name “Ventidius” was legible along with another word which translated as “sub-deacon”. Many place-names testify to Norse influence in the southern Rinns, as in many of the west-coast islands and peninsulars, but Drummore's Gaelic name is in tune with the general use of Gaelic in Galloway after the Dark Ages until it was supplanted by English under Presbyterian influence in the 17th century.

The harbour, facing east and hence shielded by the Rinns from the prevailing south-westerly wind, was developed with a jetty in the early 19th century to serve a lime manufacturing industry. For many years in the hands of the UK's Ministry of Defence as part of the management of their bombing range and weapon development area offshore in Luce Bay, it was taken over in 2004 by a private firm, the Drummore Harbour Trust Ltd, with the aim of developing its use for pleasure boats.

The village’s facilities include the Queen's Hotel, a post office, a tourist office, a garage and a general shop on the main street leading westward from the harbour; a primary school; the Ship Inn on the shore; a bowling club and children’s play park; a number of holiday cottages; and two caravan sites near sandy beaches (one of them associated with another pub).