The pair, aged 12 and 13, had clambered down cliffs beneath the ruins of the castle and oculdn't get back up.
One of their friends, who was at the top of the cliff, raised the alarm at about 8.20pm and called emergency services.
Clyde Coastguard arrived on the scene and lowered one boy into a lifeboat whilst the other managed to eventually reach the top of the cliffs on his own.
The boat then sailed to Portpatrick and the boys were taken to safety.
One of the boys was taken to hospital for a check-up but neither were seriously injured.
It was the second rescue operation on the Solway Coast in 24 hours after a man was stretchered to safety from rocks at Brighouse Bay, Kirkcudbright.
Officials are now warning people to be aware that despite the fine weather, coastal areas can still become wet and slippy and extra precautions should be taken.