The first mention of a castle at Merrion is in about 1334, when it was in the possession of Thomas Bagod, a descendant of Sir Robert Bagod, who had built Baggotrath Castle about 1280. In the late fourteenth century Merrion Castle was owned by Sir John Cruise, a leading diplomat and soldier. In the fifteenth century both castles came into the possession of the Fitzwilliam family, who became the most substantial landowners in Dublin; James Fitzwilliam, the Chief Baron of the Irish Exchequer, married Sir John Cruises's daughter. Until the late sixteenth century Baggotrath was the Fitzwilliams' favoured home, for possession of which they fought a bitter private war with the Cornwalsh family in the 1440s. It was Sir Thomas Fitzwiliam, grandfather of the first Viscount, who in the reign of Elizabeth I made Merrion Castle the principal family residence.
During the English Civil War, possession of such a strong fortress so close to Dublin was clearly of crucial importance to both sides in the conflict. The Fitzwilliams, who were staunch Royalists, installed a strong garrison; but in June 1642 the castle was betrayed to the Parliamentary side, and remained in Parliament's hands until the Restoration. The second Viscount, Oliver Fitzwilliam, later Earl of Tyrconnell, who had some influence with Oliver Cromwell's son Henry Cromwell, pleaded for its return, but without success. Given the traditional loyalty of his family to the Stuart dynasty, he might well have expected its speedy recovery in 1660; but the bitter divisions in post-Restoration Ireland, which saw Tyrconnell accused by his enemies of being a supporter of Oliver Cromwell, caused a delay in the full restitution of his lands, and he did not recover Merrion until 1663. Though it had suffered much damage during the military occupation, Merrion was still a substantial dwelling; for the purpose of the hearth tax it was assessed at sixteen hearths, making it one of the largest private dwellings in Dublin. Lord Tyrconnell in his last years did much to improve the castle, where he died in 1667. It remained the main family residence until 1710 when Richard FitzWilliam, 5th Viscount FitzWilliam began the building of Mount Merrion House.
Ruins of Merrion Castle
After 1710 the castle was entirely abandoned and it quickly fell into decay. By the late 1720s it seems to have been little more than a ruin, and the newspapers reported that the site was infested with large and savage rodents called italic=no. The "italic=no" was almost certainly the brown rat, which is recorded in Ireland from 1722, a few years ahead of its first appearance in England. Gabriel Beranger sketched the ruins around 1765. Austin Cooper surveyed them in May 1780, but on a second visit found the castle being demolished. The Topographical Dictionary of Ireland 1837 states that some ivy covered ruins of the castle still existed at that time.