The club was established in 1907 and joined the Mid-Herts League. In 1955 they moved up to Division One A of the Hertfordshire Senior County League. Following a third-place finish in their first season in the division, the club were promoted to the Premier Division. They went on to win the Premier Division title in 1956–57, and after finishing as runners-up in each of the next two seasons, were champions again in 1959–60. The club won the Herts Intermediate Cup in 1974–75 and again in 1982–83. London Colney were Premier Division runners-up again in 1985–86 and were champions the following season. They won back-to-back titles in 1988–89 and 1989–90 before moving up to Division One of the South Midlands League in 1992. The club were Division One runners-up in 1992–93 and were promoted to the Senior Division. They were Senior Division runners-up and the following season and won the Herts Charity Shieldfor the first time. In 1994–95 the club won the Senior Division and the Herts Senior Centenary Trophy, earning promotion to the Premier Division. In 1997 the South Midlands League merged with the Spartan League to form the Spartan South Midlands League; London Colney were placed in the Premier Division North, and following a third-place finish in the league's inaugural season, secured a place in the Premier Division for the following season as the league underwent reorganisation. After winning the Herts Charity Shield again in 1998–99, they were Premier Division runners-up in 2000–01 and went on to win the league title and the Challenge Cup the following season. However, following a decline in form, the club finished bottom of the Premier Division in 2007–08 and were relegated to Division One. London Colney won the Herts Senior Centenary Trophy in 2009–10 and were Division One champions in 2011–12, earning promotion to the Premier Division. They were Premier Division runners-up in 2014–15 and 2015–16 before winning the league title and the league's Challenge Trophy in 2016–17. However, the club declined the opportunity of promotion to the Isthmian League.
Ground
The club played at Whitehorse Lane until 1976, when they moved to Cotlandswick Park, which had previously been the sports ground of Marconi Instruments. A breeze block stand was built on one side the pitch after the previous stand was destroyed by vandals in 1986. The new stand was later replaced by a seated stand.