Greenleaf was born in 1857 in Kortright, New York. His father, Thomas Greenleaf, was a member of the prominent Greenleaf merchant family, but had retired to Kortright due to failing health. His mother, Eleanor Leal, was of Dutch and Scottish descent. He was the fourth of five children, and the only son, born to Thomas and Eleanor. The Greenleafs were Huguenots who fled France, anglicizing their family name to Greenleaf. Greenleaf's great-great-great-great-grandfather, Edmund, was born in 1574 in Ipswich, Suffolk, England. His great-great-grandfather, Enoch, was born there in 1647, and the entire family emigrated to Salisbury, Connecticut, in 1650. His great-grandfather, Thomas, was the founder and editor of Greenleaf's New Daily Advertiser. He was a distant relative of James Greenleaf, the infamous Washington, D.C., land speculator and whose sister married Noah Webster. Greenleaf later credited his childhood in the Catskill Mountains for giving him a love of landscape architecture. His father's wealth enabled Greenleaf to be educated at Delaware Academy in Delhi, New York. He entered the School of Mines at Columbia University, graduating with a bachelor's degree in civil engineering in 1880. After graduation, Greenleaf was hired by the United States Census to engage in a two-year survey of water power. He worked primarily in the areas around Niagara Falls, the Mississippi River, and in Alabama. Greenleaf took a teaching position as an Assistant at the Columbia School of Mines in 1882. He was promoted to Tutor, Instructor, and Assistant Professor. Increasingly engaged in the practice of civil engineering, he became an Adjunct Professor, and then left the school entirely in 1894 to become a full-time civil engineer. In the late 1890s, Greenleaf turned to the practice of landscape architecture. Working primarily on Long Island and in Connecticut, New Jersey, and Westchester County, he designed estates for Frederick William Vanderbilt, C. Ledyard Blair, Mortimer L. Schiff, Jacob Schiff, and a number of estates for the Pratt family: Pratt Oval, The Braes, Welwyn The Manor House, Poplar Hill, and Killenworth. Killenworth is considered his greatest achievement. Pratt's most visible landscape design, however, was for the Lincoln Memorial, which he did for memorial designer Henry Bacon between 1913 and 1916. President Woodrow Wilson appointed Greenleaf to the U.S. Commission of Fine Arts in 1918. He served on this body, which had statutory approval authority over the design and siting of memorials and monuments in Washington, D.C., as well as advisory authority over building design in the city, until 1927. After World War I, he authored the landscape design for seven American battlefield cemeteries in France and Belgium: Aisne-Marne American Cemetery and Memorial, Flanders Field American Cemetery and Memorial, Meuse-Argonne American Cemetery and Memorial, Oise-Aisne American Cemetery and Memorial, Somme American Cemetery and Memorial, St. Mihiel American Cemetery and Memorial, and Suresnes American Cemetery and Memorial. During his time on the Commission of Fine Arts, Greenleaf consulted on landscape design in a number of national parks. In 1924, he was elected into the National Academy of Design as an Associate Academician. After his retirement from public service in 1927, Greenleaf rarely worked. However, he did consult with the firm of McKim, Mead and White on the landscape design around Arlington Memorial Bridge in 1931 and 1932. In retirement, Greenleaf devoted himself to landscape painting, working primarily in Italy and on the Isle of Skye. His work was exhibited at the National Academy of Design in New York City.
Greenleaf married Bertha Potts of New York City on June 14, 1899. She was the daughter of George A.H. and Helen Potts, whose wealthy mining family founded Pottsville, Pennsylvania. They had a son, Donald Leal Greenleaf, born June 5, 1890. Bertha Potts Greenleaf died in 1911. Greenleaf was a Republican, but not active in party politics. He was a member of the Columbia University Club, the Cosmos Club, and the Century Club. He was an associate of the National Academy of Design, and served several times on juries for the American Academy in Rome. He was a long-time fellow of the American Society of Landscape Architects, and served as its national president from 1922 to 1927.