The school is located on in an area of Fredericksburg bounded by George, Kenmore, William and Barton streets. The site had been previously used as a potter's field and an African-American cemetery. Prior to construction, the graves were relocated to Shiloh Cemetery in Fredericksburg. The original school building was Fredericksburg High School. It consisted of one building facing George Street. An auditorium was added to the school in 1930. In 1937, the school was enlarged with the addition of James Monroe Elementary School, a separate building connected by a covered walk, and the name was changed to James Monroe High School. In 1952, when the city built a new high school, the building was renamed Matthew Fontaine Maury School and served as the city's middle school until it was closed in 1980. After the school was closed, it was used for several years by the Fredericksburg Police Academy and, later, as a homeless shelter. In 2007, the Maury School building was converted into condominia.
Maury stadium
Included in the Historic Places designation is the school's stadium. This stadium was built in 1935 and, despite the construction of two different high schools to replace it, James Monroe High School sports teams continue to use it for home games. On the slope between the school and the field, bleachers of stepped-concrete bleachers were built. A brick balustrade forms the edge of the spectators' area. The stadium has been called "the City Stadium". It is the largest public gathering place in Fredericksburg. It is the venue for concerts and other community events. The stadium was also home to the Fredericksburg Dog Mart. The Dog Mart began with a 1698 agreement between the village that was to become Fredericksburg and the ManahoacIndian tribe. Held each year, this event brought as many as 15,000 people to the school.
Maury School reflects a Colonial Revival-style architecture. The school is made up of three matching buildings with 65,000 square feet of space. The first building opened in 1920 and was called Fredericksburg High School. The school was designed to serve white students in grades 7 - 12. In 1930 an auditorium and gym were added. An identical building was built in 1937 to house elementary school students and is connected by a covered walkway. The architect of the buildings was Philip Nathaniel Stern of Fredericksburg, who was also architect for many of the buildings at what is now the University of Mary Washington. Historian and writer Jack D. Warren, Jr. called Maury School "the best example of institutional Colonial Revival architecture in Fredericksburg".
