From Historical Rutland: an illustrated history of Rutland, Vermont, from the granting of the charter in 1761 to 1911 by Rev. F. E. Davison, Rutland, Vt.: P.H. Brehmer, 1911, page 8:
Federal Square
In the center is a square, containing about five English acres, known by the name of Federal Square (which name I had the honor to give it); in front of this, on the east side, stands a court house. built of wood, by no means an ornament to the place, owing to the bad taste, and want of judgment in architecture of the committee appointed to layout the money, which was raised by voluntary contribution, for the purpose of erecting this building. In this are held the sessions of the General Assembly (established here and at Windsor alternately), the District Court under the Federal government, the Supreme Court of the State, the Court of Common Pleas, and the Court of Probate for the District of Rutland. The Goal [Jail] stands about one hundred rods south of Federal Square, on the west side of the main street; it is a good building and answers every purpose for which it was designed. About half a mile north of the court house is a neat church. On each side the square and main street, are built some handsome and elegant houses; particularly on the east side are several which draw the attention of all travelers, the largest of which was intended for the residence of the Bishop of Vermont.