This building started as a one story building in 1675 and was the first converted market in New York. It was soon replaced by a two story building in 1752. The first floor was the primary market place, and the second was used more for social events such as concerts or a meeting hall. When the Revolutionary War ended, this building became the home of the Supreme Court, but only for short time. While the first session began in 1790, the Supreme Court left for Philadelphia in 1791.