From what I've told, after the inagural ceremony at Federal Hall, President Washington and the other politicans walked a block to the Trinity Church for a worship service. If I remember right, this is also where Nicholas Cage found the hidden treasure that he was led to by the dollar bill and declaration of independence.