Commandant’s House This unusual mansion, built in 1805 just three years after the commissioning of the Navy Yard, is in private hands and remains one of the most mysterious and intriguing private residences in the city. It is rumored to have been designed by Charles Bulfinch, the architect of the U.S. Capitol’s wings, rotunda, and portico.