This nautical corner of the city is full of history and great food