Sydney Harbour would not be the same without Fort Denison in the middle of it, but be warned it is Very Small and you can see all there is to see in about twenty minutes; then you are Trapped until the next ferry comes (or you fork out for a water taxi).
More