Jervis Bay can be a confusing name, people mean different things.
Jervis Bay town itself, which is really small place, with a military population with a general store and not much else.
Jervis Bay - the Bay - a very large bay.
Jervis Bay - the traditional tourist area - Huskisson to Vincentia strip. From Husky Pub to Vincentia shops, a strip of holiday homes, restaurants, shopping, cabins, motels, beaches.
Jervis Bay - Booderee - National Park and Nature. Camping, Green Patch. Beaches.
Jervis Bay - the insta destinations - This is Hyams and surrounds. Right next to Vincentia, but you can't drive directly there.. you have to come out and in again along another narrow road, to a town that gets thousands of visitors, with a single coffee shop, and limited parking.
So, Vincentia puts you close to the centre of the traditional tourist area. Easy access to the boat tours, walks, playgrounds, restaurants etc. It would be my preferred place to stay in Jervis Bay.