I highly recommend The Stonehouse in Guilford. Upscale, but not stuffy. Right on the water, old stone house, lobster boats 50 feet away and run by experienced NYC folks.
I sell chemicals to the foodservice industry and know this place well.
About 10 minutes from Waters Edge.
Bill’s is great, but can be a bit rowdy and may be closed in the winter, but has great food and a view in the summer.