What happens when you have a boat that draws more than average is that you plan around destinations that fit you. Our boat draws 7'2" (2.2 m.) and sure, we don't go to shallow places. Funny
thing, though, I think most of those shallow places are too close to shore, too full of sandflies, mosquitoes, and midges, so we really don't miss them.
The northeast of the US and parts
of the Caribbean
are only a small part of the cruising grounds of the world. Why on earth would you want to compromise your design criteria when a whole world awaits? Seriously, if you want a good all round boat, she's going to have to have some draft to get to windward, and you need that ability sometimes. Pay no attention to the "gentlemen don't go to windward" crowd, think, instead of the shame of being embayed in this day and age!
If sailing is what you want most of all, consider re-locating to somewhere a "blue water" boat will have room for its keel.