If you like Nature, Dominica is tops--the best in the eastern Caribbean
. I've stopped there, in the north near Portsmouth, maybe nine times on our cruises. I never found the "boat boys" to be an issue. They have an organization called the Indian River Guides, and are very business-like. One of the Guides will come out in his skiff to greet you when you're approaching Prince Rupert Bay. They take turns, so cruisers won't be overwhelmed by boat boys, as is the case on some other islands.
We became friends with Martin Carrierre (Call sign "Providence" on the VHF), and met his lovely wife and two daughters. He will run you down to Customs
in his skiff to clear in for a small fee ($10EC or $3.70US when we were there). He gave us a real education in the natural history
of the island, and we always came back to the boat with a pile of fresh fruit and vegetables that he would pick off the plants in the forest.
The Guides take courses and are licensed. They will take you on a rowing tour of Indian River, a hike through the wildest rain forest in the Antilles, or a van sight-seeing tour including the only Carib Indian reservation in the Caribbean
. Martin introduced us to a Carib medicine man, who showed us the plants he uses for healing.
You might not really have time to enjoy Dominica on a week's run from Antigua
down to St Lucia, but it would be well worth it if you can fit it in.
The other don't miss in my opinion is Les Isles des Saintes. Very unique in the islands, as it is said to resemble the villages in Britanny in France
Here are a couple of links from Chris Doyles sailing guide website...
Here's Martin with a few bananas he picked for us.