Gulfport City Marina is another possibility, especially if you are sailing in the Gulf as opposed to motoring in the ICW
It's a couple of miles in from Pass -A - Grille inlet and John's Pass and allows you to get back on the Gulf quickly, as opposed to St. Pete, which is a couple of hours into the bay.
A short taxi ride gets you to downtown Gulfport, which is a fun place with good restaurants. A Publix is a longer taxi ride.
You can also get to downtown St. Pete via taxi for a reasonable price
There is a free anchorage in Boca Ciega Bay outside the marina. You can leave your dinghy in downtown Gulfport, but lock it securely to keep it from walking away.