All great suggestions above- but as the poster said- only sailing in Barnegat Bay, no offshore. Boat is 23 foot, so obviously in a storm (especially summer T storm which could pack 50-60 kt winds) heaving too could be recipe for capsize
and sinking in a small boat.
For what you describe - Bay daysailing with severe but short thunderstorms- best option if you can't secure boat and get off, is get as close to shore with protection from western exposure (as most T storms approach from there with strongest winds from west), get sails
down and securely furled, and anchor
with as much line as you have to let out. Then don't touch anything metal....