I grew up in Hyde Park and Red Hook.
You can check out Norrie Point but I believe they close entirely each winter.
Across the Hudson is Roundout Basin near Kingston. They bubble the large tour boat
Rip Van Winkle there. They may have winter terms.
The Hudson in general is a very active thing, summer or winter. Ice breakers keep shipping
open from NYC
to Albany and floes can stack 20 ft high.