Great Stuff will work. You're correct that it's closed-cell and will NOT wick water. The "Windows and Doors" type will expand less, but once you get the hang of the regular stuff you'll be able to tool it out in just the right amount. Any overspray and you can just cut it back after you've let it dry for a couple hours.